Changes in patterns of activity within the medial prefrontal cortex enable rodents, non-human primates and humans to update their behaviour to adapt to changes in the environment—for example, during cognitive tasks. Parvalbumin-expressing inhibitory neurons in the medial prefrontal cortex are important for learning new strategies during a rule-shift task, but the circuit interactions that switch prefrontal network dynamics from maintaining to updating task-related patterns of activity remain unknown. Here we describe a mechanism that links parvalbumin-expressing neurons, a new callosal inhibitory connection, and changes in task representations. Whereas nonspecifically inhibiting all callosal projections does not prevent mice from learning rule shifts or disrupt the evolution of activity patterns, selectively inhibiting only callosal projections of parvalbumin-expressing neurons impairs rule-shift learning, desynchronizes the gamma-frequency activity that is necessary for learning and suppresses the reorganization of prefrontal activity patterns that normally accompanies rule-shift learning. This dissociation reveals how callosal parvalbumin-expressing projections switch the operating mode of prefrontal circuits from maintenance to updating by transmitting gamma synchrony and gating the ability of other callosal inputs to maintain previously established neural representations. Thus, callosal projections originating from parvalbumin-expressing neurons represent a key circuit locus for understanding and correcting the deficits in behavioural flexibility and gamma synchrony that have been implicated in schizophrenia and related conditions.