Antidepressants that block the serotonin transporter, (Slc6a4/SERT), selective serotonin reuptake inhibitors (SSRIs) improve mood in adults but have paradoxical long-term effects when administered during perinatal periods, increasing the risk to develop anxiety and depression. The basis for this developmental effect is not known. Here, we show that during an early postnatal period in mice (P0-P10), Slc6a4/SERT is transiently expressed in a subset of layer 5-6 pyramidal neurons of the prefrontal cortex (PFC). PFC-SERT+ neurons establish glutamatergic synapses with subcortical targets, including the serotonin (5-HT) and GABA neurons of the dorsal raphe nucleus (DRN). PFC-to-DRN circuits develop postnatally, coinciding with the period of PFC Slc6a4/SERT expression. Complete or cortex-specific ablation of SERT increases the number of functional PFC glutamate synapses on both 5-HT and GABA neurons in the DRN. This PFC-to-DRN hyperinnervation is replicated by early-life exposure to the SSRI, fluoxetine (from P2 to P14), that also causes anxiety/depressive-like symptoms. We show that pharmacogenetic manipulation of PFC-SERT+ neuron activity bidirectionally modulates these symptoms, suggesting that PFC hypofunctionality has a causal role in these altered responses to stress. Overall, our data identify specific PFC descending circuits that are targets of antidepressant drugs during development. We demonstrate that developmental expression of SERT in this subset of PFC neurons controls synaptic maturation of PFC-to-DRN circuits, and that remodeling of these circuits in early life modulates behavioral responses to stress in adulthood.