Previous functional imaging studies have shown key roles of the dorsal anterior insula (dAI) and anterior midcingulate cortex (aMCC) in empathy for the suffering of others. The current study mapped structural covariance networks of these regions and assessed the relationship between networks and individual differences in empathic responding in 94 females. Individual differences in empathy were assessed through average state measures in response to a video task showing others' suffering, and through questionnaire-based trait measures of empathic concern. Overall, covariance patterns indicated that dAI and aMCC are principal hubs within prefrontal, temporolimbic, and midline structural covariance networks. Importantly, participants with high empathy state ratings showed increased covariance of dAI, but not aMCC, to prefrontal and limbic brain regions. This relationship was specific for empathy and could not be explained by individual differences in negative affect ratings. Regarding questionnaire-based empathic trait measures, we observed a similar, albeit weaker modulation of dAI covariance, confirming the robustness of our findings. Our analysis, thus, provides novel evidence for a specific contribution of frontolimbic structural covariance networks to individual differences in social emotions beyond negative affect.