Our knowledge of the mechanisms underlying the vulnerability of the brain's white matter microstructure to cardiovascular risk factors (CVRFs) is still limited. We used a quantitative magnetic resonance imaging (MRI) protocol in a single centre setting to investigate the cross-sectional association between CVRFs and brain tissue properties of white matter tracts in a large community-dwelling cohort (n = 1104, age range 46-87 years). Arterial hypertension was associated with lower myelin and axonal density MRI indices, paralleled by higher extracellular water content. Obesity showed similar associations, though with myelin difference only in male participants. Associations between CVRFs and white matter microstructure were observed predominantly in limbic and prefrontal tracts. Additional genetic, lifestyle and psychiatric factors did not modulate these results, but moderate-to-vigorous physical activity was linked to higher myelin content independently of CVRFs. Our findings complement previously described CVRF-related changes in brain water diffusion properties pointing towards myelin loss and neuroinflammation rather than neurodegeneration.