Self-rated health (SRH) trajectories tend to decline over a lifetime. Moreover, the Cumulative Advantage and Disadvantage (CAD) model indicates that SRH trajectories are known to consistently diverge along socioeconomic positions (SEP) over the life course. However, studies of working adults to consider the influence of work and family conflict (WFC) on SRH trajectories are scarce. We test the CAD model and hypothesise that SRH trajectories diverge over time according to socioeconomic positions and WFC trajectories accentuate this divergence. Using longitudinal data from the Swiss Household Panel (N = 2327 working respondents surveyed from 2004 to 2010), we first examine trajectories of SRH and potential divergence over time across age, gender, SEP and family status using latent growth curve analysis. Second, we assess changes in SRH trajectories in relation to changes in WFC trajectories and divergence in SRH trajectories according to gender, SEP and family status using parallel latent growth curve analysis. Three measures of WFC are used: exhaustion after work, difficulty disconnecting from work, and work interference in private family obligations. The results show that SRH trajectories slowly decline over time and that the rate of change is not influenced by age, gender or SEP, a result which does not support the CAD model. SRH trajectories are significantly correlated with exhaustion after work trajectories but not the other two WFC measures. When exhaustion after work trajectories are taken into account, SRH trajectories of higher educated people decline slower compared to less educated people, supporting the CAD hypothesis.