In 2015, space heating and domestic hot water production accounted for around 40% of the Swiss final energy consumption. Reaching the goals of the 2050 energy strategy will require significantly reducing this share despite the growing building stock. Renewables are numerous but subject to spatial–temporal constraints. Territorial planning of energy distribution systems enabling the integration of renewables requires having a spatial–temporal characterization of the energy demand. This paper presents two bottom-up statistical extrapolation models for the estimation of the geo-dependent heat and electricity demand of the Swiss building stock. The heat demand is estimated by means of a statistical bottom-up model applied at the building level. At the municipality level, the electricity load curve is estimated by combining socio-economic indicators with average consumption per activity and/or electric device. This approach also allows to break down the estimated electricity demand according to activity type (e.g., households, various industry, and service activities) and appliance type (e.g., lighting, motor force, fridges). The total estimated aggregated demand is 94 TWh for heat and 58 TWh for electricity, which represent a deviation of 2.9 and 0.5%, respectively compared to the national energy consumption statistics. In addition, comparisons between estimated and measured electric load curves are done to validate the proposed approach. Finally, these models are used to build a geo-referred database of heat and electricity demand for the entire Swiss territory. As an application of the heat demand model, a realistic saving potential is estimated for the existing building stock; this potential could be achieved through by a deep retrofit program. One advantage of the statistical bottom-up model approach is that it allows to simulate a building stock that replicates the diversity of building demand. This point is important in order to correctly account for the mismatch between gross and net energy saving potential, often called performance gap. The impact of this performance gap is substantial since the estimated net saving potential is only half of the gross one.