The Taihangshan Mountain Belt, in the central North China Craton, represents an important crustal and tectonic boundary. To explore the complex tectonic evolution of this area during the Mesozoic–Cenozoic, we gathered zircon and apatite (U–Th)/He thermochronology data along a vertical transect (elevation of 630−1584 m) of the northern part of the Taihang Mountain Belt. From our data, we observed three separate rapid cooling phases that occurred at 100 Ma, 50−40 Ma and 27 Ma. Combined with previously published geochronological ages, we suggest that the uplift of the Taihang Mountain Belt initiated during the Jurassic and experienced multiphase rapid uplift from the Cretaceous to the Cenozoic. The early Cretaceous rapid cooling/uplifting events are widespread in the North China Craton and are caused by the collision between the Okhotomorsk Block and the East Asian continental margin. The Eocene and Oligocene rapid cooling events correspond to the initial rifting and thermal subsidence of the Bohai Bay Basin, indicating a coupling between the creation of basins and mountains.