The history of leadership change in the Chinese Communist Party (CCP) exemplifies Pareto's notion of circulation of the elite. To analyze it we have compiled a partially ranked dataset of members and alternates of the Politburo Standing Committee, Politburo, and Central Committee for the 1st through 18th National Party Congresses. Quantitative studies of leadership change in the CCP have typically focused on the fraction of new members in each political body from one Party Congress to the next, but the existence of partially ranked data calls for a more subtle quantification of leadership change. Thus, we define a new family of metrics which consider change within each political body, the magnitude of such change, and the importance of each change to CCP structure and policy. We use two of these metrics to compute the distances between each pair of successive, partially-ranked leadership lists in our dataset. Our results capture important political developments from the irregular leadership change of the early years to the subsequent transformation of the CCP into a more institutionalized polity. This metric-based analysis also supplements our understanding of anomalous leadership transitions, intra-Party dynamics, and systemic change in the CCP.