Age of onset is a key factor in the linkage analysis of many complex diseases. Current methods in nonparametric linkage analysis are mainly concentrated on the affected relative pairs or affected family members with age of onset information either ignored or taken into account by specifying age-dependent penetrances for liability classes. On the other hand, gamma frailty models were developed in the biostatistics literature to model familial aggregation of age of onset. However, these frailty models cannot be used directly for linkage analysis. This paper extends the gamma frailty model by incorporating inheritance vector information and provides a semiparametric approach for linkage testing. For a given inheritance vector at the putative disease locus, we construct an additive genetic gamma frailty for each individual within a nuclear family and use the Cox proportional hazard model to model age of onset. We derive the conditional hazard ratio parameter for sib pairs and define a likelihood ratio based LOD score statistic under our model. The EM algorithm is used for estimating the parameters and the maximum likelihood functions. Simulated data sets are used to illustrate these new statistical methods.