Hostname: page-component-599cfd5f84-9hh9z Total loading time: 0 Render date: 2025-01-07T07:11:31.146Z Has data issue: false hasContentIssue false
  • English
  • Français

Loss of Information in Estimating Item Parameters in Incomplete Designs

Published online by Cambridge University Press:  01 January 2025

Theo J. H. M. Eggen  and
Norman D. Verhelst
Theo J. H. M. Eggen*
Affiliation:
Cito, The Netherlands
Norman D. Verhelst
Affiliation:
Cito, The Netherlands
*
Requests for reprints should be sent to Theo J.H.M. Eggen, Cito, PO Box 1034, 6801 MG Arnhem, The Netherlands. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

In this paper, the efficiency of conditional maximum likelihood (CML) and marginal maximum likelihood (MML) estimation of the item parameters of the Rasch model in incomplete designs is investigated. The use of the concept of F-information (Eggen, 2000) is generalized to incomplete testing designs. The scaled determinant of the F-information matrix is used as a scalar measure of information contained in a set of item parameters. In this paper, the relation between the normalization of the Rasch model and this determinant is clarified. It is shown that comparing estimation methods with the defined information efficiency is independent of the chosen normalization. The generalization of the method to other models than the Rasch model is discussed.

In examples, information comparisons are conducted. It is found that for both CML and MML some information is lost in all incomplete designs compared to complete designs. A general result is that with increasing test booklet length the efficiency of an incomplete design, compared to a complete design, is increasing, as is the efficiency of CML compared to MML. The main difference between CML and MML is seen in the effect of the length of the test booklet. It will be demonstrated that with very small booklets, there is a substantial loss in information (about 35%) with CML estimation, while this loss is only about 10% in MML estimation. However, with increasing test length, the differences between CML and MML quickly disappear.

Keywords

incomplete designsconditional maximum likelihoodmarginal maximum likelihoodF-informationRasch modelloss of information
Type
Original Paper
Information
Psychometrika , Volume 71 , Issue 2 , June 2006 , pp. 303 - 322
Copyright
Copyright © 2006 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bhapkar, V.P. (1989). Conditioning on ancillary statistics and loss of information in the presence of nuisance parameters. Journal of Statistical Planning and Inference, 21, 139–160.CrossRefGoogle Scholar
Cochran, W.G., & Cox, G.M. (1957). Experimental designs 2nd ed., New York: Wiley.Google Scholar
Eggen, T.J.H.M. (2000). On the loss of information in conditional maximum likelihood estimation of item parameters. Psychometrika, 65, 337–362.CrossRefGoogle Scholar
Eggen, T.J.H.M. (2004). Contributions to the theory and practice of computerized adaptive testing. Arnhem: Citogroep.Google Scholar
Gustafsson, J.-E. (1980). A solution of the conditional estimation problem for long tests in the Rasch model for dichotomous items. Educational and Psychological Measurement, 40, 377–385.CrossRefGoogle Scholar
Huynh, H. (1994). On equivalence between a partial credit item and a set of independent Rasch binary items. Psychometrika, 59, 111–119.CrossRefGoogle Scholar
Masters, G.N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174.CrossRefGoogle Scholar
Molenaar, I.W. (1995). Estimation of item parameters. In Fischer, G.H., & Molenaar, I.W. (Eds.), Rasch models (pp. 39–51). Springer-Verlay: New York.CrossRefGoogle Scholar
Pukelsheim, F. (1993). Optimal design of experiments. New York: Wiley.Google Scholar
Rubin, D.B. (1976). Inference and missing data. Biometrika, 63, 581–592.CrossRefGoogle Scholar
Vale, C.D. (1986). Linking item parameters onto a common scale. Applied Psychological Measurement, 10, 333–344.CrossRefGoogle Scholar