Hostname: page-component-745bb68f8f-mzp66 Total loading time: 0 Render date: 2025-01-07T10:31:17.312Z Has data issue: false hasContentIssue false
  • English
  • Français

Some Critical Observations of the Test Information Function as a Measure of Local Accuracy in Ability Estimation

Published online by Cambridge University Press:  01 January 2025

Fumiko Samejima
Fumiko Samejima*
Affiliation:
University of Tennessee
*
Requests for reprints should be sent to Fumiko Samejima, 310B Austin Peay Bldg., University of Tennessee, Knoxville, TN 37996-0900.
Get access Rights & Permissions [Opens in a new window]

Abstract

The test information function serves important roles in latent trait models and in their applications. Among others, it has been used as the measure of accuracy in ability estimation. A question arises, however, if the test information function is accurate enough for all meaningful levels of ability relative to the test, especially when the number of test items is relatively small (e.g., less than 50). In the present paper, using the constant information model and constant amounts of test information for a finite interval of ability, simulated data were produced for eight different levels of ability and for twenty different numbers of test items ranging between 10 and 200. Analyses of these data suggest that it is desirable to consider some modification of the test information function when it is used as the measure of accuracy in ability estimation.

Keywords

latent trait modelsdiscrete item responsesdichotomous responsesability estimationcomputerized adaptive testsbiasmaximum likelihood estimationitem response theory
Type
Original Paper
Information
Psychometrika , Volume 59 , Issue 3 , September 1994 , pp. 307 - 329
Copyright
Copyright © 1994 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This research was supported by the Office of Naval Research (N00014-77-C-0360, N00014-87-K-0320, N00014-91-J-1456). I would like to thank one of my former assistants, Barbara Livingston, for help with this manuscript.

References

Birnhaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In Lord, F. M., Novick, M. R. (Eds.), Statistical theories of mental test scores (pp. 395–479). Reading, MA: Addison Wesley.Google Scholar
Kendall, M. G., Stuart, A. (1961). The advanced theory of statistics. Vol. 2, New York: Hafner.Google Scholar
Lord, F. M. (1983). Unbiased estimators of ability parameters, of their variances and of their parallel-form reliability. Psychometrika, 48, 233–245.CrossRefGoogle Scholar
Lord, F. M., Novick, M. R. (1968). Statistical theories of mental test scores, Reading, MA: Addison Wesley.Google Scholar
Samejima, F. (1972). A general model for free-response data. Psychometrika Monograph, No. 18, 37 (1, Pt. 2).Google Scholar
Samejima, F. (1979). Constant information model: a promising item characteristic function, Arlington, VA: Office of Naval Research.Google Scholar
Samejima, F. (1979). Convergence of the conditional distribution of the maximum likelihood estimate, given latent trait, to the asymptotic normality: Observations made through the constant information model, Arlington, VA: Office of Naval Research.Google Scholar
Samejima, F. (1982). Information loss caused by noise in models for dichotomous items, Washington, DC: Office of Naval Research.Google Scholar
Samejima, F. (1983). The constant information model on the dichotomous response level. In Weiss, D. J. (Eds.), New horizons in testing (pp. 287–308). New York: Academic Press.Google Scholar
Samejima, F. (1987). Bias function of the maximum likelihood estimate of ability for discrete item responses, Arlington, VA: Office of Naval Research.Google Scholar
Samejima, F. (1993). An approximation for the bias function of the maximum likelihood estimate of a latent variable for the general case where the item responses are discrete. Psychometrika, 58, 119–138.CrossRefGoogle Scholar
Samejima, F. (1993). The bias function of the maximum likelihood estimate of ability for the dichotomous response level. Psychometrika, 58, 195–209.CrossRefGoogle Scholar