Hostname: page-component-745bb68f8f-hvd4g Total loading time: 0 Render date: 2025-01-08T10:06:28.475Z Has data issue: false hasContentIssue false
  • English
  • Français

A Theory of Consistency of Ordering Generalizable to Tailored Testing

Published online by Cambridge University Press:  01 January 2025

Norman Cliff
Norman Cliff*
Affiliation:
University of Southern California
*
Requests for reprints should be sent to Norman Cliff, Department of Psychology, University of Southern California, University Park, Los Angeles, California 90007.
Get access Rights & Permissions [Opens in a new window]

Abstract

Measures of consistency and completeness of order relations derived from test-type data are proposed. The measures are generalized to apply to incomplete data such as from tailored testing. The measures are based on consideration of the items-plus-persons by items-plus-persons matrix as an adjacency matrix in which a 1 means that the row element, whether item or person, dominated the column element. From this the number of item-item and person-person dominance relations can be derived. Indices of consistency are developed which compare the number of dominance relations in a matrix to the number that would occur if it were perfectly consistent and to the number in a random matrix; relations to other indices are noted.

Keywords

computerinteractiveGuttman
Type
Original Paper
Information
Psychometrika , Volume 42 , Issue 3 , September 1977 , pp. 375 - 399
Copyright
Copyright © 1977 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The research reported here was supported by the Office of Naval Research, Contract N00014-75-C-0684, NR150-373. The author wishes to thank Dr. Thomas J. Reynolds for a number of helpful discussions of this material.

References

Reference Note

Shevell, S. K. A scalability coefficient for dominance and proximity data, 1975, Ann Arbor: University of Michigan, Department of Psychology.Google Scholar

References

Airasian, P. W., & Bart, W. M. Ordering theory: A new and useful measurement model. Educational Technology, 1973, 5, 56–60.Google Scholar
Bart, W. M., & Krus, D. J. An ordering-theoretic method to determine hierarchies among items. Educational and Psychological Measurement, 1973, 33, 291–300.CrossRefGoogle Scholar
Birnbaum, A. Some latent trait models and their use in inferring an examinee's ability. In Lord, F. M. & Novick, M. R.(Eds.), Statistical theories of mental test scores, 1968, New York: Addison-Wesley.Google Scholar
Cliff, N. Complete orders from incomplete data: Interactive ordering and tailored testing. Psychological Bulletin, 1975, 82, 289–302.CrossRefGoogle Scholar
Coombs, C. H. A theory of data, 1964, New York: Wiley.Google Scholar
Cronbach, L. J. Coefficient alpha and the internal structure of tests. Psychometrika, 1951, 16, 297–334.CrossRefGoogle Scholar
Ducamp, A., & Falmagne, J. C. Composite measurement. Journal of Mathematical Psychology, 1969, 6, 359–390.CrossRefGoogle Scholar
Ferguson, G. A. On the theory of test discrimination. Psychometrika, 1949, 14, 61–68.CrossRefGoogle ScholarPubMed
Gulliksen, H. Theory of mental tests, 1950, New York: Wiley.CrossRefGoogle Scholar
Guttman, L. The quantification of a class of attributes: A theory and method of scale construction. In Horst, P.(Eds.), The prediction of personal adjustment, 1941, New York: Social Science Research Council.Google Scholar
Guttman, L. The basis for scalogram analysis. In Stouffer, S. A.(Eds.), Measurement and prediction, 1950, New York: Wiley.Google Scholar
Kaiser, H. F., and Michael, W. B. Domain validity and generalizability. Educational and Psychological Measurement, 1975, 35, 31–35.CrossRefGoogle Scholar
Krus, D. J. A computer program for deterministic and probablistic models of order analysis. Educational and Psychological Measurement, 1973, 33, 677–683.Google Scholar
Krus, D. J., & Bart, W. M. An ordering theoretic method of multidimensional scaling of items. Educational and Psychological Measurement, 1974, 34, 525–535.CrossRefGoogle Scholar
Lazarsfeld, P. F., & Henry, N. H. Latent structure analysis, 1968, Boston: Houghton Mifflin.Google Scholar
Loevinger, J. A systematic approach to the construction and evaluation of tests of ability. Psychological Monographs, 1947, 61 (4, Whole No. 285).CrossRefGoogle Scholar
Loevinger, J. The technique of homogeneous test compared with some aspects of “scale analysis” and factor analysis. Psychological Bulletin, 1948, 45, 507–529.CrossRefGoogle Scholar
Lord, F. M., & Novick, M. R. Statistical theories of mental test scores, 1968, New York: Addison-Wesley.Google Scholar