Hostname: page-component-745bb68f8f-b6zl4 Total loading time: 0 Render date: 2025-01-08T10:19:14.852Z Has data issue: false hasContentIssue false

Reliability Formulas for Independent Decision Data When Reliability Data are Matched

Published online by Cambridge University Press:  01 January 2025

Nageswari Rajaratnam*
Affiliation:
University of Illinois

Abstract

A distinction is made between reliability data and decision data. Each of these sets of data may be matched or independent, depending on whether the same instruments (tests, judges, etc.) are applied to every individual in the group or the instruments to be applied to each individual are selected independently for him. Reliability formulas are developed (for both single observations and for composites of k observations) for the case where reliability data are matched but decision data are independent. Formulas previously reported in the literature are inappropriate for this case.

Type
Original Paper
Copyright
Copyright © 1960 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

This paper was prepared under USPHS Grant M-1839, in which the author is associated with Lee J. Cronbach and Goldine C. Gleser, and is an outgrowth of a more comprehensive conceptualization of reliability being developed in that study. The author is indebted to Dr. Frederic M. Lord for numerous suggestions.

An unpublished paper prepared in 1958 entitled “A generalization of Kuder-Richardson reliability formula 21.”

References

Alexander, H. W. The estimation of reliability when several trials are available. Psychometrika, 1947, 12, 7999.CrossRefGoogle ScholarPubMed
Ebel, R. L. Estimation of the reliability of ratings. Psychometrika, 1951, 16, 407424.CrossRefGoogle Scholar
Edwards, A. L. Statistical analysis, New York: Rinehart, 1958.Google Scholar
Horst, P. A generalized expression for the reliability of measures. Psychometrika, 1949, 14, 2131.CrossRefGoogle ScholarPubMed
Hoyt, C. Test reliability estimated by analysis of variance. Psychometrika, 1951, 6, 153160.CrossRefGoogle Scholar
Kuder, G. F. and Richardson, M. W. The theory of the estimation of test reliability. Psychometrika, 1937, 2, 151160.CrossRefGoogle Scholar
Lord, F. M. Estimating test reliability. Educ. psychol. Measmt, 1955, 15, 325336CrossRefGoogle Scholar
Lord, M. Statistical inferences about true scores. Psychometrika, 1959, 24, 117CrossRefGoogle Scholar
Snedecor, G. W. Statistical methods (5th ed.), Ames, Iowa: Iowa State College Press, 1956.Google Scholar