Hostname: page-component-745bb68f8f-grxwn Total loading time: 0 Render date: 2025-01-08T09:57:43.640Z Has data issue: false hasContentIssue false

A Note on Correcting for Chance Success in Objective Tests

Published online by Cambridge University Press:  01 January 2025

Samuel B. Lyerly*
Affiliation:
The University of North Carolina

Abstract

The conventional scoring formula to “correct for guessing” is derived and is compared with a regression method for scoring which has been recently proposed by Hamilton. It is shown that the usual formula, S = RW/(n−1), yields a close approximation (correct within one point) to the maximum-likelihood estimate of an individual's “true score” on the test, if we assume that the individual “knows” or “does not know” the answer to each item, that guessing at unknown items is random, and that success at guessing is governed by the binomial law. It is also shown that the usual scoring formula yields an unbiased estimate of the individual's “true score,” when the true score is defined as the mean score over an indefinitely large number of independent attempts at the test or at equivalent (parallel) tests.

Type
Original Paper
Copyright
Copyright © 1951 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

Hamilton, C. Horace. Bias and error in multiple-choice tests. Psychometrika, 1950, 15, 151–168.