Hostname: page-component-745bb68f8f-v2bm5 Total loading time: 0 Render date: 2025-01-09T16:04:34.593Z Has data issue: false hasContentIssue false
  • English
  • Français

The Significance of Statistical Significance:

Two Authors Restate An Incontrovertible Caution. Why A Book?

Published online by Cambridge University Press:  27 December 2018

Richard Lempert
Get access Rights & Permissions [Opens in a new window]

Abstract

This essay reviews The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives, by Stephen T. Ziliak and Deirdre N. McCloskey. The book's core message is that statistical significance should not be equated with substantive significance and that empirical researchers should convey more information about the magnitude of relationships and effects than many now do. This essay summarizes, approves of, and elaborates on Ziliak and McCloskey's message with special attention to concerns of the legal academy. It clarifies appropriate uses of significance tests within the research framework of controlling for plausible rival hypotheses.

Type
Review Essay
Information
Law & Social Inquiry , Volume 34 , Issue 1 , Winter 2009 , pp. 225 - 249
Copyright
Copyright © American Bar Foundation, 2009 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

References

Ayres, Ian. 1991. Fair Driving: Gender and Race Discrimination in Retail Car Negotiations. Harvard Law Review 104 (4): 817–72.Google Scholar
Baldus, David, Woodworth, George, and Pulaski, Charles. 1990. Equal Justice and the Death Penalty: A Legal and Empirical Analysis. Boston, MA: Northeastern University Press.Google Scholar
Berk, Richard. 2005. New Claims about Executions and General Deterrence: Déjà Vu All Over Again? Journal of Empirical Legal Studies 2:303–30.Google Scholar
Chambers, David L., Clydesdale, Timothy T., Kidder, William C., and Lempert, Richard O. 2005. The Real Impact of Affirmative Action in American Law Schools: An Empirical Critique of Richard Sander's Study. Stanford Law Review 57:1855–98.Google Scholar
Darlington, Richard B. 1968. Multiple Regression in Psychological Research and Practice. Psychological Bulletin 71:161–82.Google Scholar
Ehrlich, Isaac. 1975. The Deterrent Effect of Capital Punishment: A Question of Life and Death. American Economic Review 65:397–417.Google Scholar
Gross, Samuel R., and Mauro, Robert. 1989. Death and Discrimination: Racial Disparities in Capital Sentencing. Boston, MA: Northeastern University Press.Google Scholar
Lempert, Richard. 1966. Strategies of Research Design in The Legal Impact Study: The Control of Plausible Rival Hypotheses. Law & Society Review 1:111–32.Google Scholar
Lempert, Richard. 1981. Desert and Deterrence: An Assessment of the Moral Bases of the Case for Capital Punishment. Michigan Law Review 79:1177–1231.Google Scholar
Liptak, Adam. 2005. For Blacks in Law School, Can Less Be More? New York Times, Feb 13, sec. 4, 3, late edition.Google Scholar
Mangan, Katherine S. 2004. Does Affirmative Action Hurt Black Law Students? Chronicle of Higher Education, Nov 12, A35.Google Scholar
McCloskey, Deirdre, and Ziliak, Stephen T. 1996. The Standard Error of Regressions, Journal of Economic Literature 34 (March): 97–114.Google Scholar
Morrison, Denton E., and Henkel, Ramon E. 1970. The Significance Test Controversy: A Reader. Chicago: Aldine.Google Scholar
Sander, Richard H. 2004. A Systemic Analysis of Affirmative Action in American Law Schools. Stanford Law Review 57:367–483.Google Scholar
Short, Jodi L., and Toffel, Michael W. 2008. Coerced Confessions: Self‐policing in the Shadow of the Regulator. Journal of Law, Economics, & Organization 24:45–71.Google Scholar
Stinchcombe, Arthur L. 1987 1968. Constructing Social Theories. Chicago: University of Chicago Press.Google Scholar
Ziliak, Stephen T., and McCloskey, Deirdre N. 2008. The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives. Ann Arbor: University of Michigan Press.Google Scholar

Cases Cited

Castenada v. Partida, 430 U.S. 482 (1977).Google Scholar
Dukes v. Wal-Mart, Inc., 509 F.3d 1168 (9th Cir. 2007).Google Scholar
Masters v. GlaxoSmithKline Slip Copy, 2008 WL 833085, 2d Cir., March 26, 2008.Google Scholar
United States v. Nacchio, 519 F.3d 1140 (10th Cir. 2008).Google Scholar