Hostname: page-component-7bb8b95d7b-cx56b Total loading time: 0 Render date: 2024-09-12T16:15:32.358Z Has data issue: false hasContentIssue false

Profiling and Proof: Are Statistics Safe?

Published online by Cambridge University Press:  17 April 2020

Abstract

Many theorists hold that outright verdicts based on bare statistical evidence are unwarranted. Bare statistical evidence may support high credence, on these views, but does not support outright belief or legal verdicts of culpability. The vignettes that constitute the lottery paradox and the proof paradox are marshalled to support this claim. Some theorists argue, furthermore, that examples of profiling also indicate that bare statistical evidence is insufficient for warranting outright verdicts.

I examine Pritchard's and Buchak's treatments of these three kinds of case. Pritchard argues that his safety condition explains the insufficiency of bare statistical evidence for outright verdicts in each of the three cases, while Buchak argues that her treatment of the distinction between credence and belief explains this. In these discussions the three kinds of cases – lottery, proof paradox, and profiling – are treated alike. The cases are taken to exhibit the same epistemic features. I identity significant overlooked epistemic differences amongst these three cases; these differences cast doubt on Pritchard's explanation of the insufficiency of bare statistical evidence for outright verdicts. Finally, I raise the question of whether we should aim for a unified explanation of the three paradoxes.

Type
Research Article
Copyright
Copyright © The Royal Institute of Philosophy 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Editors' note: this is the winning entry of the 2019 Philosophy Essay Prize.

References

1 This is not Buchak's term.

2 See Tribe, LaurenceTrial by Mathematics: Precision and Ritual in the Legal ProcessHarvard Law Review 84 (1971) 13291393Google Scholar; Cohen, JonathanThe Probable and the Provable (Oxford: Oxford University Press, 1977)CrossRefGoogle Scholar; Thomson, Judith JarvisLiability and Individualized EvidenceLaw and Contemporary Problems 49 (1986) 199219CrossRefGoogle Scholar; Hock Lai Ho ‘The Legal Concept of Evidence’ Stanford Encyclopedia of Philosophy http://plato.stanford.edu/archives/win2015/entries/evidence-legal/ (Winter 2015); Redmayne, MikeExploring the Proof ParadoxesLegal Theory 14 (2008) 281309CrossRefGoogle Scholar; Di Bello, MarcelloStatistics and Probability in Criminal Trials: The Good, the Bad and the Ugly Doctoral Dissertation, (Stanford University, 2013)Google Scholar; Enoch, David, Spectre, Levi, and Fisher, TaliaStatistical Evidence, Sensitivity, and the Legal Value of KnowledgePhilosophy and Public Affairs 40 (2012) 197224CrossRefGoogle Scholar; Smith, MartinWhen Does Evidence Suffice for Conviction?Mind 127 (2018) 1193-1218CrossRefGoogle Scholar; Martin Smith ‘Accuracy, Proof and the Right Against Wrongful Conviction’ (ms); Clayton Littlejohn ‘Truth, Knowledge, and the Standard of Proof in Criminal Law’ Synthese (2017); Renee Bolinger ‘The Rational Impermissibility of Accepting (Some) Racial Generalizations’ Synthese (2018); Gardiner, GeorgiLegal Burdens of Proof and Statistical Evidence’ in Coady, David and Chase, James (eds.) The Routledge Handbook of Applied Epistemology (Routledge, 2018) 171195Google Scholar; Michael Pardo ‘The Paradoxes of Legal Proof: A Critical Guide’ Boston University Law Review (2019); Julia Staffel ‘Three Puzzles about Lotteries’ in Igor Douven (ed.) Lotteries, Knowledge, and Rational Belief: Essays on the Lottery Paradox (Cambridge University Press, forthcoming). For a survey of proof paradox research, see Gardiner, GeorgiLegal Epistemology’ in Oxford Bibliographies: Philosophy, ed. Pritchard, Duncan (Oxford: Oxford University Press, 2019)Google Scholar.

3 See Morgan, E. M.The Law of Evidence, 1941–45Harvard Law Review 59 (1946) 481576CrossRefGoogle Scholar; Cohen op. cit. note 2, Thomson op. cit. note 2.

4 Pritchard, DuncanEpistemic RiskJournal of Philosophy 113 (2016) 550571CrossRefGoogle Scholar; Pritchard, DuncanLegal Risk, Legal Evidence and the Arithmetic of Criminal JusticeJurisprudence 9 (2018) 108119CrossRefGoogle Scholar. See also Pardo, Michael S.Safety vs. Sensitivity: Possible Worlds and the Law of Evidence24 Legal Theory (2018) 5075CrossRefGoogle Scholar.

5 Pritchard, DuncanEpistemic Luck (Oxford: Oxford University Press, 2005)CrossRefGoogle Scholar; Anti-Luck EpistemologySynthese 158 (2007) 277297CrossRefGoogle Scholar; Safety-Based Epistemology: Whither Now?Journal of Philosophical Research 34 (2009) 3345CrossRefGoogle Scholar; Anti-Luck Virtue EpistemologyJournal of Philosophy 109 (2012) 247279CrossRefGoogle Scholar. Although Pritchard's formulation divides nearby worlds into two discrete classes – nearby possible worlds and very close nearby possible worlds – this is best understood as a continuum: closer worlds are more significant for assessments of safety (2012: 255). For criticisms of Pritchard's safety-based approach to knowledge, see Comesaña, JuanUnsafe KnowledgeSynthese 146 (2005) 395404CrossRefGoogle Scholar; Greco, JohnWorries about Pritchard’s Safety’ Synthese 158 (2007) 299302CrossRefGoogle Scholar; Hiller, Avram and Neta, RamSafety and Epistemic LuckSynthese 158 (2007) 303313CrossRefGoogle Scholar; Pritchard (2009) op. cit. note 5; Miracchi, LisaCompetence to KnowPhilosophical Studies 172 (2015) 2956CrossRefGoogle Scholar; Gardiner, GeorgiSafety’s Swamp: Against the Value of Modal StabilityAmerican Philosophical Quarterly 54 (2017) 119129Google Scholar; Priest, MauraWhy Anti-Luck Virtue Epistemology has No Luck with ClosureLogos and Episteme 8 (2017) 493515CrossRefGoogle Scholar.

6 Harman, GilbertKnowledge, Inference, and ExplanationAmerican Philosophical Quarterly 5 (1968) 164173Google Scholar

7 Redmayne op. cit. note 2; Buchak, LaraBelief, Credence, and NormsPhilosophical Studies 169 (2014) 285311CrossRefGoogle Scholar; Duncan Pritchard, ‘Risk’ Metaphilosophy (2015); Pritchard op. cit. note 4, and others explicitly state that the taxi examples closely resemble, or are identical to, lottery examples. As I argue in section five, the taxi vignettes exhibit significant epistemological differences from lottery vignettes. The prisoner version of the proof paradox more closely resembles the lottery vignettes, although there are nevertheless differences.

8 Pritchard, op. cit. note 4, 118.

9 Op. cit. note 7.

10 Op. cit. note 7, 292.

11 Op. cit. note 7, 299.

12 In reality, most prevalent diseases are multi-factorial and cannot be modelled simply; epidemiologically simple diseases are rare diseases. The American Heart Association reports cardiovascular deaths represent 30% of deaths globally. Nearly 50% African-American adults have cardiovascular disease. Cancer Research UK estimates the lifetime cancer risk is 50% for males, and 45% for females. I am grateful to Jelena Aleksic, Ilya Chevyrev, and Zoltán Molnár for helpful discussions.

13 The CDC reports >9.3% of the US have diabetes, and >33% US adults have prediabetes, where blood sugar levels are higher than normal but not high enough to classify as diabetes. 15–30% of prediabetics develop diabetes within five years. Black and Hispanic adults are about twice as likely to develop diabetes as non-Hispanic white adults.

14 Approximately 27% of males and 3% of females develop a groin hernia; Fitzgibbons, RJ Jr and Forse, RAClinical Practice. Groin Hernias in AdultsThe New England Journal of Medicine 372 (2015) 756–63CrossRefGoogle ScholarPubMed. The male-to-female ratio for colorectal cancer is 1.35 and for bladder cancer is 4.0; Dorak, M. Tefvik and Karpuzoglu, EbruGender Differences in Cancer Susceptibility: An Inadequately Addressed IssueFrontiers in Genetics 3 (2012) 268279CrossRefGoogle Scholar. Prostate and Skene gland cancer might offer a potential real-world analogue for disease B and – if the sexes were reversed – so might breast cancer.

15 Males smoke more (habit H) and contract corresponding diseases (disease C) at a higher rate; the male-to-female lung and bronchus cancer ratio is 1.52 (Dorak and Karpuzoglu op. cit. note 14). The male-to-female tuberculosis ratio approximates 2:1. In some nations smoking might explain up to one third of this sex difference; Nhamoyebonde, Shepherd and Leslie, AlasdairBiological Differences Between the Sexes and Susceptibility to TuberculosisThe Journal of Infectious Diseases 209 (2014) s100–s106CrossRefGoogle ScholarPubMed.

16 Testosterone or cremaster and inguinal canal cells might be real-world analogues of M-molecules. On average, adult male testosterone levels are approximately eight times higher than adult female levels.

17 I argue that the prisoner vignettes, introduced below, are more similar to the Harman lottery vignettes and Kyburg lottery paradox than the taxi vignettes are.

18 Note, however, that Fiona's belief, based on bare statistical evidence, that ‘Jake committed the crime’ is insensitive. If the claim were false, S would nonetheless believe it. If intuitively Fiona's judgement is flawed, this result favours the sensitivity condition as an explanation for the inadequacy of bare statistical evidence.

19 Personal communication, April 2018. I am extremely grateful to Duncan Pritchard for many helpful conversations about these topics.

20 An example: I ask my friend her grandmother's name. She replies truly and would not speak falsely in nearby worlds. Intuitively my resulting actual belief is safe and known; not easily could it be wrong. But this belief violates the more demanding proposed standard: Were I to instead ask many people, on many occasions, eventually likely someone would reply falsely. They would be mistaken or deceptive. Thus the proposed Pritchardian reply impugns many ordinary beliefs.

21 Nesson, CharlesReasonable Doubt and Permissive Inferences: The Value of ComplexityHarvard Law Review 92 (1979) 11871225CrossRefGoogle Scholar.

22 Smith op. cit. note 2; Pardo op. cit. note 2; Lai, Ho HockA Philosophy of Evidence Law (Oxford: Oxford University Press, 2008)Google Scholar; Redmayne op. cit. note 2; Pritchard op. cit. note 4; Buchak op. cit. note 7. Note a vignette can exhibit multiple epistemic errors. This means that Case One judgements could exemplify some shared epistemic faults, such as outright judgement on bare statistical evidence, whilst differing in other epistemic properties, such as whether the evidence is rendered inadequate by high error costs.

23 Kyburg, Henry E.Probability and the Logic of Rational Belief (Wesleyan University Press, 1961)Google Scholar; Makinson, D. C.The Paradox of the PrefaceAnalysis 25 (1965) 205207CrossRefGoogle Scholar.

24 Smith op. cit. note 2.

25 See also discussion of ‘capped convictions’ (Littlejohn, op. cit. note 2). As Smith (op. cit. note 2) notes, in the lottery and preface paradox vignettes once you endorse each individual claim, there is a further question, namely whether to conjoin individual verdicts and endorse the conjunction. The prisoner and taxi cases lack this option. Once you convict each individual, there is no isomorphic further question of whether to additionally convict the conjunction.

26 Several interlocutors have suggested the crime distribution articulated in iPhone One says nothing about the probabilities concerning individuals in the building, but in Prisoner One the base rates do reveal something about the individuals. I demur, but this suggestion gestures at this difference between the iPhone and prisoner cases.

27 Realistic prison populations exhibit subgroups, granted, but these reference classes are not essential to the case. By contrast, we cannot describe the taxi vignette without substantial assumptions about the relevant reference class. Thanks to Andy Mueller, Jon Garthoff, and participants in Sherri Roush's epistemology seminar at UCLA for helpful discussion.

28 Granted, were a judge to often rule against taxi drivers on this evidence, she might eventually rule falsely. But this does not mean the original Taxi One verdict violates Pritchard's classic safety condition; it simply means if the judge continually repeated her method, one day she might judge falsely. As discussed above, many beliefs are safe, according to Pritchard's classic analysis, even though the method can potentially lead to false belief. This includes, for example, belief about a friend's grandparent's name, formed on the basis of asking that friend. Were you to ask many friends, you might one day form a similar belief falsely via a similar method. But this does not impugn the safety of your actual belief, which is modally secure. Put another way, if beliefs are unsafe merely because one day the method (might) result in a false belief, safety is too demanding.

29 A further objection to Pritchard's treatment of the proof and profiling paradoxes is available to advocates of moral encroachment. The objection proceeds: Some vignette judgements are morally weighty, and so by treating the vignettes alike Pritchard thereby overlooks important aspects of epistemic and moral normativity. I describe moral encroachment in section six. For further criticisms of a safety-based approach to explaining the proof paradox, see Georgi Gardiner ‘Legal Evidence and Knowledge’ in Maria Lasonen-Aarnio and Clayton Littlejohn (eds.) The Routledge Handbook of the Philosophy of Evidence (Routledge, forthcoming).

30 Cf. Enoch, Spectre, and Fisher op. cit. note 2; Enoch, David and Fisher, TaliaSense And “Sensitivity”: Epistemic and Instrumental Approaches to Statistical EvidenceStanford Law Review 67 (2013) 557611Google Scholar; David Enoch and Levi Spectre ‘Statistical Resentment' (ms). See also Roush, SherrilynTracking Truth (Oxford: Oxford University Press, 2007)Google Scholar.

31 Pace, MichaelThe Epistemic Value of Moral Considerations: Justification, Moral Encroachment, and James’ ‘Will to Believe’Noûs 45 (2011) 239268CrossRefGoogle Scholar; James Fritz ‘From Pragmatic Encroachment to Moral Encroachment’ Pacific Philosophical Quarterly (2017); Moss, SarahProbabilistic Knowledge (Oxford: Oxford University Press, 2018)CrossRefGoogle Scholar; Basu, RimaRadical Moral Encroachment: The Moral Stakes of Racist BeliefsPhilosophical Issues 29 (2019) 923CrossRefGoogle Scholar; Bolinger op. cit. note 2; Renee Bolinger ‘Varieties of Moral Encroachment’ (ms). For criticisms of moral encroachment, see Gardiner, GeorgiEvidentialism and Moral Encroachment’ in McCain, Kevin (ed.) Believing in Accordance with the Evidence (Springer, 2018) 169195CrossRefGoogle Scholar.

32 Basu, Rima and Schroeder, MarkDoxastic Wronging’ in Kim, Brian and McGrath, Matthew (eds.) Pragmatic Encroachment in Epistemology (Routledge, 2019) 181205Google Scholar.

33 Cf. Basu, RimaBeliefs That Wrong, doctoral dissertation, (University of Southern California 2018)Google Scholar.

34 Op. cit. note 31. For criticism of Moss's moral encroachment view, see Georgi Gardiner ‘Relevance and Risk: How the Relevant Alternatives Framework Models the Epistemology of Risk’ Synthese (forthcoming).

35 Thomson op. cit. note 2; Smith op. cit. note 2; Pritchard op. cit. note 4; Smith, MartinBetween Probability and Certainty: What Justifies Belief (Oxford: Oxford University Press, 2016)CrossRefGoogle Scholar.

36 I am grateful to Mike Ashfield, Fabrizio Cariani, Jon Garthoff, Brian Hedden, Duncan Pritchard, Sherri Roush, Martin Smith, and Timothy Williamson for comments on earlier drafts. Thanks also to Kristoffer Ahlstrom-Vij, Jelena Aleksic, Boris Babic, Sven Bernecker, Renee Bolinger, Lara Buchak, Ilya Chevyrev, Julien Dutant, Amy Flowerree, Alan Hájek, Mareile Håland, Michael Hannon, Seth Lazar, Chad Lee-Stronach, Clayton Littlejohn, Silvia Milano, Zoltán Molnár, Sarah Moss, Andy Mueller, Julia Staffel, Katie Steele, and Brian Talbot for helpful discussions on these topics. I am grateful to audiences at the Ethics and Belief workshop at the University of Cologne, the Ethics and Risk workshop at the Australian National University, the Institute of Philosophy at the University of London, University of Edinburgh, and Oxford University. Finally, many thanks to Sherri Roush’s epistemology seminar at UCLA for fruitful discussions.