Hostname: page-component-78c5997874-4rdpn Total loading time: 0 Render date: 2024-11-19T14:29:56.086Z Has data issue: false hasContentIssue false

LEONARD SAVAGE, THE ELLSBERG PARADOX, AND THE DEBATE ON SUBJECTIVE PROBABILITIES: EVIDENCE FROM THE ARCHIVES

Published online by Cambridge University Press:  12 April 2021

Carlo Zappia*
Affiliation:
Carlo Zappia: Università degli Studi di Siena (Italy).
*
*Corresponding author. E-mail: [email protected].
Rights & Permissions [Opens in a new window]

Abstract

This paper explores archival material concerning the reception of Leonard J. Savage’s foundational work of rational choice theory in its subjective-Bayesian form. The focus is on the criticism raised in the early 1960s by Daniel Ellsberg, William Fellner, and Cedric Smith, who were supporters of the newly developed subjective approach but could not understand Savage’s insistence on the strict version he shared with Bruno de Finetti. The episode is well known, thanks to the so-called Ellsberg Paradox and the extensive reference made to it in current decision theory. But Savage’s reaction to his critics has never been examined. Although Savage never really engaged with the issue in his published writings, the private exchange with Ellsberg and Fellner, and with de Finetti about how to deal with Smith, shows that Savage’s attention to the generalization advocated by his correspondents was substantive. In particular, Savage’s defense of the normative value of rational choice theory against counterexamples such as Ellsberg’s did not prevent him from admitting that he would give careful consideration to a more realistic axiomatic system, should the critics be able to provide one.

Type
Articles
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s), 2021. Published by Cambridge University Press

I. INTRODUCTION

Throughout the twentieth century, economics has relied on a notion of rationality intended simply as consistency in preferences. While this notion of rationality was not novel in the early 1900s, it was only in the mid-1940s, with the birth of game theory, that the characterization of rational choice proposed by decision theorists became the mainstream view. Since John von Neumann and Oskar Morgenstern (Reference von Neumann and Morgenstern1947), neoclassical economics has assumed that individual agents are able to attach probabilities to pay-off relevant events and to make decisions so as to maximize the expectation of a utility function relative to this probability distribution. But it was the mathematical statistician Leonard Savage (Reference Savage1954) who showed how to make it compelling that individuals should behave as though their beliefs were personal, subjective probabilities. As a result, the domain of rational choice theory was definitely thought to be extended from certainty to risk and uncertainty, the situation under which most real economic choices are made. Since then the traditional notion of homo economicus as utility maximizer has been replaced by that of a “Bayesian” decision-maker, whose preferences satisfy a few basic axioms and who is endorsed with a prior probability distribution over all possible events, to be updated according to Reverend Thomas Bayes’s rule as new pieces of information arrive (Camerer Reference Camerer, Kagel and Roth1995).

As founder of what came to be known as the subjective-Bayesian viewpoint in decision theory, Savage was deeply involved in the development and defense of his approach. In the 1960s Savage published a series of contributions detailing the meaning of the subjective approach to probability and sponsoring its application to statistical practice. On the one hand, he confronted a statistical arena populated by skeptical, if not fiercely adverse, scholars who adhered to the conventional frequentist approach. With the help of his mentor, Bruno de Finetti, and a few other colleagues such as Irving J. Good and David Lindley, in a series of conciliatory but unremitting contributions, Savage (Reference Savage, Barnard and Cox1962a, Reference Savage, Machol and Gray1962b) dealt with the opposition coming from classical statisticians. Following on Abraham Wald’s (Reference Wald1945) seminal idea that statistical problems should be solved as decision problems—that statistical practice needed a reorientation toward an economic approach to testing—in his Foundations of Statistics Savage had hoped to provide the subjectivist bases for traditional inferential statistics (Giocoli Reference Giocoli2013). But on realizing that this was an impossible task, he insisted on the need for new instruments for statistical analysis, to be anchored on prior probability distributions, thus originating a revival of the Bayes theorem and its applications (Edwards et al. Reference Edwards, Lindman and Savage1963). Notwithstanding his efforts, the spreading of the Bayesian viewpoint in statistics was slow, never reaching the status of dominant approach in the field (Fienberg Reference Fienberg2006).

On the other hand, Savage tried to make clear the methodological bases of his approach to economic behavior and decision-making (Savage Reference Savage and Neyman1961, Reference Savage1967a). Unlike statisticians, decision theorists wholeheartedly approved Savage’s proposal to use subjective probabilities, specifically because his contribution clarified the axiomatic structure through which the notion of uncertainty could be reduced to that of risk, and then treated in the set-up conceived by von Neumann and Morgenstern for expected utility theory (Luce and Raiffa Reference Luce and Raiffa1957). Notwithstanding early criticism by Maurice Allais (Reference Allais1953), the mainstream approval of subjective expected utility was so immediate that Savage did not have to defend it, making it possible for him to concentrate mostly on statistical issues in the crucial years before his sudden death in 1971. Indeed, Savage’s perspective remains the mainstream view in rational choice theory and economics in general even today (Blume and Easley Reference Blume, Easely, Durlauf and Blume2008).

But despite general acclaim among economists (Arrow Reference Arrow1958; Hirshleifer Reference Hirshleifer1965; Samuelson Reference Samuelson and Stiglitz1966), Savage’s construct of an ideal rational agent able to maximize her subjective expected utility under both risk and uncertainty was made the subject of what can be termed “inside criticism.” A few scholars who in principle accepted his subjective approach argued nonetheless that the behavioral bases of Savage’s theory were shaky. Specifically, the subjective viewpoint had to confront a counterexample proposed by decision theorist Daniel Ellsberg (Reference Ellsberg1961), who, using an approach similar to Allais’s, devised simple decision problems in which decision-makers were shown to violate the axioms of subjective expected utility.

Today the relevance of the so-called Allais Paradox and Ellsberg Paradox is such that they are usual textbook references, originating a substantial literature under the headings of non-expected utility theory (Machina Reference Machina, Durlauf and Blume2008) and non-Bayesian decision theory (Gilboa and Marinacci Reference Gilboa, Marinacci, Acemoglu, Arellano and Dekel2013). In particular, the Ellsberg Paradox has become both the subject matter of experimental studies (Camerer and Weber Reference Camerer and Weber1992) and the fundamental starting point for almost every study aiming to show that decisions under uncertainty require a wider spectrum of rational decision criteria than the maximization of subjective expected utility (Gilboa Reference Gilboa2009).Footnote 1 Indeed, following on Ellsberg’s claim, a very influential literature on ambiguity in decision-making has tried to provide rational choice theory with new normative standards (Machina and Siniscalchi Reference Machina, Siniscalchi, Machina and Viscusi2014; Gilboa Reference Gilboa2015).

At the time, though, the impact of these paradoxical results was limited. Indeed, Savage had already rejected Allais’s argument in a section of his foundational volume with the claim that he aimed at a normative theory of decision-making, one that could not be dismissed on the descriptive grounds suggested by Allais (Reference Allais1953). Savage’s stance, that rational choice theory must be regarded as a normative, rather than descriptive, theory of economic behavior, still holds, even in the claim of behavioral economists such as Daniel Kahneman (Reference Kahneman2003), who maintain that their own investigations—inspired by repeated observations that actual choices often contradict the theory—do not aim to question its normative validity.Footnote 2

As for Ellsberg, his counterexample never received hearing in Savage’s published contributions. Examining betting behavior in a series of urn examples, Ellsberg (Reference Ellsberg1961) suggested that Savage’s assumption that a single probability prior can always represent the decision-makers’ degrees of belief was too restrictive, involving a significant misrepresentation of uncertainty. He shared with two other subjectivist scholars, economist William Fellner (Reference Fellner1961) and statistician Cedric Smith (Reference Smith1961), the contention that the issue of vagueness cannot be eschewed from decision theory. Supporters of a strict subjective-Bayesian viewpoint such as Howard Raiffa (Reference Raiffa1961) and Harry Roberts (Reference Roberts1963) insisted on the viability of Savage’s solution to reduce uncertainty to risk, and despite replies by Ellsberg (Reference Ellsberg1963) and Fellner (Reference Fellner1963), the criticism did not hinder the subsequent spreading of the new mainstream in the specific variety devised by Savage. Largely, scholars working on both refinement and dissemination of the subjective-Bayesian approach to decision theory dismissed Ellsberg’s critique as normatively irrelevant (Fishburn Reference Fishburn1968; Raiffa Reference Raiffa1968; Luce and Krantz Reference Luce and Krantz1971).

As just mentioned, Savage did not intervene in the debate sparked by his critics. Apart from some brief considerations about vagueness in decision-making—which he thought difficult to theorize about (Savage Reference Savage1967b)—Savage never offered a proper analysis of what came to be known as the Ellsberg Paradox, apparently supporting Raiffa’s rebuttal of Ellsberg’s critique. This may explain why his reaction to the Ellsberg Paradox has never been examined. Compared with the substantial historical literature on the Allais Paradox (Jallais and Pradier Reference Jallais, Pradier., Fontaine and Leonard2005; Heukelom Reference Heukelom2014; Mongin Reference Mongin2019), there are no historically oriented investigations of the debate on the Ellsberg Paradox. However, and while he was also concerned with Smith’s (Reference Smith1961) version of the criticism, Savage devoted attention to the issue of imprecision in decision-making in a long joint paper with de Finetti, written in Italian and never translated into English (de Finetti and Savage Reference de Finetti, Savage and Savage1962). What is more, he corresponded with all his critics, and with de Finetti about how to deal with them.

This paper presents an assessment of the early 1960 debate, concentrating on Savage’s reaction to the criticism coming from a small group of scholars who can be termed “inside” critics of the subjectivist approach. It provides a scrutiny of archival material, examining letters from Savage’s private correspondence with de Finetti, Ellsberg, and Fellner.Footnote 3 This examination shows how Savage—jointly with de Finetti, who was often involved in the exchanges—reacted to the quest for generalization of the subjective viewpoint advocated by his correspondents. Apparently, Savage did not change his mind on the issue, even though his 1962 joint paper with de Finetti presents some significant concessions to Smith (Feduzi et al. Reference Feduzi, Runde and Zappia2014). But the correspondence examined in this paper suggests that Savage’s viewpoint was more nuanced than he admitted in published works.

The paper tries to show that this is relevant for a history of decision theory at least on two grounds. First, archival material shows that Savage never denied, not even in his private exchange with de Finetti, being a deliberate violator of his axioms while confronting Ellsberg’s urns. This is a notable difference with respect to Savage’s negative attitude towards Allais, on which the modern view of decision theory as normatively secure has been built. Second, and more relevantly, the correspondence shows that Savage was more open to a discussion about the normative appeal of his theory than usually assumed. Following on an approach he contributed to developing while in close contact with Jacob Marschak and Tjalling Koopmans—the call for rigor and mathematical precision characterizing the Cowles Commission for Research in Economics in the late 1940s and early 1950s (Koopmans Reference Koopmans1957)—his position was that he would be ready to endorse a possible revision of his axiomatic structure but only in view of a formally detailed alternative set-up, one that neither Ellsberg nor Fellner was able to provide.

As already noted, a significant criticism of the normative kind that opposes the subjective-Bayesian approach is growing in current decision theory and applications (Gilboa et al. Reference Gilboa, Postlewaite and Schmeidler2008). It has been claimed that the standard expected utility model, restricting attention to beliefs modeled by a single additive probability measure, is not convincing when there is no rational way to derive such well-defined beliefs. That is, in the presence of true uncertainty, it fails to distinguish between probabilities based on reliable data and probabilities that result from significant ignorance about the environment in which decisions are made. When the individual agent is aware that important information is missing, the rationality of the subjective-Bayesian approach is highly questionable and it is necessary to look for alternative normative standards. Since such an argument builds on Ellsberg’s classic counterexample—and it was anticipated in the correspondence with Savage we shall examine—the analysis developed in this paper can suggest how Savage would have reacted to the current axiomatic developments recommending a substantial revision of the subjective-Bayesian approach (Gilboa and Marinacci Reference Gilboa, Marinacci, Acemoglu, Arellano and Dekel2013).Footnote 4

II. SAVAGE’S APPROACH

As author of the first comprehensive presentation of what came to be known as the subjective-Bayesian viewpoint, in the late 1950s and 1960s Leonard Jimmie Savage (1917–1971) was widely regarded as its champion.Footnote 5 Among decision theorists the axiomatic set-up of Savage’s Foundations was immediately understood as providing the missing link between von Neumann and Morgenstern’s expected utility theory—where probabilities are objectively given—and a treatment of uncertainty built on rationality principles. This was a long-awaited development by an entire community of scholars fostering a view of the rationality of agents as free from psychological assumptions, that is, not based on introspection but behaviorally founded, derived from observed choices as in the revealed preference approach (Giocoli Reference Giocoli2003, pp. 388–393).

Savage’s main goal was to suggest an economic approach to statistics, to characterize statistics as a behavioral discipline, urging statisticians to embrace an economic way of reasoning when thinking about data. To do this, Savage (Reference Savage1954, p. 7) started off by building up “a highly idealized theory of the behavior of a ‘rational’ person with respect to decisions.” As is well known, Savage’s main result was to demonstrate that an agent maximizing (subjective) expected utility is someone who can be thought of as if obeying a few simple axioms on the set of actions—which Savage called “acts”—she can take, plus certain technical conditions. Together with completeness and transitivity, preferences over acts are assumed to conform to an independence axiom, dubbed the “sure-thing principle” by Savage.Footnote 6 These axioms delimit individual preferences over acts whose consequences are dependent on the possible realization of events—in principle, even singular events with no objective probability attached. Savage then showed that subjective probability distributions over events, satisfying the usual laws of probabilities, can be elicited from choices over acts. This made it possible to enlarge the domain of decision theory from risky situations such as lotteries to apparently every kind of uncertainty.

Already in 1951, on the basis of Savage’s (Reference Savage1950) initial presentation of his ideas, Kenneth Arrow had claimed that a new consensus was emerging about the behavioral significance of a distinction between risk and uncertainty. This was the view worked out at the Cowles Commission for Research in Economics in those years, where developing a “genuine science of economic behavior” implied the acknowledgment that the problem of uncertainty should be addressed with renewed mathematical rigor (Cowles 1950–1951): theoretical research in decision-making under uncertainty became representative of a new methodological approach at Cowles, namely, abstract model-building (Herfeld Reference Herfeld2018, pp. 29–30). At Cowles scholars working on a varieties of areas, most notably general equilibrium theory, were moving beyond calculus towards new mathematical technics, concentrating on existence proofs and representation theorems (Düppe and Weintraub Reference Düppe and Weintraub2014).

As part of this methodological turn away from empirically oriented analysis and to normativism, Savage’s axiomatization of decision-making showed the crucial fact that “Knight’s uncertainties seem to have surprisingly many of the properties of ordinary probabilities” (Arrow Reference Arrow1951, p. 417).Footnote 7 In their celebrated volume on games and decision theory, Duncan Luce and Howard Raiffa (Reference Luce and Raiffa1957, p. 304) opened the chapter on individual decision-making under uncertainty with an endorsement of Savage’s representation of the decision problem in terms of “states of nature,” “acts,” and “consequences.” They praised the “elegant” feature of his approach that “no concept of objective probability is assumed; rather, a subjective probability measure arises as a consequence of his axioms.” Savage (Reference Savage and Neyman1961, p. 576) himself stated that, in the subjectivist viewpoint, probability simply is “an index, in an operational sense …, of a person’s opinion about an event.”Footnote 8

As already noted, not even Maurice Allais’s (Reference Allais1953) questioning about the descriptive validity of the theory had a negative impact on the diffusion of his theoretical corpus, since Savage (Reference Savage1954) had objected to Allais’s critique that the normative content of the theory was untouched with respect to the choices of a rational individual. In response to Allais’s (Reference Allais1953) critique of expected utility—and his own failure, as an experimental subject, to adhere to it when tested—Savage (Reference Savage1954, pp. 102–104) argued that theories of rational behavior have a normative status that is unquestionable even in the light of adverse evidence, which can only indicate “irrational” choices. As a matter of fact, his own experience as a violator was that a rational decision-maker who instinctively violates the theory when confronting Allais’s example will reverse her choice after “thorough deliberation.”Footnote 9

In the early 1960s, then, the historical background of the subjective-Bayesian revolution is one that sees Savage’s approach as amply accepted among decision theorists and favorably imported in economics to deal with microeconomic issues in general. Savage could then stay focused on what had actually been his main aim in the Foundations, that of showing how the subjective probability approach could strengthen Wald’s (Reference Wald1945) viewpoint that every statistical problem should be seen as a decision problem, to be solved by the statistician as if she were a rational decision-maker acting under uncertainty, the uncertainty related to the unknown probability distribution underlying the available data. On realizing that instead of providing stronger, behaviorally founded bases for traditional inference, he had made it necessary to abandon standard inference techniques, Savage concentrated on the spread of new statistical tools and effective methods for inference (Giocoli Reference Giocoli2013).Footnote 10

For instance, his contribution to the Fourth Berkeley Symposium on Mathematical Statistics and Probability was a sort of manifesto for a paradigmatic shift in statistics: Savage objected to the way the traditional view of frequency probability had oriented statistical theory and concentrated on “another view [that] seems now to be entering upon the scene,” the one that “may be called Bayesian or neo-Bayesian” (Savage Reference Savage and Neyman1961, p. 575). As a matter of fact, most of his efforts were directed at an unreceptive audience of frequentists such as George Barnard, Ronald Fisher, Jerzy Neyman, and Egon Pearson, who endorsed a probability approach to statistical inference that was alien to a subjective view of the probability involved.Footnote 11

Therefore, the majority of Savage’s papers after the Foundations of Statistics were devoted to the illustration and defense of the new viewpoint in a quite hostile statistical arena (Lindley Reference Lindley1980).Footnote 12 Since a relevant question in what follows is why Savage did not address in his publications the critical arguments made by a few critics among decision theorists, it can be argued that his resolve to stay focused on the diffusion of his creed among statisticians contributes to explaining Savage’s reluctance to get involved in a foundational debate.

III. FRIENDLY FIRE IN ECONOMICS

The symposium on “Decision under Uncertainty,” published in 1961 in the Quarterly Journal of Economics (QJE), made apparent both the status already gained by Savage’s Foundations as the mainstream treatment of decision-making and a quest for its fundamental reorientation. Decision theorist Daniel Ellsberg (Reference Ellsberg1961) and economist William Fellner (Reference Fellner1961) examined Savage’s subjective probability approach from the viewpoint of adherents to a well-structured theoretical corpus. Specifically, Ellsberg (Reference Ellsberg1961, p. 657) argued that “the Savage axioms, and the general ‘Bayesian’ approach, are unquestionably appropriate when a subject is willing to base his decisions on a definite and precise choice of a particular distribution,” since in such a situation “his uncertainty … is unequivocally in the form of ‘risk.’” But he also questioned Savage’s approach on the grounds that it was not rich enough to deal with all instances of actual decision environments. Both Ellsberg and Fellner found that the reduction of decision-making under uncertainty into the framework von Neumann and Morgenstern (Reference von Neumann and Morgenstern1947) had devised for risk was unwarranted: they disputed that all uncertainties could be reduced to risks.Footnote 13

On the basis of observed violations by a number of colleagues he tested in the late 1950s at the RAND Corporation and Harvard economics department, Ellsberg, a Junior Fellow of the Harvard Society and RAND analyst since 1959, criticized Savage by claiming that vagueness about probabilities could lead individuals to violate the axioms of consistent behavior upon which Bayesian decision theory was based. Savage’s sure-thing principle, in particular, was shown to be violated by individuals acting in what Ellsberg called “ambiguous” environments. Ellsberg’s (Reference Ellsberg1961, p. 646) claim was that, in a series of examples concerning choices from urns containing colored balls, he was able to identify “a class of choice-situations in which many otherwise reasonable people neither wish nor tend to conform to the Savage postulates, nor to the other axiom sets that have been devised.” What is more, Ellsberg suggested that, since in many cases the violations were deliberate—that is, individuals were not inclined to change their choices even after being asked to thoroughly reconsider the significance of the theory—the use of sharp probability priors could be inappropriate even from a normative point of view. In current economics literature these results are well known as the Ellsberg Paradox. Footnote 14

Fellner’s (Reference Fellner1961) argument was motivated on theoretical grounds. Fellner, a professor of economics at Yale University whose book on oligopolistic competition was one of the first to acknowledge the relevance of game theory, but who had been critical of the way von Neumann and Morgenstern dealt with the beliefs of the entrepreneur (Fellner Reference Fellner1949, p. 37–41), objected to the reasonableness of Savage’s assumption. He argued that the observable decision weights that an individual attaches to prospective events—namely, the probabilities attached to an event if the individual actually bets on the event—may differ from the theoretical probabilities she would attach in Savage’s set-up. When the individual regards some of her beliefs as “shaky judgements,” Fellner maintained, subjective probabilities may be distorted, meaning that they would not obey the usual laws of probability, with the distortion depending on the perceived instability of certain judgments. Fellner concluded that this was to be expected in particular when events are unique, that is, when they do not belong to any “standard process” with objective characteristics. In these cases, “we should not regard it as irrational if a person develops a reaction to uncertainty rather than is guided exclusively by mathematical expectations” (Fellner Reference Fellner1961, p. 685). The similarity with Ellsberg was apparent, since Ellsberg had distinguished unambiguous from ambiguous urns, claiming that people usually prefer to bet on an unambiguous urn with respect to an ambiguous one even though the subjective probability attributed to them by Savage’s approach was supposed to be the same.Footnote 15

The “Decision under Uncertainty” QJE symposium had Howard Raiffa arguing in favor of Savage’s approach. Raiffa, a mathematical statistician at Harvard University who was developing new mathematical tools for applied business decisions from a subjective viewpoint (Raiffa and Schlaifer Reference Raiffa and Schlaifer1961), reaffirmed his faith in Savage’s axioms as normative guides.Footnote 16 Referring to experimental sessions he conducted using adaptations of Ellsberg’s example, Raiffa (Reference Raiffa1961, pp. 692–693) admitted that “if certain uncertainties in the problem were in a cloudy or fuzzy form, then very often there was a shifting of gears and no effort at all was made to think deliberately and reflectively about the problem,” confirming the experience of Ellsberg and Fellner. However, the message he drew was different from theirs. Ellsberg’s choice examples simply showed, in his view, that “there is a need to teach people how to cope with uncertainty in a purposive and reflective manner.” Raiffa reported that experimental subjects who were initially inclined to violate the axioms behaved consistently with them when a different way of looking at Ellsberg’s problems was suggested to them.

It is worth noting that the Allais-Savage debate was not referred to by any of those participating in this new round of debate: Allais’s (Reference Allais1953) criticism focused on utility axioms in an unambiguous context with objective probabilities—a situation of risk—while the concern now was the limitations of probability axioms in contexts in which only subjective probabilities were available—a situation of uncertainty. But Raiffa implicitly assumed Savage’s solution to Allais as the conventional way to deal with hypothetical examples: in the experimental sessions he conducted, Raiffa presented to his subjects Ellsberg’s urn problems in a rearranged table form, similarly to what Savage had done (Reference Savage1954, p. 103) when examining Allais’s example.Footnote 17

As is well known, the mainstream endorsed Raiffa’s rejection of Ellsberg, whose paradoxical results had to wait more than twenty years to be addressed consistently in decision theory (Schmeidler Reference Schmeidler1989). But Savage was not involved in the defense of his approach against Ellsberg and Fellner. Quite probably this was because, as noted above and as the correspondence we shall examine later confirms, he was consumed by the debate in what he perceived as the much more relevant statistical arena. As a matter of fact, in Savage’s published works only a few words are dedicated to Ellsberg’s and Fellner’s criticism. Savage’s annotated bibliography prepared for the second edition of the Foundations of Statistics presents the 1961 “Decision under Uncertainty” symposium as “an account of an important line of dissent from the theory of personal probability and utility” (Savage Reference Savage1970, p. 25).Footnote 18 Savage (Reference Savage1970, p. 24) also acknowledges that de Finetti and Savage (Reference de Finetti, Savage and Savage1962) “discuss a large number of doubts and difficulties about the actual application of personal probability.” In fact, the notion of interval-valued, as opposed to sharp, probability prior is examined at length in de Finetti and Savage’s Reference de Finetti, Savage and Savage1962 paper. But neither Ellsberg nor Fellner is mentioned in that paper.

Before turning to what the correspondence shows, it is worth recalling that Savage had already faced the issue of vagueness, in both his Foundations and later contributions. Indeed, we shall see that the private discussion with his critics is reminiscent of a distinction between sure and unsure opinions Savage (Reference Savage1954, p. 58) had examined in his Foundations, concluding: “The notion of ‘sure’ and ‘unsure’ … is vague, and my complaint is precisely that neither the theory of personal probability, as it is developed in this book, nor any other device known to me render the notion less vague.” Later, in what can be seen as an unspoken reference to Ellsberg, Savage (Reference Savage, Machol and Gray1962b, p. 165) remarked: “some people see the vagueness phenomenon as an objection [to precise personal probabilities]; I see it as a truth, sometimes unpleasant but not to be escaped by a new theory.” And when discussing certain “difficulties” in the theory of personal probability, he argued: “Some have tried to reflect the phenomenon of vagueness within the theory, while others believe that, though vagueness must somehow be reckoned with, its nature defies formalization” (Savage Reference Savage1967a, p. 308).

In view of Savage’s commitment to the mathematical rigor sponsored at Cowles—namely, to provide a set of rules constraining the decision-maker’s choices—the issue of whether the critics would be able to propose a formalized version of their suggestions is crucial in the correspondence to which we now turn. As a matter of fact, only critiques amenable to formalization, showing themselves operationally founded, would have caught Savage’s attention. He had indeed insisted from the outset that his theory was not about “what to believe in the face of inconclusive evidence, but … what action to decide upon such circumstances” (Savage Reference Savage1954, p. 2).

IV. ARCHIVAL EVIDENCE: FIRST PART

This section presents the private correspondence between Savage and Ellsberg and Fellner, two professed subjective-Bayesians who ended up as critics of the strict version of the approach. The correspondence is illustrative of Savage’s interest in the topic of vagueness and imprecision in probability priors as a possible generalization of his viewpoint. The main theme that emerges is that Savage did not formulate an outright rejection of the criticism, unlike what he had done when he had to confront Allais’s (Reference Allais1953) critiques. One may be tempted to argue that the fact that Savage did not publicly reply to Ellsberg’s counterexamples should be interpreted as showing that he did not attribute to Ellsberg any significant advance as compared with what he had judged as Allais’s inability to disqualify the normative status of the theory. But the exchange with Ellsberg and Fellner shows instead a more open attitude towards the alleged violations. Rather than a clear-cut denial of interest toward the normative impact of Ellsberg’s suggested violations, Savage seems to show an unwillingness to endorse a less firm subjectivist perspective while still fighting for the acceptance of the core of his viewpoint in the statistical arena.

Ellsberg was explicit about his attempt to influence the subjectivist developments. In his doctoral thesis at Harvard—unpublished for many years but circulated among major contributors to decision theory, including Savage and de Finetti—Ellsberg ([1962] Reference Ellsberg2001, p. xlix) acknowledged that “nearly every page of this study testifies to my intellectual debt to L. J. Savage,” to whom he was grateful “for encouraging me to believe that the arguments and counterexamples presented here deserved serious consideration.” Ellsberg’s claim, never objected to by Savage—neither in his published writings nor in the available archived correspondence—is that Savage was among deliberate violators of his own axioms when tested in February 1958 (Ellsberg Reference Ellsberg1961, p. 654).

However, Ellsberg ([1962] Reference Ellsberg2001, p. 165) defined himself a “less exacting ‘neo-Bayesian’” in the footsteps of Good (Reference Good1952), and presented his comments on Savage’s Foundations as “mainly critical, and by some standards heretical with respect to ‘Bayesian’ principles.” Ellsberg made it clear that the thesis was addressed mostly to “the currently convinced” of the subjective-Bayesian view, and claimed: “very simply: I wish to change their minds … I hope … to persuade them there are more ways of being reasonable under uncertainty than they currently imagine” (Ellsberg [1962] Reference Ellsberg2001, p. liii).Footnote 19 While sending him the thesis manuscript a few days before its defense, in his accompanying letter Ellsberg confesses to Savage: “I see from a copy of your letter to Fellner that I haven’t convinced you yet. That is just as well, since the enclosed manuscript (which is really a 400-page letter to you, designed to change your mind) would hardly have been worth the trouble” (D. Ellsberg to L. J. Savage, May 21, 1962, LJS Papers, 11, 260).

The correspondence collected at Yale University contains only a few letters (ranging from 1961 to 1963) and is surely not exhaustive about the debate among the two, who personally met a few times in the meantime.Footnote 20 The correspondence had started on October 1961 with Savage’s acknowledgment of receipt of the QJE paper sent to him by Ellsberg and his suggestion to forward it to de Finetti, as he often did with correspondents. But there is no evidence that the comments promised by Savage to Ellsberg—in the hope they would arrive “soon enough to affect your thesis, insofar you find them pertinent” (L. J. Savage to D. Ellsberg, February 18, 1962, LJS Papers, 11, 260)—were ever written.Footnote 21

However, even in the absence of a proper answer to Ellsberg, the exchange with de Finetti is illustrative of Savage’s attitude.Footnote 22 Early in 1962 de Finetti asks Savage: “Have you read D. Ellsberg’s note (Quarterly J. of Econ., 75, 4, Nov. Reference Ellsberg1961) that claims that you were ‘inconsistent’ in answering to one of his questions concerning issues such as Smith’s?” (B. de Finetti to L. J. Savage, March 8, 1962, LJS Papers, 8, 194, author’s translation from the original Italian). In his reply, Savage states: “I have not only read Ellsberg’s paper but had a very thorough visit with him here in Ann Arbor. He is intelligent, steeped in the material, but quite blind about certain aspects of it. I feel that there may be a grain of truth in what he is trying to say, but find it very difficult to clear my own head on the subject” (L. J. Savage to B. de Finetti, March 16, 1962, LJS Papers, 8, 194).

We shall see that the reference made by Ellsberg to a letter to Fellner helps in understanding Savage’s reaction. But it is enlightening that after receiving the thesis, Savage urged Ellsberg to send his manuscript to de Finetti, as he had already done with the QJE article. Later in 1962, de Finetti provided his comments in a letter to Ellsberg, forwarded to Savage. De Finetti’s reaction to Ellsberg’s thesis is closely adherent to the subjective-Bayesian canon, which is thoroughly defended. But after pointing out that overall his position was “essentially the same as Raiffa’s,” de Finetti comments on the maximization of expected utility that he used to attribute to Daniel Bernoulli:

I am not inflexible against violators of Bernoullian rule.… This criterion is not a moral law, but simply a distinction between decision rules having and having not a surely desirable property (admissibility); I will deny any reason (if not mathematically disproving the now established Bernoulli/Ramsey/Savage theory) to admit other Criteria than the one “rational,” but I admit many reasons justifying people not willing to follow (in particular senses and cases) the “rational criterion” … [especially because] many complementary aspects are ignored in the mathematical formulation of the goal-function and it is more convenient to take them into account empirically. (B. de Finetti to D. Ellsberg, August 21, 1962, LJS Papers, 8, 195)

Notwithstanding the unsystematic content of the correspondence with Ellsberg, two things are worth noting before moving on to that with Fellner. First, Savage did not take the opportunity given to him by de Finetti to deny the normative significance of his own violations, as actual decision-maker, of the axioms: he did not object, not even in private, to being classified as a deliberate violator of his own axioms by Ellsberg. While of course this cannot but be speculative, we may take this episode as signaling that Savage was more intrigued by the significance of the empirical violation put forward by Ellsberg than he was with respect to Allais’s. Second, while de Finetti used the descriptive/normative distinction in his comments on Ellsberg’s thesis to reject his counterexamples as normatively irrelevant, he contemplated the issue of normative violation. Under the strict condition that a normative counterargument could be taken into account only if “mathematically disproving” the subjective-Bayesian approach, de Finetti admitted that a normative argument against the subjective approach could be of interest.

As already mentioned, there is evidence of Savage’s own reaction to Ellsberg in his exchange with Fellner. Late in 1961, Fellner had asked Savage to comment on his idea of probability distortions in the face of uncertainty, emphasizing the similarity with Ellsberg’s experimental results. Apologizing for not being ready yet to offer a detailed comment on his QJE paper because of other obligations, Savage replied to Fellner in the letter mentioned by Ellsberg:

I had long and serious conversations with Ellsberg in which I am sure I tried sincerely to grasp his point of view, but I emerged with the feeling that his ideas do not represent a step forward from such theories as those expressed in my book, for the normative purpose in which I am interested. Your paper may give me a different slant; we cannot know until I find time to study it. … In particular, I am now very much interested in exploring the implications of the conventional theory of subjective probability for everyday technical statistics. … If the theory of subjective probability, as I understand it, is seriously deficient, these deficiencies will express themselves in my statistical theories. But I think that you and Ellsberg would not question that this theory has promise as a sort of first approximation and deserves to be explored at least on that account. (L. J. Savage to W. J. Fellner, May 10, 1962, LJS Papers, 11, 267)

Savage had taken months to reply to Fellner, pointing to the fact we have already mentioned that his research was devoted to developments in statistical practice rather than foundational issues. Indeed, while trying to convince statisticians that they should use a prior probability in every examination of data, it would have been counterproductive for his approach to admit that this prior can be vague in certain instances of relevance. But Fellner immediately insisted on his point, namely, the cognitive unease of dealing with uncertainty issues as if they were risky ones:

Many people feel differently about staking their fortunes on controversial judgments from how they feel about taking a chance on de facto uncontroversial ones. … in contrast to Raiffa, I have found in recent experiments that a good many very intelligent individuals do not in fact get rid of this inclination, even if the experimenter exposes them quite impartially to both sides of the controversy. … The normative proposition that a person is not entitled to this reaction seems arbitrary to me. (W. J. Fellner to L. J. Savage, May 15, 1962, LJS Papers, 11, 267; italics in the original)

Even this time, Savage was not eager to answer soon. The idea to abandon, or even relax, his main assumption that precise subjective probabilities can be determined and used in every decision problem, while still trying to convince statisticians to follow him in statistical practice, was certainly not on his agenda. But in a reply dated June 1963, the issue raised by Fellner in his letter—and in particular a summary of his argument Fellner had enclosed in it—is re-examined:

[Your summary] says that a certain normative assumption seems arbitrary to you.… Would it not be a step forward in science, and in our conversation, if you were to decide which assumptions in F. of S. seem arbitrary. … A normative proposition may be unsatisfactory without being arbitrary, and the assumptions in F. of S. are certainly unsatisfactory to me in certain ways, though they are still almost the best I know how to propose. … You may say “… let us make assumptions that are more nearly right.” I sympathize. In fact, I do in effect make more nearly correct assumptions in practice. What I do not know how to do is to make a mathematical theory with more realistic assumptions. (L. J. Savage to W. J. Fellner, June 17, 1963, LJS Papers, 11, 267)

And when Fellner pointed at the sure-thing axiom as the arbitrary assumption, Savage replied: “If I understand correctly, the essential point here is whether the original imperfect system exemplified by F. of S. admits mathematical improvement or only improvement by informal commentary. I have expressed a pessimistic opinion about the possibility of the latter, but I trust I would not be blind to a better system should one come along” (L. J. Savage to W. J. Fellner, July 1, 1963, LJS Papers, 11, 267).

It must be stressed, then, that the issue explicitly became whether or not normative progress was possible. Although it appears that Savage no longer showed interest in Fellner’s attempt to discuss a generalization of his viewpoint allowing for vagueness,Footnote 23 the correspondence shows that Savage may have accepted a constructive criticism of his theory, possibly generating a new normative standard, but with the caveat that the new theory would be able to provide theoretical continuity in terms of the way his one was formulated, namely, its axiomatic structure.

In conclusion, the early 1960s exchange with Ellsberg and Fellner signals a positive attitude by Savage (and de Finetti) towards the significance of their criticism. This is not surprising on descriptive grounds: indeed, in those years both Savage and de Finetti had been insisting that theirs was a normative viewpoint, and that descriptive violations were plainly admitted. As already remarked, the axiomatic structure devised by Savage in his Foundations was explicitly intended to provide a normative guide to the formation of consistent beliefs by statisticians. Axioms are instrumental, Savage (Reference Savage1954, p. 20) claimed, “to police my own decision for consistency, and, where possible, to make complicated decisions depend on simpler ones.”Footnote 24

But the correspondence also shows that, while they kept objecting to the possible normative relevance of the specific arguments raised by their critics, Savage and de Finetti considered the normative issue worth discussing. They both showed a more open attitude than they were used to doing in their published works. We have seen, on the one hand, de Finetti asking for a negative argument of mathematical kind, which he considered as a prerequisite to openly consider Ellsberg’s point as of normative value. On the other hand, in his questions to Fellner for axioms apt to replace the sure-thing principle, Savage admitted that a constructive argument would be of interest, insofar as “mathematical improvement” was in principle acceptable.

To be sure, both Savage and de Finetti insisted that more realistic hypotheses should not be detrimental to the normative appeal of the entire axiomatic structure of the subjective approach to decision-making: in particular, Savage would not abandon a normative proposition such as the sure-thing principle—which may appear “unsatisfactory without being arbitrary”—in the absence of an alternative proposition endowed with similar plausibility. But it is remarkable that in the discussion with Ellsberg and Fellner, a possible generalization of the subjective-Bayesian approach—officially denied in print while still fighting for acceptance among statisticians—was contemplated. And, indeed, this is the route followed in decision theory in the 1980s after the experimental evidence confirming Ellsberg’s results became overwhelming and started being interpreted as of normative value.Footnote 25

V. FRIENDLY FIRE IN STATISTICS

As seen in the previous section, both Ellsberg and Fellner aimed at a normative criticism of Savage’s viewpoint, one that could not simply be classified as a descriptive violation of rational choice theory. The attention they received from Savage in private exchange was substantial but ineffective: Savage never really tackled the issue they raised in his publications. Although his counterexamples proved to be puzzling for Savage, Ellsberg’s aim “to change” Savage’s mind failed: the correspondence reveals that neither he nor Fellner was able to provide the requested alternative axiomatic set-up.

This section presents excerpts from the archival evidence available on a distinct but related criticism, suggested by Cedric Smith (Reference Smith1961) with his study on upper and lower probability values in a Bayesian framework. Mostly through an analysis of the thoughts shared with de Finetti while examining Smith’s point, Savage’s understanding of vagueness and possibly imprecise probability priors can be detailed as subtler than usually understood, confirming the evidence already examined on the Ellsberg Paradox.

As we have seen, a core aspect of Savage’s subjective research program was the possibility to provide a behavioral justification of the representation of degrees of belief as probabilities, that is, an operationally founded—in Percy Bridgman’s (Reference Bridgman1927) sense—subjective probability. This step toward behaviorism, refraining from introspection, had been proposed by Frank Ramsey and de Finetti in terms of betting quotients elicited from choices, plus a condition of consistency, usually interpreted as the impossibility to have a “Dutch Book” made against a rational individual. A crucial argument against accepting the vagueness of beliefs Ellsberg and Fellner wanted to allow, in order to deal with what they considered a kind of uncertainty irreducible to risk, was that it would be incompatible with this elicitation procedure.Footnote 26

In their criticism, both Ellsberg and Fellner referred to this aspect. Ellsberg, in particular, devoted an entire section of his doctoral thesis to de Finetti’s “condition of coherence.” For purposes of measurement, de Finetti ([1937] Reference de Finetti, Kyburg and Smokler1964) had regarded probabilities as “prices” and assumed that the highest price an individual is ready to pay for betting in favor of an event—her probability for the realization of the event as a bettor—coincides with the lowest she is ready to accept for taking the other side of the bet—her probability as a bookie. In order to derive a sharp subjective prior satisfying the laws of probability, therefore, no inequality between upper and lower betting prices was allowed by de Finetti. Ellsberg accepted the subjectivists’ methodology of eliciting probability from choices, but he argued that he could see no rationale for the assumption that the decision-maker is always willing to take either side of a bet at the same price, as implied by de Finetti’s reasoning (Ellsberg [1962] Reference Ellsberg2001, p. 68). And in order to clarify his point, Ellsberg referred to the approach of deriving lower and upper probability priors from betting presented by Smith (Reference Smith1961).

Cedric Smith, a statistician at the Galton Laboratory of the University College, London, who specialized in genetics, was among the very few English statisticians endorsing Savage’s subjective-Bayesian perspective from the outset. But Smith’s Reference Smith1961 paper also belonged to the tradition of interval-valued probabilities, an approach that had been investigated by probabilists such as Bernard Koopman (Reference Koopman1940) and Good (Reference Good1952), who had worked in the footsteps of John Maynard Keynes’s ([1921] Reference Keynes1973) notion of epistemic probability and his hint that probabilities might be ordered only partially.Footnote 27 But while Koopman and Good interpreted probabilities simply as “intuitive judgements,” that is, judgments based on introspection prior to objective experience, Smith followed de Finetti in adopting a behavioral perspective. He accepted that subjective beliefs are meaningful only if measured by means of the elicitation of probabilities from betting quotients accepted by individual agents in controlled environments, as in de Finetti ([1937] Reference de Finetti, Kyburg and Smokler1964). But he applied this procedure to derive possibly imprecise beliefs. He showed how to elicit from personal betting quotients upper and lower probability values, and clarified the formal conditions under which the decision-maker can then be attributed an interval of precise initial probabilities. As a result, Smith showed that a decision-maker refusing to bet on either an event or its complement can do so consistently, in de Finetti’s sense.Footnote 28

Ellsberg used Smith’s analysis to argue that the probabilities that can be derived from the choices of a deliberate violator of Savage axioms in his urn examples define an interval of probabilities but cannot be termed “irrational” by means of the Dutch Book argument. Indeed, consistency does not apply only to a set of “precise, definite beliefs,” since “beliefs that must be treated as ‘indefinite’ within limits can still be precise enough to determine decisions in betting, and susceptible of quantitative expression in terms of inequalities” (Ellsberg [1962] Reference Ellsberg2001, p. 88).

VI. ARCHIVAL EVIDENCE: SECOND PART

We have seen earlier that de Finetti mentioned Smith when asking Savage about Ellsberg in his letter of March 1962. And, indeed, in the early 1960s de Finetti and Savage were discussing how to react to Smith’s proposal to generalize the subjective-Bayesian approach in order to allow for interval-valued probability priors. The correspondence between them on this point—mostly related to the drafting of de Finetti and Savage (Reference de Finetti, Savage and Savage1962), a joint paper they were working on—reveals the extent to which interval-valued probabilities could be contemplated. It is also interesting because the tension already emerged in the discussion with Ellsberg and Fellner between what is descriptively versus normatively relevant is even more evident in light of Smith’s argument.

De Finetti and Savage’s (Reference de Finetti, Savage and Savage1962) paper, titled “Sul modo di scegliere le probabilità iniziali” (How to choose the initial probabilities), was intended for a statistical audience. It presents to statisticians a summary of why, in their view, no problem can be correctly stated in statistics without an evaluation of the “initial probabilities.” But it also reflects the two subjectivist scholars’ perplexity with respect to the statement they were publicly defending, namely, that the reference to intervals of prior probabilities may pose “more severe problems than they are intended to resolve” (Savage Reference Savage1962c, p. 150).Footnote 29

Savage’s correspondence with de Finetti shows that it was on Savage’s request that Smith’s contribution was made a subject matter of their investigation. While commenting on the translation into English of a piece by de Finetti, Savage had written: “I wondered whether before concluding on page 65 [of your Lectures] you would want to touch on the allegorical idea of many opinions in one person à la Smith. Also, it is less allegorical and to that extent more satisfactory, to speak of the many systems of opinion not altogether incompatible with the vaguely defined system of a real person” (L. J. Savage to B. de Finetti, March 3, 1961, LJS Papers, 7, 192).

Savage seems to suggest that Smith’s interpretation provides a technical, rather than simply metaphorical, way to introduce the issue of vagueness, and that this makes it worth examining (see also Savage Reference Savage1962d). And, indeed, his concern about imprecise probability priors is reflected in the section of the paper dedicated to Smith that reproduces part of the correspondence between the two authors ensuing from a preliminary draft. In particular, in a letter to de Finetti, Savage is reported to claim:

we seem to argue [in the preliminary draft] that imprecision in probability judgements can be always removed, after providing enough effort … [but] this conclusion is not in harmony with my experience and introspection … there is plenty of serious and relevant events for which I would not be able to state a probability judgement other than with ample uncertainty: for instance, as regards the likelihood of total war in a near future. (L. J. Savage to B. de Finetti, September 1961, as reported in de Finetti and Savage Reference de Finetti, Savage and Savage1962, p. 130; author’s translation from the original Italian)

The issue at stake may appear a descriptive one, but the section on Smith’s approach hints at normative issues. De Finetti and Savage admit that Smith’s “particularly elaborate analysis” of Koopman’s and Good’s idea “to make imprecision precise” provides a precise criterion to determine the two limiting probability values: “In Smith’s case … the objections about the precision of the extreme values do not hold, because he gives a criterion that is … surely ‘precise’” (de Finetti and Savage Reference de Finetti, Savage and Savage1962, p. 135). Moreover, de Finetti and Savage (Reference de Finetti, Savage and Savage1962, p. 141) accept Smith’s considerations about the meaning of being reluctant to betting, since these considerations can refer to “what can be said of a certain behavior when a person has an incomplete knowledge of the opinions justifying a decision.”

This reference to incomplete self-knowledge entails a concession to a possible normative justification of using interval-valued probabilities. In fact, it is illustrated through the analogy with the case of a group of decision-makers who have to make a collective decision on the basis of their sharp but not necessarily unanimous priors—indeed, typically different, since “personal” in the subjective approach. In this case, de Finetti and Savage acknowledge, there is a theoretical, not concrete, difficulty in determining a single (collective) prior.Footnote 30 And this is dubbed as analogous to the situation of an individual who has “various souls leaning towards contrasting opinions,” possibly because she is in doubt about whether to rely on her own sharp prior or on “the ones she has been made aware of by consulting experts she considers highly” (de Finetti and Savage Reference de Finetti, Savage and Savage1962, p. 142).Footnote 31

The correspondence between de Finetti and Savage in the early 1960s is punctuated by scattered but recurrent reference to the issue. For instance, while summarizing the last changes about Smith he had made to the draft of their joint paper, de Finetti writes to Savage:

The intuition I have used here … exemplifies many aspects I understand we should clarify in order to show how to move from a single probability assessment to many (from individual to collective preferences, etc.); so to say, Social choice and individual values under Uncertainty [in English] … I think something of Smith survives in such a purview. (B. de Finetti to L. J. Savage, November 15, 1961, LJS Papers, 7, 193; author’s translation from the original Italian)

To this point, Savage replies with a clear reference to the issue of how to deal with probability priors when more than a single one is admitted:

If upper and lower probabilities are taken seriously, they at least double the vagueness that they intended to alleviate.… Nevertheless, I agree that there is practical importance in exploring the implication of a set of probabilities that might be designed as “acceptable” … I would expect convexity to be an innocuous assumption about a set of acceptable probabilities, and a convex set of probabilities can be well described by inequalities on expectations. (L. J. Savage to B. de Finetti, February 23, 1962, LJS Papers, 8, 194)

The admission that a phenomenon that the subjective viewpoint contemplates as obvious for group decision-making—that the arbitrary opinions of different individuals may not coincide—may also hold true for a single individual represents a significant concession to Smith’s developments and to the other critics of a strict version of the subjective-Bayesian approach. Under the behavioral perspective suggested by Smith, Savage appears to allow vagueness of the beliefs of an individual agent even from a normative perspective, a concession that cannot be retrieved in his published works in English.

As a matter of fact, during discussion with de Finetti about a new joint work that never came out in print, Savage raised the issue at least once more:

We, in the Castellano paper [de Finetti and Savage Reference de Finetti, Savage and Savage1962] repeatedly affirm that anyone who does not act in accordance with some prior distribution exposes himself to unnecessary loss. This thesis seems to me somewhat exaggerated, but of course I hope I am wrong in saying so…. What I seem to be asking for is a derivation of the theory of personal probability as complete and rigorous as that in F. of S. but substantially more convincing and clearer in its practical implications. (L. J. Savage to B. de Finetti, April 22, 1964, LJS Papers, 8, 198)

Even though Savage’s philosophical papers of the late 1960s do not offer any further substantial concession on vagueness, the correspondence suggests that his final position may have been open to a formally consistent representation of it.Footnote 32

VII. CONCLUDING REMARKS

Contemporary decision theory under uncertainty has built on the so-called Ellsberg Paradox to justify theories that reject, on normative grounds, one of the main tenets of the mainstream subjective-Bayesian approach, namely, that individuals have precise probabilistic beliefs over any source of uncertainty (Gilboa et al. Reference Gilboa, Postlewaite and Schmeidler2008). This point was originally made in the early 1960s, when Ellsberg and other critics such as Fellner and Smith argued that the subjective-Bayesian model was too restrictive in its assumptions. These critics considered themselves supporters of the subjective view of probability and decision-making, but they could not understand Savage’s insistence on the strict version he shared with de Finetti. Their attack was directed to Savage’s axiomatic justification of the new paradigm, which in the early 1960s was already regarded by the majority of decision theorists as so compelling that it could attain the status of the mainstream view in decision theory and economics.

To what extent was Savage ready to admit a permissive variation of his theory of decision-making, such as the one suggested in quite similar fashion by Ellsberg, Fellner, and Smith in the early 1960s? The abandonment of one of the building blocks of the subjective-Bayesian approach—the representation of degrees of belief through a sharp probability prior—was never endorsed in his published writings, although he admitted that he found this kind of representation wanting on descriptive grounds. However, the doubts he shared in private correspondence with his critics appear to be extremely relevant since they have normative content.

This paper has documented that in his correspondence with what can be identified as a small group of inside critics of the subjective-Bayesian approach—and at the same time with his co-author de Finetti about how to deal with them—Savage openly examined the issue of how rational choice might be modified when a single individual has less than full understanding of the decision context. The correspondence shows that he never equated Ellsberg’s counterexample with Allais’s, suggesting that he found the former more puzzling than the latter. And that when pressed by Fellner about the implausibility of the sure-thing principle, he suggested a methodological way forward, admitting that normative progress could be envisaged. Moreover, when facing Smith’s operational justification of the criticism, he did not regard as untenable a variant of the subjective approach allowing for interval-valued probability priors.

It can then be concluded that Savage’s reluctance to endorse the critical viewpoint underlying the Ellsberg Paradox was related to methodological caution rather than to rejection of its content. The new notion of mathematical rigor he had endorsed as part of the group of mathematical economists and statisticians he had worked with in the 1950s was crucial to him. His doubts were mostly based on the inability of his critics to provide an alternative theoretical set-up rather than on a clear-cut denial of the normative relevance of their argument. He may have been ready to endorse it had a consistent theoretical corpus and the appropriate axioms been made available by his critics. He died at the age of fifty-four, far too early to see such analytical progress come into reality.

ARCHIVAL COLLECTION

Leonard Jimmie Savage Papers, archived at the Manuscripts and Archives Department of the Yale University Library (New Haven), as MS695.

Footnotes

A previous draft of this paper was presented at the STOREP meeting in Catania (June 2016), at the D-TEA meeting in Paris (June 2019), and at the HES meeting in New York (June 2019). Comments by Marcello Basili, George Bent, Alain Chateauneuf, Alberto Feduzi, David Glasner, Itzhak Gilboa, Philippe Mongin, Aldo Montesano, Jochen Runde, Sam Savage, Francesco Sergi, and three anonymous referees are gratefully acknowledged. Although his recollections of the details of his meetings with Savage are sparse, Daniel Ellsberg’s suggestions were of fundamental importance. The usual caveats apply.

1 A search for articles citing Ellsberg’s Reference Ellsberg1961 paper in the single year 2019 using Google Scholar returns 545 references (search made on January 10, 2020).

2 Throughout this paper, norms of behavior refer to action-guiding principles with prescriptive content (Hands Reference Hands and Maki2012). A normative theory is not intended to state how people actually behave but how they should behave if they wish to achieve certain aims. In decision theory the dichotomy between what is intended to be “descriptive” and what “normative” was first stressed by Marschak (Reference Marschak1950). Luce and Raiffa (Reference Luce and Raiffa1957, p. 63) considered it “crucial that the social scientist recognize that game theory is not descriptive, but rather (conditionally) normative.

3 The whole of the correspondence quoted in this paper is reproduced from the Leonard Jimmie Savage Papers, archived at the Manuscripts and Archives Department of Yale University Library (New Haven), as MS 695. In the following text, references will be made as follows: LJS Papers, Box #, Folder #. The assistance of Michael Frost and other staff members of the Public Services of the Manuscripts and Archives Department of Yale University Library is gratefully acknowledged.

4 Before moving on it should be noted that, although the subject matter of the debate was the so-called Bayesian position revived by Savage, Bayes’s theorem did not have a role in the discussion. On the one hand, Savage did not make extensive use of Bayes’s formula in his Foundations but only in his later research on applications (Edwards et al. Reference Edwards, Lindman and Savage1963). On the other hand, the critics concentrated on the axiomatic set-up of the theory. The issue of how different axiomatic set-ups would impact on the dynamic consistency of choices never surfaced in the debate.

5 Trained as a mathematician, earning his PhD at the University of Michigan in 1941, Savage began working in statistics during wartime at the Columbia University Statistical Research Group with Wald, but he was known among economists for his collaboration with Milton Friedman, whom he met when joining the University of Chicago in 1946. Friedman and Savage (Reference Friedman and Savage1948) assessed the historical developments of the economic theory of risk in order to make apparent the significance of von Neumann and Morgenstern’s (Reference von Neumann and Morgenstern1947) axiomatic approach. Savage’s main work in statistics was influenced by the call for rigor and conceptual precision that pervaded the Cowles Commission under Marschak and Koopmans, to which he was indirectly affiliated as a member of the newly founded Department of Statistics at the University of Chicago, where he worked in the years from 1949 to 1960.

6 As presented by Savage (Reference Savage1967a, p. 306) in an effort to defend its plausibility, the sure-thing principle simply states that “if two acts have the same consequences for some states, the preference between the two acts will not be changed if they are given new common consequences on those states where they are already in agreement and each is left unaltered elsewhere.” On the history of the independence axiom and the sure-thing principle, see Fishburn and Wakker (Reference Fishburn and Wakker1995) and Moscati (Reference Moscati2016).

7 As shown by Moscati (Reference Moscati2016), Paul Samuelson, initially a severe critic, became a resolute supporter of expected utility theory after corresponding with Friedman and Savage on the normative value of an independence axiom. Friedman and Savage (Reference Friedman and Savage1952) and Savage (Reference Savage1952) presented a preliminary version of the 1954 axiomatic set-up, making apparent the normative appeal of grounding a theory of behavior under uncertainty on simple, reasonable axioms.

8 The emphasis on behaviorism, or operationalism à la Bridgman (Reference Bridgman1927), was intended to stress that concepts such as degrees of belief were not introspectively determined, as in the logical approach to probability of Keynes ([1921] Reference Keynes1973) and Jeffreys (Reference Jeffreys1939), but defined in terms of the specific set of operations performed to measure them. De Finetti’s ([1937] Reference de Finetti, Kyburg and Smokler1964) betting odds represented the way in which subjective probabilities could be thought of as bases for consistent decision-making. A similar view was put forward independently by Ramsey ([1931] Reference Ramsey, Kyburg and Smokler1964), the other founder of the subjective approach to probability. Behaviorism and subjectivism were the two key ingredients of Savage’s project (Giocoli Reference Giocoli2013).

9 As is well known, when tested by Allais at a meeting in Paris during the International Colloquium on Risk in May 1952, Savage expressed preferences contradicting his axioms. But after reformulating Allais’s original problem, he later changed his mind and claimed that, in reversing his preferences, he corrected an “error.” Savage (Reference Savage1954, p. 102) argued that “a person who has tentatively accepted a normative theory must conscientiously study situations in which the theory seems to lead him astray; he must decide for each by reflection … whether to retain his initial impression of the situation or to accept the implications of the theory for it.” So, only “deliberate” decisions must show consistency with the axioms of the theory. This defense of the normativity of rational choice theory has been termed a “quasi-empirical” test of rationality (Guala Reference Guala2000). On the Savage-Allais correspondence, see Heukelom (Reference Heukelom2014).

10 As noted by a referee, Savage’s attempt to find a compromise between tradition and innovation in statistics was acknowledged to be technically impossible in the years immediately after publication of the 1954 volume. Only after realizing this—a shift in understanding the depth of his research program that Lindley (Reference Lindley1980, p. 47) suggests happened around 1958—Savage became a committed Bayesian. Savage’s own recollection of his turn away from traditional inference is provided in the preface to the 1972 reprint of the 1954 volume.

11 The frequentist mainstream in statistics was of course a variegated one. For instance, Savage (Reference Savage1962c, p. 149) placed emphasis on Neyman and Pearson’s insistence on behavior, rather than reasoning, while discussing induction, and claimed that “Bayesian statistics can be viewed as a continuation, rather than a contradiction of Neyman-Pearson theory.” However, as testified by the discussion following Savage’s (Reference Savage, Barnard and Cox1962a) presentation of the subjective-Bayesian viewpoint at the Joint Statistics Seminar at Birkbeck and Imperial Colleges in London in 1959, the opposition to Foundations was almost unanimous among contemporary statisticians, with the notable exception of Irving Good and Cedric Smith.

12 Wallis (Reference Wallis and Leonard1981, pp. 22–23) remarks that the Chicago statistics department, which Savage helped create in 1949—also by gathering a group of young statisticians, both as faculty members such as Harry Roberts and David Wallace, and as visiting scholars such as Dennis Lindley, Frederick Mosteller, and John Pratt—and chaired from 1957 to 1960 before moving to the University of Michigan for personal reasons, rejected his request to come back in 1964. Savage interpreted this decision as indifference by his former colleagues to his radical new ideas. He then accepted the proposal by Yale to establish a new statistics department and spent the last few years of his life in New Haven.

13 Following Knight (Reference Knight1921), Luce and Raiffa (Reference Luce and Raiffa1957, p. 13) identified decisions made under risk with a situation when known probabilities can be assigned to the states of the world in the state space, such as when playing roulette in a casino or buying lottery tickets. “Uncertainty” is typified as a situation in which this does not hold true: decisions have as their consequences a set of possible outcomes, but the probabilities of these outcomes are, unlike risk, unknown, such as when betting on horse races.

14 The extent to which Ellsberg insisted on the normative falsification of Savage’s view, a point largely disregarded in current decision theory, is examined in Zappia (Reference Zappia2018).

15 Although long unaddressed, Ellsberg’s urn examples and Fellner’s intuition were crucial for subsequent developments providing an alternative axiomatic structure for decision-making—based on multiple and non-additive probability priors—in what is usually called the “ambiguity literature” (Gilboa Reference Gilboa2009; Machina and Siniscalchi Reference Machina, Siniscalchi, Machina and Viscusi2014). Among an increasing number of applications, Nobel Prize laureates Lars Hansen and Thomas Sargent endorsed this view in their studies on the potential misspecification of macroeconomic policy models under uncertainty (Hansen Reference Hansen2014).

16 It must be remarked that Raiffa and Schlaifer (Reference Raiffa and Schlaifer1961) presented subjective expected utility as the theory of decision-making for business studies, a normative guide for practical behavior, showing that Savage’s original goal to provide a normative guide for statisticians had already transcended to business applications.

17 Ellsberg’s counterargument, that Raiffa’s reformulation of his problems suppressed significant information in the original data, was provided in his doctoral thesis (Ellsberg [1962] Reference Ellsberg2001, pp. 241–246). The fact that Ellberg did not publish his thesis before being definitely absorbed in his role as strategic analyst at RAND and the US Department of Defense contributed to his defeat. Ellsberg (Reference Ellsberg2002) provides a memoir of his sudden turn away from academics and involvement in the Vietnam War and the diffusion of the so-called Pentagon Papers.

18 Savage (Reference Savage1954, p. 3) preferred to call “personal” the probabilities of what came to be known as the “subjective” probability approach.

19 On Ellsberg’s arguments in favor of a generalized version of the Bayesian approach in his thesis, see Levi (Reference Levi and Ellsberg2001) and Zappia (Reference Zappia2016). Binmore (Reference Binmore2009) provides an assessment of Savage’s approach from an Ellsbergian perspective.

20 The two surely met to discuss Ellsberg’s theory at least once in March 1962, while Ellsberg was writing his thesis, submitted in April 1962. The correspondence alludes also to what appears to be their last meeting in May 1963. Savage was on the verge of moving to New Haven, while Ellsberg had already become heavily involved in his activity as military analyst for the US Department of Defense (Ellsberg Reference Ellsberg2002).

21 Unfortunately, Ellsberg has no detailed recollection of his meetings with Savage and does not remember whether he ever received written comments from him (personal communication, email dated September 6, 2016).

22 As we shall see, the exchange between Savage and de Finetti was constant and significant. They had been corresponding since the early 1950s and de Finetti’s presentation at the Second Berkeley Symposium on Mathematical Statistics (de Finetti Reference de Finetti and Neyman1951). Savage could understand Italian, so de Finetti could write him in his native language. In the early 1960s, after Savage spent a sabbatical in Rome in the academic year 1958–59, the correspondence became huge, containing dozens of letters each year.

23 In a letter of August 1963, Feller insisted that the phenomenon of imprecision could be addressed by a new theory but he could not provide any axiomatic justification for his point. It is, then, not surprising that the Leonard Jimmie Savage Papers do not contain any further letter from Savage to Fellner, although this absence could also be explained by Savage’s 1964 move to New Haven where Fellner was Sterling Professor of Economics and they may have met.

24 As for de Finetti, an editorial note he added to the 1964 English translation of his 1937 classic—commenting on his original claim that the rules of probability calculus are applied, albeit unconsciously, “by all men in all circumstances of life”—reads as follows: “in order to avoid frequent misunderstandings it is essential to point out that probability theory is not an attempt to describe actual behavior; its subject is coherent behavior, and the fact that people are only more or less coherent is inessential” (de Finetti [1937] Reference de Finetti, Kyburg and Smokler1964, p. 111).

25 Schmeidler’s (Reference Schmeidler1989) axiom of comonotonic independence among acts—on which Choquet expected utility theory with non-additive probability priors is based—arguably represents the kind of replacement Savage may have requested. On the normative appeal of the current developments in rational choice theory rejecting a strict version of Bayesianism, see Gilboa (Reference Gilboa2015).

26 The issue of consistency in betting was popularized through the so-called Dutch Book argument, which refers to a betting situation designed by a bookie so that a bettor accepting the offered betting prizes loses, no matter how events turn out. De Finetti ([1937] Reference de Finetti, Kyburg and Smokler1964, p. 103) showed that in order to be immune to Dutch Books, the subjective probabilities of an individual had to satisfy the basic properties of a probability measure. Kyburg (Reference Kyburg1978, p. 159) described the Dutch Book argument as a “fundamental nexus” in which logic and behavior meet in the subjectivist interpretation of probability.

27 The primacy of Keynes’s Treatise on Probability in introducing the issue that epistemic probabilities may be “non numerical” (i.e., not sharply determined) and that confidence in a probability assessment may vary was admitted by Ellsberg in his doctoral thesis. On Keynes’s role in the philosophy of probability, see Gillies (Reference Gillies2000).

28 Smith illustrated his viewpoint as follows: “if I am willing to bet 2 to 1 on sun against rain, and 1 to 4 on rain against sun, this means that I regard sun as between 2 and 4 times as probable as rain; and I do not need to be more precise than this.” As a result, the elicitation of probabilities from choices entails that “probabilities and utilities are no longer uniquely defined, but, in accordance with human vagueness and imprecision, they are only determined within a certain range” (Smith Reference Smith1965, p. 478). For an analysis of Smith’s role in the development of the imprecise probability approach in statistics, see Walley (Reference Walley1991).

29 The paper was not translated into English, and was known among Bayesians only through a long English summary written by Savage (Reference Savage1962c). But Savage’s English summary was written before de Finetti, on Savage’s request, drafted the additional section on Smith to which the correspondence examined in this section refers. Therefore, the content of the section devoted to Smith never appeared in English (excerpts reproduced here are translations from the Italian original made by the author). For a detailed analysis of the genesis of de Finetti and Savage (Reference de Finetti, Savage and Savage1962) see Feduzi et al. (Reference Feduzi, Runde and Zappia2014), on which this section partly draws.

30 Both in his appraisal of Wald (Savage Reference Savage1951) and in the second part of his Foundations (Savage Reference Savage1954, ch. 10), Savage did not tackle the issue of group decision-making within a proper subjectivist perspective. Indeed, within it there is no obvious way to reconcile individual personal priors. As noted by Giocoli (Reference Giocoli2013, pp. 84–85), in order to get to a rule that a group should adopt when making decisions, Savage admitted, it was necessary to rely on Wald’s minimax rule. De Finetti had autonomously come to the same discomfiting conclusion in de Finetti (Reference de Finetti1954).

31 This example corresponds to what economists today would call a situation of conflicting evidence (Smithson Reference Smithson1999). Situations of this kind are of course quite common in practical decision situations, but may also be considered a failure of subjective-Bayesian rationality. Ellsberg ([1962] 2001) identified conflicting evidence as one of the causes justifying deliberate violations of Savage’s axioms. In statistical literature, Walley (Reference Walley1991, p. 214) lists the conflict between expert opinions as a notable example of “imprecision [that] reflects unavoidable indeterminacy rather than incomplete modelling.”

32 Further evidence is provided by the correspondence with de Finetti concerning the drafting of de Finetti’s (Reference de Finetti1967) entry on probability interpretations for the International Encyclopaedia of Social Sciences, a paper written in mid-1962 in which Smith’s position is given prominent attention. On this point see Feduzi et al. (Reference Feduzi, Runde and Zappia2017).

References

REFERENCES

Allais, Maurice. 1953. “Le comportement de l’homme rationnel devant le risque: critique des postulats et axioms de l’ecole americaine.” Econometrica 21 (4): 503546.CrossRefGoogle Scholar
Arrow, Kenneth J. 1951. “Alternative Approaches to the Theory of Choice in Risk-Taking Situations.” Econometrica 19 (4): 404437.CrossRefGoogle Scholar
Arrow, Kenneth J. 1958. “Utilities, Attitudes, Choices: A Review Note.” Econometrica 26 (1): 123.CrossRefGoogle Scholar
Blume, Lawrence E., and Easely, David. 2008. “Rationality.” In Durlauf, S. N. and Blume, L. E., eds., The New Palgrave Dictionary of Economics . Second edition. Volume 6. London: Palgrave Macmillan, pp. 7484.Google Scholar
Binmore, Ken. 2009. Rational Decisions . Princeton: Princeton University Press.Google Scholar
Bridgman, Percy W. 1927. The Logic of Modern Physics . New York: MacMillan.Google Scholar
Camerer, Colin F. 1995. “Individual Decision Making.” In Kagel, J. and Roth, A. E., eds., Handbook of Experimental Economics . Princeton: Princeton University Press, pp. 587703.Google Scholar
Camerer, Colin F., and Weber, Martin. 1992. “Recent Developments in Modelling Preferences: Uncertainty and Ambiguity.” Journal of Risk and Uncertainty 5 (4): 325370.CrossRefGoogle Scholar
Cowles Commission for Research in Economics. 1950–51. “Rational Decision-Making and Economic Behavior.” 19th Annual Report: July 1, 1950–June 30, 1951.Google Scholar
de Finetti, Bruno. [1937] 1964. “Foresight: Its Logical Laws, Its Subjective Sources.” In Jr. Kyburg, H. E.and Smokler, H. E., eds., Studies in Subjective Probability . New York: Wiley, pp. 94158.Google Scholar
de Finetti, Bruno. 1951. “Recent Suggestions for the Reconciliation of Theories of Probability.” In Neyman, J., ed., Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability . Berkeley: University of California Press, pp. 217225.Google Scholar
de Finetti, Bruno. 1954. “Media di decisioni e media di opinioni.” Bulletin of International Statistical Institute 34: 114.Google Scholar
de Finetti, Bruno. 1967. “Probability: Interpretations.” In International Encyclopedia of Social Sciences. New York: Macmillan, pp. 496505.Google Scholar
de Finetti, Bruno, and Savage, Leonard J.. 1962. “Sul modo di scegliere le probabilità iniziali.” Biblioteca del Metron, Serie C 1: 81–147. Reprinted in Savage, Leonard J., The Writings of Leonard Jimmie Savage: A Memorial Selection . Washington, DC: American Statistical Association and Institute of Mathematical Statistics, 1981, pp. 308381.Google Scholar
Düppe, Till, and Weintraub, Roy E.. 2014. Finding Equilibrium: Arrow, Debreu, McKenzie and the Problem of Scientific Credit . Princeton: Princeton University Press.Google Scholar
Edwards, Ward, Lindman, Harold, and Savage, Leonard J.. 1963. “Bayesian Statistical Inference for Psychological Research.” Psychological Review 70 (3): 193242.CrossRefGoogle Scholar
Ellsberg, Daniel. 1961. “Risk, Ambiguity, and the Savage Axioms.” Quarterly Journal of Economics 75 (4): 643669.CrossRefGoogle Scholar
Ellsberg, Daniel. [1962] 2001. Risk, Ambiguity and Decision . New York: Routledge.Google Scholar
Ellsberg, Daniel. 1963. “[Risk, Ambiguity, and the Savage Axioms:] Reply.” Quarterly Journal of Economics 77 (2): 336342.CrossRefGoogle Scholar
Ellsberg, Daniel. 2002. Secrets: A Memoir of Vietnam and the Pentagon Papers . New York: Penguin Books.Google Scholar
Feduzi, Alberto, Runde, Jochen, and Zappia, Carlo. 2014. “De Finetti on Uncertainty.” Cambridge Journal of Economics 38 (1): 121.CrossRefGoogle Scholar
Feduzi, Alberto, Runde, Jochen, and Zappia, Carlo. 2017. “De Finetti and Savage on the Normative Relevance of Imprecise Reasoning: A Reply to Arthmar and Brady.” History of Economic Ideas 25 (1): 211223.Google Scholar
Fellner, William. 1949. Competition Among the Few . New York: Kelley.Google Scholar
Fellner, William. 1961. “Distortion of Subjective Probabilities as a Reaction to Uncertainty.” Quarterly Journal of Economics 75 (4): 670689.CrossRefGoogle Scholar
Fellner, William. 1963. “Slanted Subjective Probabilities and Randomization: A Reply to Howard Raiffa and K. R. W. Brewer.” Quarterly Journal of Economics 77 (4): 676690.CrossRefGoogle Scholar
Fienberg, Stephen E. 2006. “When Did Bayesian Inference become ‘Bayesian’? Bayesian Analysis 1 (1): 140.CrossRefGoogle Scholar
Fishburn, Peter C. 1968. “Utility Theory.” Management Science 14 (5): 335378.CrossRefGoogle Scholar
Fishburn, Peter C., and Wakker, Peter. 1995. “The Invention of the Independence Condition for Preferences.” Management Science 41 (7): 11301144.CrossRefGoogle Scholar
Friedman, Milton, and Savage, Leonard J.. 1948. “The Utility Analysis of Choices Involving Risk.” Journal of Political Economy 56 (4): 279304.CrossRefGoogle Scholar
Friedman, Milton, and Savage, Leonard J.. 1952. “The Expected-Utility Hypothesis and the Measurability of Utility.” Journal of Political Economy 60 (6): 463474.CrossRefGoogle Scholar
Gilboa, Itzhak. 2009. Theory of Decision Under Uncertainty . Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Gilboa, Itzhak. 2015. “Rationality and the Bayesian Paradigm.” Journal of Economic Methodology 22 (3): 312334.CrossRefGoogle Scholar
Gilboa, Itzhak, and Marinacci, Massimo. 2013. “Ambiguity and the Bayesian Paradigm.” In Acemoglu, D., Arellano, M., and Dekel, E., eds., Advances in Economics and Econometrics . Volume I. Cambridge: Cambridge University Press, pp. 179241.CrossRefGoogle Scholar
Gilboa, Itzhak, Postlewaite, Andrew, and Schmeidler, David. 2008. “Probability and Uncertainty in Economic Modelling.” Journal of Economic Perspectives 22 (3): 173188.CrossRefGoogle Scholar
Gillies, Donald. 2000. Philosophical Theories of Probability . London: Routledge.Google Scholar
Giocoli, Nicola. 2003. Modeling Rational Agents . Cheltenham: Edward Elgar.Google Scholar
Giocoli, Nicola. 2013. “From Wald to Savage: Homo Economicus Becomes a Bayesian Statistician.” Journal of the History of Behavioral Sciences 49 (1): 6395.CrossRefGoogle ScholarPubMed
Good, Irving J. 1952. “Rational Decisions.” Journal of the Royal Statistical Society, Series B 14 (1): 107114.Google Scholar
Guala, Francesco. 2000. “The Logic of Normative Falsification: Rationality and Experiments in Decision Theory.” Journal of Economic Methodology 7 (1): 5993.CrossRefGoogle Scholar
Hands, D. Wade. 2012. “The Positive-Normative Dichotomy and Economics.” In Maki, U., ed., Philosophy of Economics . Amsterdam: Elsevier, pp. 291–240.Google Scholar
Hansen, Lars P. 2014. “Nobel Lecture: Uncertainty Outside and Inside Economic Models.” Journal of Political Economy 122 (5): 945987.CrossRefGoogle Scholar
Herfeld, Catherine. 2018. “From Theories of Human Behavior to Rules of Rational Choice: Tracing a Normative Turn at the Cowles Commission, 1943–54.” History of Political Economy 50 (1): 148.CrossRefGoogle Scholar
Heukelom, Floris. 2014. Behavioral Economics: A History . Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Hirshleifer, J. 1965. “Investment Decision under Uncertainty: Choice-Theoretic Approaches.” Quarterly Journal of Economics 79 (4): 509536.CrossRefGoogle Scholar
Jallais, Sophie, and Pradier., Pierre-Charles 2005. “The Allais Paradox and Its Immediate Consequences for Expected Utility Theory.” In Fontaine, P. and Leonard, R., eds., The Experiment in the History of Economics . London: Routledge, pp. 2549.Google Scholar
Jeffreys, Harold. 1939. Theory of Probability . Oxford: Oxford University Press.Google Scholar
Kahneman, Daniel. 2003. “Maps of Bounded Rationality: A Perspective on Intuitive Judgment.” American Economic Review 93 (5): 14491475.CrossRefGoogle Scholar
Keynes, John M. [1921] 1973. A Treatise on Probability. Volume VII. The Collected Writings of John Maynard Keynes . London: Macmillan.Google Scholar
Knight, Frank H. 1921. Risk, Uncertainty and Profit . Boston: Houghton Mifflin.Google Scholar
Koopman, Bernard O. 1940. “The Axioms and Algebra of Intuitive Probability.” Annals of Mathematics 41: 269292.CrossRefGoogle Scholar
Koopmans, Tjalling J. 1957. Three Essays on the State of Economic Science . London: McGraw-Hill.Google Scholar
Kyburg, Henry E. Jr. 1978. “Subjective Probability: Criticisms, Reflections and Problems.” Journal of Philosophical Logic 7 (1): 157180.CrossRefGoogle Scholar
Levi, Isaac. 2001. “Introduction.” In Ellsberg, Daniel, Risk, Ambiguity and Decision . New York: Routledge, pp. ixxxxvii.Google Scholar
Lindley, Dennis V. 1980. “Savage. His Work in Probability and Statistics.” Annals of Statistics 8 (1): 124.CrossRefGoogle Scholar
Luce, Duncan R., and Krantz, David H.. 1971. “Conditional Expected Utility.” Econometrica 39 (2): 253271.CrossRefGoogle Scholar
Luce, Duncan R., and Raiffa, Howard. 1957. Games and Decisions . New York: Wiley.Google Scholar
Machina, Mark J. 2008. “Non-expected Utility Theory.” In Durlauf, S. N. and Blume, L. E., eds., The New Palgrave Dictionary of Economics . Second edition. Volume 6. London: Palgrave Macmillan, pp. 884893.Google Scholar
Machina, Mark J., and Siniscalchi, Marciano. 2014. “Ambiguity and Ambiguity Aversion.” In Machina, M. J. and Viscusi, W. K., eds., The Handbook of the Economics of Risk and Uncertainty . Volume I. Amsterdam: Elsevier, pp. 729807.Google Scholar
Marschak, Jacob. 1950. “Rational Behavior, Uncertain Prospects, and Measurable Utility.” Econometrica 18 (1): 111142.CrossRefGoogle Scholar
Mongin, Philippe. 2019. “The Allais Paradox: What It Became, What It Really Was, What It Now Suggests to Us.” Economics and Philosophy 35 (3): 423459.CrossRefGoogle Scholar
Moscati, Ivan. 2016. “Retrospectives. How Economists Came to Accept Expected Utility Theory. The Case of Samuelson and Savage.” Journal of Economic Perspectives 30 (2): 219236.CrossRefGoogle Scholar
Raiffa, Howard. 1961. “Risk, Ambiguity, and the Savage Axioms: A Comment.” Quarterly Journal of Economics 75 (4): 690694.CrossRefGoogle Scholar
Raiffa, Howard. 1968. Decision Analysis. Introductory Lectures on Choices under Uncertainty . Reading: Addison-Wesley.Google Scholar
Raiffa, Howard, and Schlaifer, Robert. 1961. Applied Statistical Decision Theory . Boston: Harvard University Press.Google Scholar
Ramsey, Frank P. [1931] 1964. “Truth and Probability.” In Jr. Kyburg, H. E. and Smokler, H. E., eds., Studies in Subjective Probability . New York: Wiley, pp. 94158.Google Scholar
Roberts, Harry. 1963. “Risk, Ambiguity, and the Savage Axioms: A Comment.” Quarterly Journal of Economics 77 (2): 327336.CrossRefGoogle Scholar
Samuelson, Paul A. 1966. “Postscript.” In Stiglitz, J. E., ed., The Collected Scientific Papers of Paul A. Samuelson . Volume I. Cambridge, MA: MIT Press, pp. 124126.Google Scholar
Savage, Leonard J. 1950. “The Role of Personal Probability in Statistics.” Econometrica 18 (2): 183184.Google Scholar
Savage, Leonard J. 1951. “The Theory of Statistical Decision.” Journal of the American Statistical Association 46 (253): 5567.CrossRefGoogle Scholar
Savage, Leonard J. 1952. “Une axiomatisation du comportement raisonnable face à l’incertitude.” Économétrie : 2933.Google Scholar
Savage, Leonard J. 1954. The Foundations of Statistics . New York: Wiley.Google Scholar
Savage, Leonard J. 1961. “The Foundations of Statistics Reconsidered.” In Neyman, J., ed., Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability . Volume I. Berkeley: University of California Press, pp. 575586.Google Scholar
Savage, Leonard J.. 1962aSubjective Probabilities and Statistical Practice.” In Barnard, G. A. and Cox, D. R., eds., The Foundations of Statistical Inference: A Discussion . London: Methuen, pp. 935.Google Scholar
Savage, Leonard J. 1962b. “Bayesian Statistics.” In Machol, R. F. and Gray, P., eds., Recent Developments in Decision and Information Processes . New York: Macmillan, pp. 161194.Google Scholar
Savage, Leonard J.. 1962cEnglish Summary.” Biblioteca del Metron, Serie C 1: 148151.Google Scholar
Savage, Leonard J. 1962d. “Review of C. A. B. Smith 1961.” Mathematical Reviews 23: A1414.Google Scholar
Savage, Leonard J.. 1967aDifficulties in the Theory of Personal Probability.” Philosophy of Science 34 (4): 305310.CrossRefGoogle Scholar
Savage, Leonard J. 1967b. “Implications of Personal Probability for Induction.” Journal of Philosophy 64 (4): 593607.CrossRefGoogle Scholar
Savage, Leonard J. 1970. “Reading Suggestions for the Foundations of Statistics .” American Statistician 24 (1): 2327.Google Scholar
Schmeidler, David. 1989. “Subjective Probability and Expected Utility without Additivity.” Econometrica 57 (3): 571587.CrossRefGoogle Scholar
Smith, Cedric A. B. 1961. “Consistency in Statistical Inference.” Journal of the Royal Statistical Society, Series B 23 (1): 125.Google Scholar
Smith, Cedric A. B. 1965. “Personal Probability and Statistical Analysis.” Journal of the Royal Statistical Society, Series A 128 (4): 469499.CrossRefGoogle Scholar
Smithson, Michael. 1999. “Conflict Aversion: Preference for Ambiguity vs Conflict in Sources and Evidence.” Organizational Behavior and Human Decision Processes 79 (2): 179198.CrossRefGoogle ScholarPubMed
von Neumann, John, and Morgenstern, Oskar. 1947. Theory of Games and Economic Behavior . Second edition. Princeton: Princeton University Press.Google Scholar
Wald, Abraham. 1945. “Statistical Decision Functions which Minimize the Maximum Risk.” Annals of Mathematics 46 (2): 265280.CrossRefGoogle Scholar
Walley, Peter. 1991. Statistical Reasoning with Imprecise Probabilities . London: Chapman and Hall.CrossRefGoogle Scholar
Wallis, Allen W. 1981. “Memorial Service Tribute.” In Leonard, J. Savage, The Writings of Leonard Jimmie Savage: A Memorial Selection . Washington, DC: American Statistical Association and Institute of Mathematical Statistics, pp. 1124.Google Scholar
Zappia, Carlo. 2016. “Daniel Ellsberg and the Validation of Normative Propositions.” Œconomia 6 (1): 5779.Google Scholar
Zappia, Carlo. 2018. “Rationality under Uncertainty: Classic and Current Criticisms of the Bayesian Viewpoint.” European Journal of the History of Economic Thought 25 (6): 13871419.CrossRefGoogle Scholar