Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-11-17T19:53:46.419Z Has data issue: false hasContentIssue false
  • English
  • Français

A review of human linguistic probability processing: General principles and empirical evidence

Published online by Cambridge University Press:  07 July 2009

Thomas S. Wallsten  and
David V. Budescu
Thomas S. Wallsten
Affiliation:
Department of Psychology, University of North Carolina, Chapel Hill, NC 27599-3270, USA
David V. Budescu
Affiliation:
University of Illinois at Urbana-Champaign, USA
Get access Rights & Permissions [Opens in a new window]

Abstract

This article reviews research on how people use and understand linguistic expressions of uncertainty, with a view toward the needs of researchers and others interested in artificial intelligence systems. We discuss and present empirical results within an inductively developed theoretical framework consisting of two background assumptions and six principles describing the underlying cognitive processes.

Type
Research Article
Information
The Knowledge Engineering Review , Volume 10 , Issue 1 , March 1995 , pp. 43 - 62
Copyright
Copyright © Cambridge University Press 1995

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anderson, NH, 1991. Information Integration Theory, Erlbaum.Google Scholar
Bass, BM, Cascio, WF and O'Connor, EJ. 1974. “Magnitude estimation of expressions of frequency and amount” Journal of Applied Psychology 59 313–320.CrossRefGoogle Scholar
Behn, RD and Vaupel, JW, 1982. Quick Analysis for Busy Decision Makers, Basic.Google Scholar
Beyth-Marom, R, 1982. “How probable is probable? A numerical translation of verbal probability expressions” Journal of Forecasting 1 257–269.CrossRefGoogle Scholar
Bonissone, PP and Decker, KS, 1987. “Selecting uncertainty calculi and granularity: An experiment in trading off precision and complexity” In: Kanal, LN and Lemmer, JF (eds.), Uncertainty and Artificial Intelligence, Elsevier.Google Scholar
Bortolan, G and Degani, R, 1985. “A review of some methods for ranking fuzzy subsets” Fuzzy Sets and Systems 15 1–19.Google Scholar
Brackner, JW, 1985. “How to report contingent losses in financial statements?” Journal of Business Forecasting 4 13–18.Google Scholar
Bradburn, NM and Miles, C, 1979. “Vague quantifiers” Public Opinion Quarterly 43 92–101.Google Scholar
Brun, W and Teigen, KH, 1988. “Verbal probabilities: Ambiguous, context-dependent, or both?” Organizational Behavior and Human Decision Processes 41 390–404.Google Scholar
Bryant, and Norman, , 1980. “Expressions of probability: Words and Numbers” New England Journal of Medicine 302 411.Google ScholarPubMed
Budescu, DV and Wallsten, TS, 1985. “Consistency in interpretation of probabilistic phrases” Organizational Behavior and Human Decision Processes 36 391–405.CrossRefGoogle Scholar
Budescu, DV and Wallsten, TS 1987. “Subjective estimation of precise and vague uncertainties In: Wright, G and Ayton, P. (eds.), Judgmental Forecasting, pp 63–81, Wiley.Google Scholar
Budescu, DV and Wallsten, TS, 1990. “Dyadic decisions with verbal and numerical probabilities” Organizational Behavior and Human Decision Processes 46 240–263.Google Scholar
Budescu, DV and Wallsten, TS (in press). “Processing linguistic probabilities: general principles and empirical evidence” In: Busemeyer, JR, Hastie, R and Medin, DL (eds.), Decision Making from the Perspective of Cognitive Psychology, Academic Press.Google Scholar
Budescu, DV, Weinberg, S and Wallsten, TS, 1988. “Decisions based on numerically and verbally expressed uncertainties” Journal of Experimental Psychology: Human Perception and Performance 14 281–294.Google Scholar
Budescu, DV, Zwick, R, Wallsten, TS and Erev, I, 1990. “Integration of linguistic probabilities” International Journal of Man–Machine Studies 33 657–676.Google Scholar
Camerer, C and Weber, M, 1992. “Recent developments in modeling preferences: Uncertainty and ambiguity” Journal of Risk and Uncertainty 5 325–370.Google Scholar
Chesley, GR, 1985. “Interpretation of uncertainty expressions” Contemporary Accounting Research 2 179–199.CrossRefGoogle Scholar
Clark, DA, 1990. “Verbal uncertainty expressions: A review of two decades of research” Current Psychology: Research and Reviews 9 203–235.Google Scholar
Clarke, VA, Ruffin, CL, Hill, DJ and Beamen, AL, 1992. “Ratings of orally presented verbal expressions of probability by a heterogeneous sample” Journal of Applied Social Psychology 22 638–656.Google Scholar
Cliff, N, 1959. “Adverbs as multipliers” Psychological Review 66 27–44.CrossRefGoogle ScholarPubMed
Cohen, BL and Wallsten, TS, 1992. “The effect of constant outcome value on judgments and decision making given linguistic probabilities” Journal of Behavioral Decision Making 5 53–72.CrossRefGoogle Scholar
Curley, SP and Yates, JF, 1985. “The center and range of the probability interval as factors affecting ambiguity preferences” Organizational Behavior and Human Decision Processes 36 273–287.CrossRefGoogle Scholar
Degani, R and Bortolan, G, 1988. “The problem of linguistic approximation in clinical decision making” International Journal of Approximate Reasoning 2 143–162.CrossRefGoogle Scholar
DeGroot, MH, 1970. Optimal Statistical Decisions, McGraw-Hill.Google Scholar
Einhorn, HJ and Hogarth, RM, 1985. “Ambiguity and uncertainty in probabilistic inference” Psychological Review 92 433–461.Google Scholar
Ellsberg, D, 1961. “Risk, ambiguity, and the Savage axioms” Quarterly Journal of Economics 75 643–669.CrossRefGoogle Scholar
Erev, I and Cohen, BL, 1990. “Verbal versus numerical probabilities: Efficiency, biases, and the preference paradox” Organizational Behavior and Human Decision Processes 45 1–18.CrossRefGoogle Scholar
Erev, I, Wallsten, TS and Budescu, DV, 1994. “Simultaneous over- and underconfidence: The role of error in judgment processes” Psychological Review 101 519–527.CrossRefGoogle Scholar
Erev, I, Wallsten, TS and Neal, M, 1991. “Vagueness, ambiguity, and the cost of mutual understanding” Psychological Science 2 321–324.CrossRefGoogle Scholar
Farkas, A and Makai-Csasar, M, 1988. “Communication or dialogue of deafs: Pitfalls of use of fuzzy quantifiers” In: Second Network Seminar of the International Union of Psychological Science, North- Holland.Google Scholar
Fillenbaum, S, Wallsten, TS, Cohen, B and Cox, JA, 1991. “Some effects of vocabulary and communication task on the understanding and use of vague probability expressions” American Journal of Psychology 104 35–60.CrossRefGoogle Scholar
Gärdenfors, P and Sahlin, NE, 1982. “Unreliable probabilities, risk taking, and decision making” Synthese 53 361–386.Google Scholar
González-Vallejo, CC, Erev, I and Wallsten, TS, 1994. “Do decision quality and preference order depend on whether probabilities are verbal or numerical?” American Journal of Psychology 107 157–172.CrossRefGoogle Scholar
González-Vallejo, CC and Wallsten, TS, 1992. “Effects of probability mode on preference reversal” Journal of Experimental Psychology: Learning, Memory, ' Cognition 18 855–864.Google ScholarPubMed
Grether, DM and Plott, CR, 1979. “Economic theory of choice and the preference reversal phenomenon” American Economic Review 69 623–638.Google Scholar
Hamm, RM, 1991. “Selection of verbal probabilities: A solution for some problems of verbal probability expression” Organizational Behavior and Human Decision Processes 48 193–223.CrossRefGoogle Scholar
Hammerton, M, 1976. “How much is a large part?” Applied Ergonomics 7 10–12.CrossRefGoogle ScholarPubMed
Holyoak, KJ, 1978. “Comparative judgments with numerical reference points” Cognitive Psychology 10 203–243.CrossRefGoogle Scholar
Holyoak, KJ and Glass, AL, 1978. “Recognition confusions among quantifiers” Journal of Verbal Learning and Verbal Behavior 17 249–264.CrossRefGoogle Scholar
Jaffe-Katz, A, Budescu, DV and Wallsten, TS, 1989. “Timed magnitude comparisons of numerical and nonnumerical expressions of uncertainty” Memory and Cognition 17 249–264.Google Scholar
Johnson, EM, 1973. “Numerical encoding of qualitative expressions of uncertainty” (Tech. paper No. 250), U.S. Army Research Institute for the Behavioral and Social Sciences.CrossRefGoogle Scholar
Johnson, EM and Huber, GP, 1977. “The technology of utility assessment IEEE Translations oil Systems, Man and Cybernetics 7 311–325.CrossRefGoogle Scholar
Kadane, JB, 1990. “Comment: Codifying chance” Statistical Science 5 18–20.CrossRefGoogle Scholar
Keynes, JM, 1921. A Treatise on Probability, Macmillan.Google Scholar
Knight, FH, 1921. Risk, Uncertainty, and Profit, University of Chicago Press.Google Scholar
Kong, A, Barnett, GO, Mosteller, F and Youtz, C, 1986. “How medical professionals evaluate expressions of probability” The New England Journal of Medicine 315 740–744.CrossRefGoogle ScholarPubMed
Lichtenstein, S, Fischhoff, B and Phillips, LD, 1982. “Calibration of probabilities: The state of the art to 1980” In: Kahneman, D, Slovic, P and Tversky, A (eds.), Judgment under Uncertainty: Heuristics and Biases, pp 306–334, Cambridge University Press.Google Scholar
Lichtenstein, S and Newman, JR, 1967. “Empirical scaling of common verbal phrases associated with numerical probabilities” Psychonomic Science 9 563–564.CrossRefGoogle Scholar
López de Mántaras, R, Meseguer, P, Sanz, F, Sierra, C and Verdaguer, A, 1988. “A fuzzy logic approach to the management of linguistically expressed uncertainty” IEEE Transactions on Systems, Man and cybernetics 144–151.Google Scholar
Krause, P and Clark, D, 1993. Representing Uncertain Knowledge: An artificial intelligence approach, Intellect.CrossRefGoogle Scholar
Mapes, , 1979. “Verbal and numerical estimates of probability terms” Journal of General Internal Medicine 6 237.Google Scholar
Marshall, E, 1986. “Feynman issues his own shuttle report, attacking NASA's risk estimates” Science 232 1596.Google Scholar
Marshall, E, 1988. “Academy panel faults NASA's safety analysis” Science 239 1233.Google Scholar
Merz, JF, Druzdzel, MJ and Mazur, DJ, 1991. “Verbal expressions of probability in informed consent litigation” Journal of Medical Decision Making 11 273–281.Google Scholar
Moore, PG, 1977. “The manager's struggle with uncertainty” Journal of the Royal Statistical Society 140 129–165.CrossRefGoogle Scholar
Moore, PG and Thomas, H, 1975. “Measuring uncertainty” The International Journal of Managememu Science 3 657.Google Scholar
Mosier, CI, 1941. “A psychometric study of meaning” Journal of Social Psychology 39 31–36.Google Scholar
Mosteller, F and Youtz, C, 1990. “Quantifying probabilistic expressions” Statistical Science 5 2–16.Google Scholar
Moxey, LM and Sanford, AJ, 1993. Communicating Quantities: A Psychological Perspective, Lawrence Erlbaum.Google Scholar
Mullet, E, and Rivet, I, 1991. “Comprehension of verbal probability expressions in children and adolescents” Language and Communication 11 217–225.CrossRefGoogle Scholar
Murphy, AH and Brown, BG, 1983. “Forecast terminology: Composition and interpretation of public weather forecasts” Bulletin of tile American Meteorological Society 64 13–22.Google Scholar
Murphy, AH, Lichtenstein, S, Fischhoff, B and Winkler, RL, 1980. “Misinterpretations of precipitation probability forecasts” Bulletin of the American Meteorological Society 61 695–701.Google Scholar
Nakao, and Axelrod, , 1983. “Numbers are better than words: Verbal specifications of frequency have no place in medicine” American Journal of Medicine 74 1061.CrossRefGoogle ScholarPubMed
National Weather Service, 1984. Weather Service Operations Manual. National Oceanic and Atmospheric Administration.Google Scholar
Newstead, SE, 1988. “Quantifiers as fuzzy concepts” In: Zetenyl, T (eds.), Fuzzy Sets in Psychology, pp 51–72, Elsevier Science.Google Scholar
Norwich, AM and Turksen, IB, 1984. “A model for the measurement of membership and the consequences of its empirical implementation” Fuzzy Sets and Systems 12 1–25.CrossRefGoogle Scholar
Parciucci, A, 1968. “How often is often” American Psychologist 23 828.Google Scholar
Pepper, S, 1981. “Problems in the quantification of frequency expression” In: Fiske, DW (ed.), New Directions for Methodology of Social and Behavioral Science Jossey- Bass.Google Scholar
Pepper, S and Prytulak, LS, 1974. “Sometimes frequently means seldom: Context effects in the interpretation of quantitative expressions Journal of Research in Personality 8 95–101.CrossRefGoogle Scholar
Rapoport, A, Wallsten, TS and Cox, JA, 1987. “Direct and indirect scaling of membership functions of probability phrases” Mathematical Modelling 9 397–417.Google Scholar
Rapoport, A, Wallsten, TS, Erev, I and Cohen, BL, 1990. “Revision of opinion with verbally and numerically expressed uncertainties” Acta Psychologica 74 61–79.CrossRefGoogle Scholar
Reagan, RT, Mosteller, F and Youtz, C, 1989. “Quantitative meanings of verbal probability expressions” Journal of Applied Psychology 74 433–442.Google Scholar
Reyna, VF, 1981. “The language of possibility and probability: Effects of negation on meaning” Memory ' Cognition 9 642–650.CrossRefGoogle ScholarPubMed
Rubin, DC, 1979. “On measuring fuzziness: A comment on 'a fuzzy set approach to modifiers and vagueness in natural language” Journal of Experimeiital Psychology: General 108 486–489.Google Scholar
Schkade, DA and Kleinmuntz, DN, 1994. “Information displays and choice processes: Differential effects of organization, form, and sequence” Organizational Behavior and Human Decision Processes 57 319–337.CrossRefGoogle Scholar
Shapiro, AJ and Wallsten, TS, 1994. “Base rate effects on interpreting verbally and numerically communicated probabilities” Working paper.Google Scholar
Simpson, RH, 1944. “The specific meanings of certain terms indicating differing degrees of frequency Quarterly Journal of Speech 30 328–330.Google Scholar
Stone, DN and Schkade, DA, 1991. “Numeric and linguistic information representation in multiattribute choice” Organizational Behavior and Human Decision Processes 49 42–59.CrossRefGoogle Scholar
Sutherland, HJ, Lockwood, GA, Tritchler, DL and Scm, F, 1991. “Communicating probabilistic information to cancer patients: Is there ‘noise’ on the line?” Social Science and Medicine 32 725–731.CrossRefGoogle ScholarPubMed
Svenson, O and Karlson, G, 1986. “Attractiveness of decision alternatives characterized by numerical and non-numerical information Scandinavian Journal of Psychology 27 74–84.Google Scholar
Teigen, KH, 1988a. “When are low-probability events judged to be ‘probable’? Effects of outcome-set characteristics on verbal probability estimates” A cta Psychologica 67 157–174.Google Scholar
Teigen, KH, 1988b. “The language of uncertainty” Ada Psychologica 68 27–38.CrossRefGoogle Scholar
Teigen, KH and Brun, W, 1993. “Yes, but it is uncertain: Direction and communicative intention of verbal probabilistic terms” SPUDM-14, Aix-en Provence, France.Google Scholar
Tsao, CJ and Wallsten, TS, 1994. “Effects of the number of outcomes on the interpretation and selection of verbal and numerical probabilities in dyadic decisions”. Working paper.Google Scholar
Tversky, A, Sattath, S and Slovic, P, 1988. “Contingent weighting in judgment and choice” Psychological Review 95 371–384.Google Scholar
Vesely, WE and Rasmuson, DM, 1984. “Uncertainties in nuclear probabilistic risk analysis” Risk Analysis 4 313–322.Google Scholar
von, Winterfeldt D and Edwards, W, 1986. Decision Analysis and Behavioral Research, Cambridge University Press.Google Scholar
Wallsten, TS, 1971. “Subjectively expected utility theory and subjects' probability estimates: Use of measurement-free techniques” Journal of Experimental Psychology 88 31–40.CrossRefGoogle Scholar
Wallsten, TS, 1990. “Measuring vague uncertainties and understanding their use in decision making” In: Furstenberg, GM von (ed.), Acting under Uncertainty pp 377–398, Kluwer.Google Scholar
Wallsten, TS, Budescu, DV and Erev, I, 1988. “Understanding and using linguistic uncertainties” Acta Psychologica 68 39–52.CrossRefGoogle Scholar
Wallsten, TS, Budescu, DV, Rapoport, A, Zwick, R and Forsyth, BH, 1986. “Measuring the vague meanings of probability terms” Journal of Experimental Psychology: General 115 348–365.Google Scholar
Wallsten, TS, Budescu, DV and Tsao, CJ, 1994. “Combining linguistic probabilities” Symposiumn on Qualitative Aspects of Decision Making, Regensburg, Germany, 07 20 1994.Google Scholar
Wallsten, TS, Budescu, DV and Zwick, R, 1993. “Comparing the calibration and coherence numerical and verbal probability judgments” Management Science 39 176–190.Google Scholar
Wallsten, TS, Budescu, DV, Zwick, R and Kemp, SM, 1993. “Preference and reasons for communicating probabilistic information in numerical or verbal terms” Bulletin of the Psychonomnic Society 31 135–138.CrossRefGoogle Scholar
Wallsten, TS, Filenbaum, S and Cox, JA, 1986. “Base rate effects on the interpretations of probability and frequency expressions” Journal of Memory and Language 25 571–587.CrossRefGoogle Scholar
Weber, EU, 1988. “A descriptive measure of risk” Acta Psychologica 69 185–203.Google Scholar
Weber, EU and Bottom, WP, 1989. “Axiomatic measures of perceived risk: Some tests and extensions” Journal of Behavioral Decision Making 2 113–131.Google Scholar
Webber, EU and Hilton, DJ, 1990 “Contextual effects in the interpretations of probability words: Perceived base rate and severity of events” Journal of Experimental Psychology: Human Perception and Performance 16 781–789.Google Scholar
Wright, GN, Phillips, LD, Whalley, PC, Choo, GT, Ng, KO, Tan, I and Wisudha, A, 1978. “Cultural differences in probabilistic thinking” Journal of Cross-Cultural Psychology 9 285–299.Google Scholar
Wyden, P, 1979. Bay of Pigs, Simon & Schuster.Google Scholar
Yager, RR, 1981. “A procedure for ordering fuzzy sets on the unit interval” Information Sciences 24 143–161.Google Scholar
Yates, JF, Zhu, Y, Ronis, DL, Wang, DF, Shinotsuka, H and Toda, M, 1989. “Probability judgment accuracy: China, Japan, and the United States” Organizational Behavior and Human Decision Processes 43 145–171.CrossRefGoogle Scholar
Zimmer, AC, 1983. “Verbal vs. numerical processing of subjective probabilities” In: RW, Scholz (ed.), Decision Making Under Uncertainty, Elsevier.Google Scholar
Zwick, R, 1987. “Combining stochastic uncertainty and linguistic inexactness: Theory kind experimental evaluation”. Doctoral dissertation, University of North Carolina at Chapel Hill.Google Scholar
Zwick, R, Budescu, DV and Wallsten, TS, 1988. “An empirical study of the integration of linguistic probabilities” In: Zetenyi, T (ed.), Fuzzy Set Theory in Psychology, pp 91–125, North Holland.CrossRefGoogle Scholar
Zwick, R, Carlstein, E and Budescu, DV, 1987. “Measures of similarity among fuzzy concepts: A comparative analysis” International Journal of Approximate Reasoning 1 221–242.CrossRefGoogle Scholar
Zwick, R and Wallsten, TS, 1989. “Combining stochastic and linguistic inexactness: Theory and experimental evaluation of four fuzzy probability models” International Journal of Man–Machine Studies 30 69–111.CrossRefGoogle Scholar