Skip to main content Accessibility help
×
Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-11-05T06:11:18.070Z Has data issue: false hasContentIssue false

8 - Learning judgment and decision making from feedback

Published online by Cambridge University Press:  05 December 2011

Mandeep K. Dhami
Affiliation:
University of Cambridge
Anne Schlottmann
Affiliation:
University College London
Michael R. Waldmann
Affiliation:
Georg-August-Universität, Göttingen, Germany
Get access

Summary

Introduction

In this chapter, I first discuss mechanisms of skill learning. Then I focus on the role of feedback. I discuss this in the context of various types of judgment and decision-making tasks. Provision of outcome feedback facilitates learning in relatively simple tasks, but it appears to have no effect or to impair performance in more complex tasks. However, in these latter cases, it is important to distinguish its detrimental effects on performance during learning and possible beneficial effects it has on learning itself (as measured by later performance after feedback has been removed). Processing feedback from previous judgments and decisions may compete with the processing needed to make current judgments and decisions for available cognitive resources. Thus, people may have to decide how to share these resources between using feedback to develop new knowledge (exploration) and using their extant knowledge to formulate the judgments and decisions currently required of them (exploitation).

Mechanisms of skill learning

This book is about instances of judgment and decision making that can be regarded as skills. In the past, the domain over which the term ‘‘skill’’ can be applied was a matter of some dispute. Eventually, Bartlett’s (1948) view that it should be used to cover both mental and motor activities came to be accepted over Pear’s (1948) argument that it should be reserved for “muscular performances.” Nowadays, a physician making a clinical decision is regarded as exercising a skill just as much as a cricket player. This approach implies that skills have common properties that are shared across the different domains in which they are studied. We should expect that what we have learnt from studying motor skills generally holds true for cognitive skills. Thus, in what follows, I will not limit my discussion to research into the cognitive skills underlying judgment and decision making but, where appropriate, I shall also draw on research into motor skills.

Type
Chapter
Information
Judgment and Decision Making as a Skill
Learning, Development and Evolution
, pp. 199 - 226
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Adams, J. A. 1987 Historical review and appraisal of research on the learning, retention, and transfer of human motor skillsPsychological Bulletin 101 41CrossRefGoogle Scholar
Annett, J. A. 1969 Feedback and human behaviourHarmondsworth, UKPenguin BooksGoogle Scholar
Atkins, P. W. B.Wood, R. E.Rutgers, P. J. 2002 The effects of feedback format on dynamic decision makingOrganizational Behavior and Human Decision Processes 88 587CrossRefGoogle Scholar
Azuma, H.Cronbach, L. J. 1966 Cue-response correlations in the attainment of a scalar conceptAmerican Journal of Psychology 79 38CrossRefGoogle Scholar
Baddeley, A. D.Longman, D. J. A. 1978 The influence of length and frequency of training session on the rate of learning to typeErgonomics 21 627CrossRefGoogle Scholar
Balzer, W. K.Doherty, M. E.O’Connor, R. 1989 Effects of cognitive feedback on performancePsychological Bulletin 106 410CrossRefGoogle Scholar
Balzer, W. K.Hammer, L. B.Sumner, K. E.Birchenough, T. R.Parham Martens, S.Raymark, P. H. 1994 Effects of cognitive feedback components, display format, and elaboration on performanceOrganizational Behavior and Human Decision Processes 58 369CrossRefGoogle Scholar
Balzer, W. K.Sulsky, L. M.Hammer, L. B.Sumner, K. E. 1992 Task information, cognitive information, or functional validity information: Which components of cognitive feedback affect performanceOrganizational Behavior and Human Decision Processes 53 35CrossRefGoogle Scholar
Barron, G.Erev, I. 2003 Small feedback-based decisions and their limited correspondence to description-based decisionsJournal of Behavioral Decision Making 16 215CrossRefGoogle Scholar
Bartlett, F. C. 1948 The measurement of human skillOccupational Psychology 22 31Google ScholarPubMed
Bjork, R. A. 1994 Institutional impediments to effective trainingDruckman, D.Bjork, R. A.Learning, remembering, believing: Enhancing individual and team performance295Washington, DCNational Academy PressGoogle Scholar
Björkman, M. 1965 Studies in predictive behavior: Explorations into predictive judgments based on functional learning and defined by estimation, categorization, and choiceScandinavian Journal of Psychology 6 129CrossRefGoogle Scholar
Björkman, M. 1972 Feedforward and feedback as determinants of knowledge and policy: Notes on a neglected issueScandinavian Journal of Psychology 13 152CrossRefGoogle Scholar
Bourne, L. E.Bunderson, C. U. 1963 Effects of delay of informative feedback and length of post-feedback interval on concept identificationJournal of Experimental Psychology 65 1CrossRefGoogle Scholar
Bourne, L. E.Guy, D. E.Dodd, D. H.Justesen, D. R. 1965 Concept identification: The effects of varying length and informational components of the intertrial intervalJournal of Experimental Psychology 69 624CrossRefGoogle ScholarPubMed
Brehmer, B. 1980 In one word: Not from experienceActa Psychologica 45 223CrossRefGoogle Scholar
Brehmer, B.Lindberg, L. 1970 Retention of probabilistic cue-criterion relations as a function of cue validity and retention intervalJournal of Experimental Psychology 86 331CrossRefGoogle Scholar
Broadbent, D. E.Fitzgerald, P.Broadbent, M. H. P. 1986 Implicit and explicit knowledge in the control of complex systemsBritish Journal of Psychology 77 33CrossRefGoogle Scholar
Catalano, J. F.Kleiner, B. M. 1984 Distant transfer in coincident timing as function of variability of practicePerceptual and Motor Skills 58 851CrossRefGoogle Scholar
Cohen, J. D.McClure, S. M.Yu, A. J. 2007 Should I stay or should I go? How the human brain manages the trade-off between exploitation and explorationPhilosophical Transactions of the Royal Society 362 933CrossRefGoogle ScholarPubMed
Cooksey, R. W. 1996 Judgment analysis: Theory, methods, and applicationsSan Diego, CAAcademic PressGoogle Scholar
Cowan, N. 1993 Activation, attention, and short-term memoryMemory and Cognition 21 162CrossRefGoogle ScholarPubMed
Craik, F. I. M.Lockhart, R. S. 1972 Levels of processing: A framework for memory researchJournal of Verbal Learning and Verbal Behavior 11 671CrossRefGoogle Scholar
Croll, W. L. 1970 Children’s discrimination learning as a function of intertrial interval durationPsychonomic Science 18 321CrossRefGoogle Scholar
Dam, G.Körding, K. 2009 Exploration and exploitation during sequential searchCognitive Science 33 530CrossRefGoogle ScholarPubMed
Deane, D. H.Hammond, K. R.Summers, D. A. 1972 Acquisition and application of knowledge in complex inference tasksJournal of Experimental Psychology 92 20CrossRefGoogle Scholar
Diehl, E.Sterman, J. D. 1995 Effects of feedback complexity on dynamic decision makingOrganizational Behavior and Human Decision Processes 62 198CrossRefGoogle Scholar
Dienes, Z.Fahey, R. 1995 Role of specific instances in controlling a dynamic systemJournal of Experimental Psychology: Learning, Memory, and Cognition 21 848Google Scholar
Engle, R. W.Conway, A. R. A.Tuholski, S. W.Shisler, R. J. 1995 A resource account of inhibitionPsychological Science 6 122CrossRefGoogle Scholar
Fischer, I.Harvey, N. 1999 Combining forecasts: What information do judges need to outperform the simple averageInternational Journal of Forecasting 15 227CrossRefGoogle Scholar
Fox, C. R.Hadar, L. 2006 Decisions from experience = sampling error + prospect theory: Reconsidering Hertwig, Barron, Weber & Erev (2004)Judgment and Decision Making 1 159Google Scholar
Frensch, P. S.Funke, J. 1995 Complex problem solving: The European perspectiveHillsdale, NJErlbaum
Gallagher, J. D.Thomas, J. R. 1980 Effects of varying post-KR intervals upon children’s motor performanceJournal of Motor Behavior 12 41CrossRefGoogle Scholar
Ghodsian, D.Bjork, R. A.Benjamin, A. S. 1997 Evaluating training training: Obstacles and opportunitiesQuiñones, M. A.Ehrenstein, A.Training for 21st century technology: Applications of psychological research63Washington, DCAmerican Psychological AssociationGoogle Scholar
Gibson, E. J.Walk, R. W. 1956 The effect of prolonged exposure to visually presented patterns on learning to discriminate themJournal of Comparative and Physiological Psychology 49 239CrossRefGoogle Scholar
Gibson, F. P. 2000 Feedback delays: How can decision makers learn not to buy a new car every time the garage is emptyOrganizational Behavior and Human Decision Processes 83 141CrossRefGoogle Scholar
Gigerenzer, G.Todd, P. M. 1999 Fast and frugal heuristics: The adaptive toolboxGigerenzer, G.Todd, P. M.the ABC Research GroupSimple heuristics that make us smart3Oxford University PressGoogle Scholar
Goldberg, L. R. 1968 Simple models or simple processes: Some research on clinical judgmentsAmerican Psychologist 23 483CrossRefGoogle ScholarPubMed
Hammond, K. R. 1971 Computer graphics as an aid to learningScience 172 903CrossRefGoogle ScholarPubMed
Hammond, K. R.Boyle, P. J. R. 1971 Quasi-rationality, quarrels and new conceptions of feedbackBulletin of the British Psychological Society 24 103Google Scholar
Hammond, K. R.Summers, D. A. 1972 Cognitive controlPsychological Review 79 58CrossRefGoogle Scholar
Hammond, K. R.Summers, D. A.Deane, D. H. 1973 Negative effects of outcome feedback in multiple-cue probability learningOrganizational Behavior and Human Performance 9 30CrossRefGoogle Scholar
Harries, C.Harvey, N. 2000 Taking advice, using information, and knowing what you are doingActa Psychologica 104 399CrossRefGoogle ScholarPubMed
Harvey, N.Fischer, I. 1997 Taking advice: Accepting help, improving judgment and sharing responsibilityOrganizational Behavior and Human Decision Processes 70 117CrossRefGoogle Scholar
Harvey, N.Fischer, I. 2005 Development of experience-based judgment and decision making: The role of outcome feedbackBetsch, T.Habberstroh, S.The routines of decision making119Mahwah, NJErlbaumGoogle Scholar
Hertwig, R.Barron, G.Weber, E. U.Erev, I. 2004 Decisions from experience and the effect of rare events in risky choicePsychological Science 15 534CrossRefGoogle ScholarPubMed
Holding, D. H.Macrae, A. W. 1964 Guidance, restriction, and knowledge of resultsErgonomics 7 289CrossRefGoogle Scholar
Holzworth, R. J.Doherty, M. E. 1976 Feedback effects in a metric multiple-cue probability learning taskBulletin of the Psychonomic Society 8 1CrossRefGoogle Scholar
Jessup, R. K.Bishara, A. J.Busemeyer, J. R. 2008 Feedback produces divergence from Prospect Theory in descriptive choicePsychological Science 19 1015CrossRefGoogle ScholarPubMed
Juslin, P.Olsson, H.Olsson, A-C. 2003 Exemplar effects in categorization and multiple-cue judgmentJournal of Experimental Psychology: General 132 133CrossRefGoogle ScholarPubMed
Kahneman, D. 1973 Attention and effortEnglewood Cliffs, NJPrentice-HallGoogle Scholar
Karelaia, N.Hogarth, R. M. 2008 Determinants of linear judgment: A meta-analysis of lens model studiesPsychological Bulletin 134 404CrossRefGoogle ScholarPubMed
Kelley, H.Friedman, D. 2002 Learning to forecast priceEconomic Inquiry 40 556CrossRefGoogle Scholar
Kerr, R.Booth, B. 1978 Specific and varied practice of a motor skillPerceptual and Motor Skills 46 395CrossRefGoogle ScholarPubMed
Kerstholt, J. H. 1996 Dynamic decision makingWageningenPonsen & Looijen B.VGoogle Scholar
Klayman, J. 1988 On the how and why (not) of learning from outcomesBrehmer, BJoyce, C. R. B.Human Judgment: The SJT viewAmsterdamElsevier Publishers B.V. (North-Holland)Google Scholar
Kleinmuntz, D. N. 1985 Cognitive heuristics and feedback in a dynamic decision environmentManagement Science 31 680CrossRefGoogle Scholar
Kluger, A. N.DeNisi, A. 1996 The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theoryPsychological Bulletin 119 254CrossRefGoogle Scholar
Knowlton, B. J.Squire, L. R.Gluck, M. A. 1994 Probabilistic classification learning in amnesiaLearning & Memory 1 106Google ScholarPubMed
Lagnado, D. A.Newell, B. R.Kahan, S.Shanks, D. R. 2006 Insight and strategy in multiple-cue learningJournal of Experimental Psychology: General 135 162CrossRefGoogle ScholarPubMed
Lee, T. D.Magill, R. A. 1983 The locus of contextual interference in skill acquisitionJournal of Experimental Psychology: Learning, Memory, and Cognition 9 730Google Scholar
Lurie, N. H.Swaminathan, J. M. 2009 Is timely information always better? The effect of feedback frequency on decision makingOrganizational Behavior and Human Decision Processes 108 315CrossRefGoogle Scholar
Macrae, A. W.Holding, D. H. 1965 Guided practice in direct and reversed serial trackingErgonomics 8 487CrossRefGoogle ScholarPubMed
Magill, R. A.Hall, K. G. 1990 A review of the contextual interference effect in motor skill acquisitionHuman Movement Science 9 241CrossRefGoogle Scholar
Newell, B. R.Lagnado, D. A.Shanks, D. R. 2007 Challenging the role of implicit processes in probabilistic category learningPsychonomic Bulletin and Review 14 505CrossRefGoogle ScholarPubMed
Newell, B. R.Rakow, T. 2007 The role of experience in decisions from descriptionPsychonomic Bulletin and Review 14 1133CrossRefGoogle ScholarPubMed
Newell, B. R.Weston, N. J.Tunney, R. J.Shanks, D. R. 2009 The effectiveness of feedback in multiple-cue probability learningQuarterly Journal of Experimental Psychology 62 890CrossRefGoogle ScholarPubMed
Osman, M. 2010 Controlling uncertainty: A review of human behaviour in complex dynamic environmentsPsychological Bulletin 136 65CrossRefGoogle ScholarPubMed
Osman, M. 2010 Controlling uncertainty: Decision making and learning in complex worldsOxfordWiley, BlackwellCrossRefGoogle Scholar
Paich, M.Sterman, J. D. 1993 Boom, bust, and failures to learn in experimental marketsManagement Science 39 1439CrossRefGoogle Scholar
Pear, T. H. 1948 Professor Bartlett on skillOccupational Psychology 22 92Google ScholarPubMed
Proctor, R. W.Dutta, A. 1995 Skill acquisition and human performanceLondonSageGoogle Scholar
Rakow, T.Demes, K. A.Newell, B. R. 2008 Biased samples not mode of presentation: Re-examining the apparent underweighting of rare events in experience-based choiceOrganizational Behavior and Human Decision Processes 106 168CrossRefGoogle Scholar
Sage, J. R.Anagnostaras, S. G.Mitchell, S.Bronstein, J. M.De, S. A.Masterman, D.Knowlton, B. J. 2003 Analysis of probabilistic classification learning in patients with Parkinson’s disease before and after pallidotomy surgeryLearning & Memory 10 226CrossRefGoogle ScholarPubMed
Salmoni, A. W.Schmidt, R. A.Walter, C. B. 1984 Knowledge of results and motor learning: A review and critical reappraisalPsychological Bulletin 95 355CrossRefGoogle ScholarPubMed
Schmidt, R. A.Bjork, R. A. 1992 New conceptualizations of practice: Common principles in three paradigms suggest new concepts for trainingPsychological Science 3 207CrossRefGoogle Scholar
Schmidt, R. A.Young, D. E.Swinnen, S.Shapiro, D. C. 1989 Summary knowledge of results for skill acquisition: Support for the guidance hypothesisJournal of Experimental Psychology: Learning, Memory, and Cognition 15 352Google ScholarPubMed
Schmitt, N.Coyle, B. W.King, L. 1976 Feedback and task predictability as determinants of performance in multiple cue probability learning tasksOrganizational Behavior and Human Performance 16 388CrossRefGoogle Scholar
Schmitt, N.Coyle, B. W.Saari, B. B. 1977 Types of task information feedback in multiple-cue probability learningOrganizational Behavior and Human Performance 18 316CrossRefGoogle Scholar
Shea, J. B.Morgan, R. L. 1979 Contextual interference effects on the acquisition, retention, and transfer of a motor skillJournal of Experimental Psychology: Human Learning and Memory 5 179Google Scholar
Shohamy, D.Myers, C. E.Grossman, S.Sage, J.Gluck, M. A.Poldrack, R. A. 2004 Cortico-striatal contributions to feedback-based learning: Converging data from neuroimaging and neuropsychologyBrain 127 851CrossRefGoogle ScholarPubMed
Simon, H. A. 1957 Models of man: Social and rationalNew YorkWileyGoogle Scholar
Slovic, P.Lichtenstein, S. 1971 Comparison of Bayesian and regression approaches to the study of information processing in judgmentOrganizational Behavior and Human Performance 6 649CrossRefGoogle Scholar
Stanovich, K. E.West, R. F. 1998 Individual differences in rational thoughtJournal of Experimental Psychology: General 127 161CrossRefGoogle Scholar
Sterman, J. D. 1989 Modeling managerial behavior: Misperceptions of feedback in a dynamic decision making experimentManagement Science 35 321CrossRefGoogle Scholar
Sterman, J. D. 1989 Misperceptions of feedback in dynamic decision makingOrganizational Behavior and Human Decision Processes 43 301CrossRefGoogle Scholar
Todd, F. J.Hammond, K. R. 1965 Differential feedback in two multiple-cue probability learning tasksBehavioral Science 10 429CrossRefGoogle ScholarPubMed
Trowbridge, M. H.Cason, H. 1932 An experimental study of Thorndike’s theory of learningJournal of General Psychology 7 245CrossRefGoogle Scholar
Ungemach, C.Chater, N.Stewart, N. 2009 Are probabilities overweighted or underweighted when rare outcomes are experienced (rarely)Psychological Science 20 473CrossRefGoogle Scholar
Weinberg, D. R.Guy, D. E.Tupper, R. W. 1964 Variations of postfeedback interval in simple motor learningJournal of Experimental Psychology 67 98CrossRefGoogle Scholar
Wickens, C. D. 1980 The structure of processing resourcesNickerson, R.Attention and Performance VII239Hillsdale, NJErlbaumGoogle Scholar
Wilkinson, L.Lagnado, D. A.Quallo, M.Jahanshahi, M. 2008 The effects of feedback on non-motor probabilistic classification learning in Parkinson’s diseaseNeuropsychologia 46 2683CrossRefGoogle Scholar
Wills, A. J.Suret, M. B.McClaren, I. P. L. 2004 The role of category structure in determining the effects of stimulus preexposure on categorization accuracyQuarterly Journal of Experimental Psychology 57B 79CrossRefGoogle Scholar
Winstein, C. J.Schmidt, R. A. 1990 Reduced frequency of knowledge of results enhances motor skill learningJournal of Experimental Psychology: Learning, Memory, and Cognition 16 677Google Scholar
Wulf, G.Schmidt, R. A. 1989 The learning of generalized motor programs: Reducing the relative frequency of knowledge of results enhances memoryJournal of Experimental Psychology: Learning, Memory, and Cognition 15 748Google Scholar

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×