Book contents
- Frontmatter
- Contents
- Figures
- Contributors
- Preface
- Acknowledgments
- Chapter cross-reference table
- Part I Evolutionary and neural bases of JDM
- Part II Developmental approaches to JDM
- Part III Learning JDM
- 6 Learning of judgment and decision-making strategies
- 7 Causal models in judgment and decision making
- 8 Learning judgment and decision making from feedback
- Part IV Improving and aiding JDM
- Conclusion
- Index
- References
6 - Learning of judgment and decision-making strategies
Published online by Cambridge University Press: 05 December 2011
Book contents
- Frontmatter
- Contents
- Figures
- Contributors
- Preface
- Acknowledgments
- Chapter cross-reference table
- Part I Evolutionary and neural bases of JDM
- Part II Developmental approaches to JDM
- Part III Learning JDM
- 6 Learning of judgment and decision-making strategies
- 7 Causal models in judgment and decision making
- 8 Learning judgment and decision making from feedback
- Part IV Improving and aiding JDM
- Conclusion
- Index
- References
Summary
Introduction
People learn many skills throughout their lives, such as how to drive a car, roast a turkey, or identify people whom they can trust. People not only learn through the help of parents, teachers, and books, but also often simply on the basis of personal experience. The goal of the present chapter is to show how models of bounded rationality benefit from considering individual learning processes to explain people’s decision skills. Learning is a “missing link” in decision-making research because it provides an explanation of how people are able to adapt their decision making to specific situations.
In this chapter we first present an overview of the bounded rationality approaches that have largely neglected learning when accounting for people’s decision-making processes. Second, we present models of learning that address how people can learn the values of options and decision strategies. Overall, we aim to show that learning can account for individuals adapting their choices to the statistical structure of environments. This adaptation takes place either directly, by changing people’s preferences for the available choice options, or indirectly, by changing people’s preferences for the decision strategies that determine the choice between options. At the end of the chapter, we discuss the connection of learning and decision making to extant neuroscience research and, more generally, the opportunities afforded by, and limitations of, the learning perspective on decision making.
- Type
- Chapter
- Information
- Judgment and Decision Making as a SkillLearning, Development and Evolution, pp. 143 - 168Publisher: Cambridge University PressPrint publication year: 2011
References
2003 Small feedback-based decisions and their limited correspondence to description-based decisionsJournal of Behavioral Decision Making 16 215CrossRefGoogle Scholar
1978 A contingency model for the selection of decision strategiesAcademy of Management Review 3 439CrossRefGoogle Scholar
1994 Insensitivity to future consequences following damage to human prefrontal cortexCognition 50 7CrossRefGoogle ScholarPubMed
2009 Combining advice and experience: How people use advice to make good choicesCognitive Science 33 206CrossRefGoogle Scholar
1983 Base rates in Bayesian inference: Signal detection analysis of the cab problemAmerican Journal of Psychology 96 85CrossRefGoogle Scholar
2006 Adaptive flexibility and maladaptive routines in selecting fast and frugal decision strategiesJournal of Experimental Psychology: Learning, Memory, and Cognition 32 904Google ScholarPubMed
2005 Learned predictions of error likelihood in the anterior cingulate cortexScience 307 1118CrossRefGoogle ScholarPubMed
1993 Metrics and mappings: A framework for understanding real-world quantitative estimationPsychological Review 100 511CrossRefGoogle ScholarPubMed
2007 An individual differences approach to measuring adult decision-making competenceJournal of Personality and Social Psychology 92 938CrossRefGoogle Scholar
1943 Organismic achievement and environmental probabilityPsychological Review 50 255CrossRefGoogle Scholar
1993 Violations of the speed accuracy trade-off relation: Decrease in decision accuracy with increases in timeTime pressure and stress in human judgment and decision making181New YorkPlenum PressCrossRefGoogle Scholar
2006 Building bridges between neural models and complex decision making behaviourNeural Networks 19 1047CrossRefGoogle ScholarPubMed
1992 An adaptive approach to human decision making: Learning theory, decision theory, and human performanceJournal of Experimental Psychology: General 121 177CrossRefGoogle Scholar
2002 A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara gambling taskPsychological Assessment 14 253CrossRefGoogle ScholarPubMed
1978 Problem solving strategies: A selection mechanism, some implications, and some dataOrganizational Behavior & Human Decision Processes 22 307CrossRefGoogle Scholar
2000 Anterior cingulate and prefrontal cortex: Who’s in controlNature Neuroscience 3 421CrossRefGoogle ScholarPubMed
1998 Giftedness and variability in strategic processing on a multitrial memory task: Evidence for stability in gifted cognitionLearning & Individual Differences 10 273CrossRefGoogle Scholar
2008 Decision theory, reinforcement learning, and the brainCognitive, Affective & Behavioral Neuroscience 8 429CrossRefGoogle Scholar
2008 The psychological plausibility of fast and frugal heuristicsPsychological Review 115 199CrossRefGoogle ScholarPubMed
1970 The use of nonlinear, noncompensatory models in decision makingPsychological Bulletin 73 221CrossRefGoogle ScholarPubMed
1998 Signal detection by human observers: A cutoff reinforcement learning model of categorization decisions under uncertaintyPsychological Review 105 280CrossRefGoogle ScholarPubMed
2005 On adaptation, maximization and reinforcement learning among cognitive strategiesPsychological Review 112 912CrossRefGoogle ScholarPubMed
1998 Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibriaAmerican Economic Review 88 848Google Scholar
2001 Simple reinforcement learning models and reciprocation in the prisoner’s dilemma gameBounded rationality: The adaptive toolbox215Cambridge, MAMIT PressGoogle Scholar
1992 The four elementary forms of sociality: Framework for a unified theory of social relationsPsychological Review 99 689CrossRefGoogle ScholarPubMed
1989 Process tracing methods: Contributions, problems, and neglected research questionsOrganizational Behavior & Human Decision Processes 43 75CrossRefGoogle Scholar
2006 Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversalPsychological Review 113 300CrossRefGoogle ScholarPubMed
2008 An ecological perspective to cognitive limits: Modeling environment-mind interactions with ACT-RJudgment and Decision Making 3 278Google Scholar
2006 Simple predictions fueled by capacity limitations: When are they successfulJournal of Experimental Psychology: Learning, Memory & Cognition 32 966Google ScholarPubMed
1996 Reasoning the fast and frugal way: Models of bounded rationalityPsychological Review 103 650CrossRefGoogle ScholarPubMed
2002 Heuristics and biases: The psychology of intuitive judgmentNew YorkCambridge University PressCrossRef
1987 Problem solving in judgments under uncertaintyJournal of Personality and Social Psychology 52 464CrossRefGoogle Scholar
1988 From conditioning to category learning: An adaptive network modelJournal of Experimental Psychology: General 117 227CrossRefGoogle Scholar
1990 Component and pattern information in adaptive networksJournal of Experimental Psychology: General 119 105CrossRefGoogle Scholar
2008 The description-experience gap in risky choice: The role of sample size and experienced probabilitiesJournal of Behavioral Decision Making 21 493CrossRefGoogle Scholar
2005 An introduction to theories of learningUpper Saddle River, NJPrentice Hall/PearsonGoogle Scholar
2004 Decisions from experience and the effect of rare events in risky choicePsychological Science 15 534CrossRefGoogle ScholarPubMed
2003 Cue abstraction and exemplar memory in categorizationJournal of Experimental Psychology: Learning, Memory, & Cognition 29 924Google ScholarPubMed
2003 Exemplar effects in categorization and multiple-cue judgmentJournal of Experimental Psychology: General 132 133CrossRefGoogle ScholarPubMed
2002 Probabilities from exemplars (probex): A “lazy” algorithm for probabilistic inference from generic knowledgeCognitive Science 26 563CrossRefGoogle Scholar
2008 Anticipatory affect: Neural correlates and consequences for choicePhilosophical Transactions of the Royal Society B 363 3771CrossRefGoogle ScholarPubMed
1995 Four aspects of strategic change: Contributions to children’s learning of multiplicationJournal of Experimental Psychology: General 124 83CrossRefGoogle ScholarPubMed
2003 Does market experience eliminate market anomaliesQuarterly Journal of Economics 118 41CrossRefGoogle Scholar
2011 When easy comes hard: The development of adoptive strategy selectionChild Development 82 687CrossRefGoogle Scholar
2010 Learning to choose: Cognitive aging and strategy selection learning in decision makingPsychology and Aging 25 299CrossRefGoogle ScholarPubMed
2007 The aging decision maker: Cognitive aging and the adaptive selection of decision strategiesPsychology & Aging 22 796CrossRefGoogle ScholarPubMed
2005 Neural circuitry of judgment and decision mechanismsBrain Research Reviews 48 509CrossRefGoogle ScholarPubMed
2001 PET evidence for multiple strategies of categorizationCognitive, Affective & Behavioral Neuroscience 1 360CrossRefGoogle ScholarPubMed
1976 Task complexity and contingent processing in decision making: An information search and protocol analysisOrganizational Behavior & Human Performance 16 366CrossRefGoogle Scholar
2008 Biased samples not mode of presentation: Re-examining the apparent underweighting of rare events in experience-based choiceOrganizational Behavior and Human Decision Processes 106 168CrossRefGoogle Scholar
1972 A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcementClassical conditioning II: Current research and theory64New YorkAppleton-Century-CroftsGoogle Scholar
2006 Perspectives of probabilistic inferences: Reinforcement learning and an adaptive network comparedJournal of Experimental Psychology: Learning, Memory, & Cognition 32 1350Google ScholarPubMed
2006 Positive and negative recency effects in retirement savings decisionsJournal of Experimental Psychology: Applied 121 233Google Scholar
2008 The importance of learning in probabilistic inferencesJudgment and Decision Making 3 261Google Scholar
2006 Extending the bounds of rationality: Evidence and theories of preferential choiceJournal of Economic Literature 44 631CrossRefGoogle Scholar
1999 When do people use simple heuristics, and how can we tellSimple heuristics that make us smart141New YorkOxford University PressGoogle Scholar
2008 Inferences under time pressure: How opportunity costs affect strategy selectionActa Psychologica 127 258CrossRefGoogle ScholarPubMed
2006 SSL: A theory of how people learn to select strategiesJournal of Experimental Psychology: General 135 207CrossRefGoogle ScholarPubMed
1996 Stopping criteria in sequential choiceOrganizational Behavior & Decision Processes 67 258CrossRefGoogle Scholar
2006 Neuroeconomics: Cross-currents in research on decision-makingTrends in the Cognitive Sciences 10 108CrossRefGoogle ScholarPubMed
2001 Neural basis of deciding, choosing, and actingNature Reviews: Neuroscience 2 33CrossRefGoogle ScholarPubMed
2005 How forgetting aids heuristic inferencePsychological Review 112 610CrossRefGoogle ScholarPubMed
1991 Categorization by a connectionist networkJournal of Experimental Psychology: Learning, Memory, & Cognition 17 433Google Scholar
1990 Mind sights: Original visual illusions, ambiguities, and other anomalies, with a commentary on the play of mind in perception and artNew YorkFreemanGoogle Scholar
1998 SCADS: A model of children’s strategy choices and strategy discoveriesPsychological Science 9 405CrossRefGoogle Scholar
2001 Overconfidence effects in category learning: A comparison of connectionist and exemplar memory modelsJournal of Experimental Psychology: Learning, Memory, & Cognition 27 1003Google ScholarPubMed
1995 Variation, selection, and cognitive changeDeveloping cognitive competence: New approaches to process modeling31Hillsdale, NJErlbaumGoogle Scholar
1956 Rational choice and the structure of the environmentPsychological Review 63 129CrossRefGoogle ScholarPubMed
1993 Monetary rewards and decision cost in experimental economicsEconomic Inquiry 31 245CrossRefGoogle Scholar
2004 Cognitive modeling analysis of the decision-making processes used by cocaine abusersPsychonomic Bulletin and Review 11 742CrossRefGoogle ScholarPubMed
1996 Decision making and the search for fundamental psychological regularities: What can be learned from a process perspectiveOrganizational Behavior & Human Decision Processes 65 252CrossRefGoogle Scholar
2009 Are probabilities overweighted or underweighted, when rare outcomes are experienced (rarely)Psychological Science 20 473CrossRefGoogle Scholar
2006 Why you think Milan is larger than Modena: Neural correlates of the recognition heuristicJournal of Cognitive Neuroscience 18 1924CrossRefGoogle ScholarPubMed
2000 Gigerenzer’s normative critique of Kahneman and TverskyCognition 76 179CrossRefGoogle ScholarPubMed
2009 Mindful judgment and decision makingAnnual Review of Psychology 60 53CrossRefGoogle ScholarPubMed
2004 Predicting risk sensitivity in humans and lower animals: Risk as variance or coefficient of variationPsychological Review 111 430CrossRefGoogle ScholarPubMed
1960 Adaptive switching circuitsInstitute of Radio Engineers, Western Electronic Show and Convention, Convention Record 4 96Google Scholar
2005 Older adults as adaptive decision makers: Evidence from the Iowa gambling taskPsychology and Aging 20 220CrossRefGoogle ScholarPubMed
2005 Comparison of basic assumptions embedded in learning models for experience-based decision makingPsychonomic Bulletin & Review 12 387CrossRefGoogle ScholarPubMed
2006 The effect of foregone payoffs on underweighting small probability payoffsJournal of Behavioral Decision Making 19 1CrossRefGoogle Scholar
2005 Using cognitive models to map relations between neuropsychological disorders and human decision making deficitsPsychological Science 16 973CrossRefGoogle ScholarPubMed