Hostname: page-component-586b7cd67f-t8hqh Total loading time: 0 Render date: 2024-11-21T19:01:51.763Z Has data issue: false hasContentIssue false
  • English
  • Français

Bias in human judgement under uncertainty?

Published online by Cambridge University Press:  07 July 2009

Peter Ayton  and
Eva Pascoe
Peter Ayton
Affiliation:
Department of Psychology, City University, Northampton Square, London ECI V OHB, UK.
Eva Pascoe
Affiliation:
Department of Psychology, City University, Northampton Square, London ECI V OHB, UK.
Get access Rights & Permissions [Opens in a new window]

Abstract

The claim is frequently made that human judgement and reasoning are vulnerable to cognitive biases. Such biases are assumed to be inherent in that they are attributed to the nature of the mental processes that produce judgement. In this paper, we review the psychological evidence for this claim in the context of the debate concerning human judgemental competence under uncertainty. We consider recent counter-arguments which suggest that the evidence for cognitive biases may be dependent on observations of performance on inappropriate tasks and by comparisons with inappropriate normative standards. We also consider the practical implications for the design of decision support systems.

Type
Research Article
Information
The Knowledge Engineering Review , Volume 10 , Issue 1 , March 1995 , pp. 21 - 41
Copyright
Copyright © Cambridge University Press 1995

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Arkes, HR, Hackett, C and Boehm, L, 1989. “The generality of the relation between familiarity and validity” Journal of Behavioral Decision Making 2 81–94.CrossRefGoogle Scholar
Ayton, P, 1992. “On the competence and incompetence of experts” In: Wright, G and Bolger, F (eds.), Expertise and Decision Support, Plenum.Google Scholar
Ayton, P and Wright, G, 1987. “Assessing and improving judgmental probability forecasts” OMEGA: International Journal of Management Science 15 191–196.CrossRefGoogle Scholar
Ayton, P, Hunt, A and Wright, G, 1989. “Psychological conceptions of randomness” Journal of Behavioral Decision Making 2 221–238.CrossRefGoogle Scholar
Ayton, P, Hunt, A and Wright, G, 1991. “Randomness and reality” Journal of Behavioral Decision Making 4 222–226.CrossRefGoogle Scholar
Bacon, Fr, 1979. “Credibility of repeated statements: memory for trivia” Journal of Experimental Psychology: Human Learning and Memory 5 241–252.Google Scholar
Bar-Hillel, M, 1980. “The base-rate fallacy in probability judgements” Acta Psychologica 44 211–233.CrossRefGoogle Scholar
Beach, LR and Braun, G, 1994. “Laboratory studies of subjective probability: A status report” In: Wright, G, and Ayton, P (eds.), Subjective Probability, Wiley.Google Scholar
Benson, PG and Önkal, D, 1992. “The effects of feedback and training on the performance of probability forecasters” Internaüonal Journal of Forecasting 8 559–573.CrossRefGoogle Scholar
Bolger, F and Harvey, N, 1993. “Context-sensitive heuristics in statistical reasoning” Quarterly Journal of Experimental Psychology 46A 779–811.CrossRefGoogle Scholar
Bolger, F and Wright, G, 1994. “Assessing the quality of expert judgement: Issues and analysis” Decision Support Systems 11 1–24.CrossRefGoogle Scholar
Cohen, LJ, 1981. “Can human irrationality be experimentally demonstrated?” The Behavioral and Brain Sciences 4 317–370.CrossRefGoogle Scholar
Christcnsen-Szalanski, JJJ and Bushyhead, JB, 1981. “Physicians use of probabilistic information in a real clinical setting” Journal of Experimental Psychology, Human Perception and Performance 7 928–935.CrossRefGoogle Scholar
Cooper, A, Woo, C and Dunkelberger, W, 1988. “Entrepreneurs' perceived chances for success” Journal of Business Venturing 3 97–108.CrossRefGoogle Scholar
Cosmides, L and Tooby, J, in press. “Are humans good intuitive statisticians after all? Rethinking some conclusions from the literature on judgment under uncertainty” Cognition.Google Scholar
Dalkey, N, 1972. “An elementary cross impact model” Technological Forecasting and Social Changes 3 341–351.CrossRefGoogle Scholar
Dawes, RM, 1980. “Confidence in intellectual judgments” In: Lantermann, ED and Feger, H (eds.), Similarity and Choice, Hans Huber.Google Scholar
Dawes, RM, 1988. Rational Choice in an Uncertain World. Harcourt.Google Scholar
Dostoyevsky, F, 1966. The Gambler, Penguin.Google Scholar
DuCharme, WM and Peterson, CR, 1968. “Intuitive inference about normally distributed populations” Journal of Experimental Psychology 78 269–275.CrossRefGoogle ScholarPubMed
Duda, RO, Hart, PE and Nilsson, NJ, 1976. “Subjective Bayesian methods for rule-based inference systems” Proc. Nat. Computer. Cong (AFIPS) 45 1075–1082.Google Scholar
Eddy, DM, 1982. “Probabilistic reasoning in clinical medicine: Problems and opportunities” In: Kahneman, D, Slovic, P and Tversky, A (eds.), Judgement under Uncertainty: Heuristics and biases, Cambridge University Press.Google Scholar
Edwards, W, 1954. “The theory of decision making” Psychological Bulletin 51 380–417.CrossRefGoogle ScholarPubMed
Edwards, W, 1968. “Conservatism in human information processing” In: Kleinmuntz, B (ed.), Formal Representation of Human Judgment, Wiley.Google Scholar
Estes, W, 1976. “The cognitive side of probability learning” Psychological Review 83 37–64.CrossRefGoogle Scholar
Ferrell, WR and McGooey, PJ, 1980. “A model of calibration for subjective probabilities” Organizational Behavior and Human Performance 26 32–53.CrossRefGoogle Scholar
Finke, RA, 1984. “Strategies for being random” Bulletin of the Psychonomic Society 22 40–41.CrossRefGoogle Scholar
Fischhoff, B and Beyth-Marom, R, 1983. “Hypothesis evaluation from a Bayesian perspective” Psychological Review 90 239–260.CrossRefGoogle Scholar
Fischhoff, B, Slovic, P and Lichtenstein, R, 1983. “Fault trees: Sensitivity of estimated failure probabilities to problem representation” Journal of Experimental Psychology: Human Perception and Performance 4 330–344.Google Scholar
Fox, J, 1994. “On the necessity of probability: Reasons to believe and grounds for doubt” In: Wright, G and Ayton, P (eds.), Subjective Probability, Wiley.Google Scholar
Gigerenzer, G, 1984. “External validity of laboratory experiments: The frequency-validity relationship” American Journal of Psychology 97 185–195.CrossRefGoogle Scholar
Gigerenzer, G, 1994. “Why the distinction between single event probabilities and frequencies is important for Psychology and vice-versa” In: Wright, G and Ayton, P (eds.), Subjective Probability, Wiley.Google Scholar
Gigerenzer, G, Hell, W and Blank, H, 1988. “Presentation and content: The use of base rates as a continuous variable” Journal of Experimental Psychology: Human Perception and Performance 14 513–525.Google Scholar
Gigerenzer, G, Hoffrage, U and Kleinbolting, H, 1991. “Probabilistic mental models: A Brunswikian theory of confidence” Psychology Review 98 506–528.CrossRefGoogle ScholarPubMed
Goodwin, P and Wright, G, 1990. Decision Analysis for Business, Wiley.Google Scholar
Hacking, , 1975. The Emergence of Probability. Cambridge University Press.Google Scholar
Hasher, L, Goldstein, D and Toppino, T, 1977. “Frequency and the conference of referential validity” Journal of Verbal Learning and Verbal Behavior 21 127–141.Google Scholar
Hasher, L and Zacks, RT, 1979. “Automatic and effortful processes in memory” Journal of Experimental Psychology: General 108 356–388.CrossRefGoogle Scholar
Hasher, L and Zacks, RT, 1984. “Automatic processing of fundamental information. The case of frequency of occurrence” American Psychologist 39 1372–1388.CrossRefGoogle ScholarPubMed
Henrion, M, 1990. “Towards Efficient Probabilistic Diagnosis in Multiply Connected Belief Network” In: Olivier, RM and Smith, JQ (eds.), Influence Diagrams. Belief Nets and Decision Analysis, Wiley.Google Scholar
Jacob, VS, Gaulteney, LD and Salvendy, G, 1986 “ Strategies and biases in human decision making and their implications for expert systems” Behaviour and information Technology 5 119–140.CrossRefGoogle Scholar
Juslin, P, 1994. “The overconfidence phenomenon as a consequence of informal experimenter-guided selection of almanac items” Organizational Behavior and Human Decision Processes 57 226–246.CrossRefGoogle Scholar
Kahneman, D, Slovic, P and Tversky, A (eds.), 1982, Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press.CrossRefGoogle Scholar
Kahneman, D and Tversky, A, 1972. “Subjective probability: A judgement of representativeness” Cognitive Psychology 3 430–454.CrossRefGoogle Scholar
Kahneman, D and Tversky, A, 1973. “On the psychology of prediction” Psychological Review 80 237–251.CrossRefGoogle Scholar
Kahneman, D and Tversky, A, 1979. “Intuitive prediction: Biases and corrective procedures” Management Science 12 313–327.Google Scholar
Kahneman, D and Tversky, A, 1982a. “On the study of statistical intuitions” In: Kahneman, D, Slovic, P and Tversky, A (eds.), Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press.CrossRefGoogle Scholar
Kahneman, D and Tversky, A, 1982b. “Judgements of and by representativeness” In: Kahneman, D, Slovic, P and Tversky, A (eds.), Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press.CrossRefGoogle Scholar
Kahneman, D and Lovallo, D, 1993. “Timid choices and bold forecasts. A cognitive perspective on risk taking” Management Science 39 17–31.CrossRefGoogle Scholar
Kareev, Y, 1992. “Not that bad after all: Generation of random sequences” Journal of Experimental Psychology: Human Perception and Performance 18 1189–1194.Google Scholar
Keren, GB, 1987. “Facing uncertainty in the game of bridge: A calibration study” Organizational Behavior and Human Decision Processes 39 98–114.CrossRefGoogle Scholar
Keren, G, 1991. “Calibration and probability judgments: Conceptual and methodological issues” Acta Psychologica 77 217–273.CrossRefGoogle Scholar
Krause, PJ and Clark, DA, 1993. Representing Uncertain Knowledge: An Artificial Intelligence Approach, Intellect.CrossRefGoogle Scholar
Lenat, DL, 1982. “AM: Discovery in mathematics as heuristic search” In: Davis, R and Lenat, D (eds.), Knowledge Based Systems in Artificial intelligence, McGraw Hill.Google Scholar
Lichtenstein, S, Fischhoff, B and Phillips, LD, 1982. “Calibration of probabilities: The state of the art to 1980” In: Kahneman, D, Slovic, P and Tversky, A (eds.), Judgement under Uncertainty: Heuristics and Biases, Cambridge University Press.Google Scholar
McClelland, AGR and Bolger, F, 1994. “The calibration of subjective probabilities: Theories and Models 1980–1994” In: Wright, G and Ayton, P (eds.), Subjective Probability, Wiley.Google Scholar
Meehl, PE, 1954. Clinical versus Statistical Prediction: A theoretical analysis and a review of the evidence, University of Minnesota Press.CrossRefGoogle Scholar
Meehl, PE, 1986. “Causes and effects of my disturbing little book” Journal of Personality Assessment 50 370–375.CrossRefGoogle ScholarPubMed
Milburn, MA, 1983. “Sources of bias in the prediction of future events” Organizational Behavior and Human Performance 21 17–26.CrossRefGoogle Scholar
Murphy, AH and Brown, BG, 1985. “A comparative evaluation of objective and subjective weather forecasters in the U.S.” In: Wright, G (ed.), Behavioral Decision Making, Plenum.Google Scholar
Murphy, AH and Winkler, RL, 1984. “Probability forecasting in meteorology” Journal of the American Statistical Association 79 489–500.Google Scholar
Payne, JW, 1982. “Contingent Decision Behavior” Psychological Bulletin 92 382–402.CrossRefGoogle Scholar
Pearl, J, 1988. Probbilistic Reasoning in Intelligent Systems: Networks of plausible inference, Morgan Kaufmann.Google Scholar
Phillips, LD, 1987. “On the adequacy of judgmental probability forecasts” In: Wright, G and Ayton, P (eds.), Judgmental Forecasting, Wiley.Google Scholar
Phillips, LD and Edwards, W, 1966. “Conservatism in simple probability inference tasks” Journal of Experimental Psychology 72 346–357.CrossRefGoogle Scholar
Pitz, GF, 1974. “Subjective probability distributions for imperfectly known quantities” In: Gregg, LW (ed), Knowledge and Cognition, Erlbaum.Google Scholar
Nisbett, R and Ross, L, 1980. Human Inference: Strategies and Shortcomings, Prentice Hall.Google Scholar
Peterson, CR, Schneider, RJ and Miller, AJ, 1965. “Sample size and the revision of subjective probability” Journal of Experimental Psychology 69 522–527.CrossRefGoogle Scholar
Pitz, GF, Downing, L and Rheinold, H, 1967. “Sequential effects in the revision of subjective probabilities” Canadian Journal of Psychology 21 381–393.CrossRefGoogle ScholarPubMed
Poulton, EC, 1989. Bias in Quantifying Judgments, Erlbaum.Google Scholar
Raiffa, H, 1968. Decision Analysis, Addison-Wesley.Google Scholar
Rapoport, A and Budescu, D, 1992. “Generation of random series in two-person strictly competitive games” Journal of Experimental Psychology: General 121 352–363.CrossRefGoogle Scholar
Savage, LJ, 1954. The Foundation of Statistics, Wiley.Google Scholar
Schwartz, S and Griffin, T, 1986. Medical Thinking: The Psychology of Medical Judgment and Decision Making, Springer-Verlag.CrossRefGoogle Scholar
Shortliffe, EH and Buchanan, BG, 1976. “A model of inexact reasoning in medicine” Mathematical Biosciences 23 351–379.CrossRefGoogle Scholar
Simon, H, 1957. Models of Man: Social and Rational, Wiley.Google Scholar
Slatter, PE, 1987. “Cognitive emulation in expert system design” Knowledge Engineering Review 2 27–42.CrossRefGoogle Scholar
Tiegen, KH, 1994. “Variants of subjective probabilities: Concepts, norms and biases” In: Wright, G and Ayton, P (eds.), Subjective Probability, Wiley.Google Scholar
Tvcrsky, A and Kahneman, D, 1971. “Belief in the law of small numbers” Psychological Bulletin 76 105–110.CrossRefGoogle Scholar
Tversky, A and Kahneman, D, 1983. “Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment” Psychological Review 90 293–315.CrossRefGoogle Scholar
van der Heijden, C, 1994. “Probabilistic planning and scenario planning” In: Wright, G and Ayton, P (eds.), Subjective Probability, Wiley.Google Scholar
von, Wintcrfeldt D and W, Edwards, 1986. Decision Analysis and Behavioral Research, Cambridge University Press.Google Scholar
Wagenaar, WA and Keren, GB, 1986. “Does the expert know? The reliability of predictions and confidence ratings of experts” In: Hollnagel, E, Mancini, G and Woods, DD (eds.), Intelligent Decision Support In Process Environments, Springer-Verlag.Google Scholar
Winefield, AH, 1966. “Negative recency and event dependence” Quarterly Journal of Experimental Psychology 18 47–54.CrossRefGoogle Scholar
Winkler, RL and Murphy, AM, 1973. “Experiments in the laboratory and the real world” Organizational Behavior and Human Performance 20 252–270.CrossRefGoogle Scholar
Wright, G and Ayton, P, 1992. “ Judgmental probability forecasting in the immediate and medium term” Organizational Behavior and Human Decision Processes 51 344–363.CrossRefGoogle Scholar
Yates, JF, 1982. “External correspondence: decompositions of the mean probability score” Organizational Behavior and Human Performance 30 132–156.CrossRefGoogle Scholar
Yates, JF, McDaniel, LS and Brown, ES, 1991. “Probabilistic forecasts of stock prices and earnings: The hazards of nascent expertise” Organizational Behavior and Human Decision Processes 40 60–79.CrossRefGoogle Scholar
Yousseff, ZI and Peterson, CR, 1973. Intuitive cascaded inferences” Organizational Behavior and Human Performance 10 349–358.CrossRefGoogle Scholar