Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-11-17T17:19:33.769Z Has data issue: false hasContentIssue false

Robust Evidence and Secure Evidence Claims

Published online by Cambridge University Press:  01 January 2022

Abstract

Many philosophers have claimed that evidence for a theory is better when multiple independent tests yield the same result, i.e., when experimental results are robust. Little has been said about the grounds on which such a claim rests, however. The present essay presents an analysis of the evidential value of robustness that rests on the fallibility of assumptions about the reliability of testing procedures and a distinction between the strength of evidence and the security of an evidence claim. Robustness can enhance the security of an evidence claim either by providing what I call second-order evidence, or by providing back-up evidence for a hypothesis.

Type
Research Article
Copyright
Copyright © The Philosophy of Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Audiences to presentations at Saint Louis University, the Northwest Philosophy Conference, and the Twelfth International Congress of Logic, Methodology, and Philosophy of Science have assisted the author in refining this analysis. I have had helpful discussions with George Terzis, James Marcum, Wayne Myrvold, and Bill Harper. Robert Hudson and an anonymous referee for another journal helped steer me toward an improved formulation, and two anonymous referees for this journal provided helpful commentary and suggestions.

References

Abe, F., Albrow, M. G., et al. [CDF] (1994), “Evidence for Top Quark Production in $\overline{p}p$ Collisions at $\sqrt{s}=1.8\mathrm{TeV}\,$ ”, Physical Review D 50:29663026.Google Scholar
Achinstein, Peter (1995), “Are Empirical Evidence Claims a Priori?”, Are Empirical Evidence Claims a Priori? 46:447473.Google Scholar
Achinstein, Peter (2001), The Book of Evidence. New York: Oxford University Press.10.1093/0195143892.001.0001CrossRefGoogle Scholar
Campbell, Donald T., and Fiske, Donald W. (1959), “Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix”, Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix 56:81105.Google ScholarPubMed
Carnap, Rudolf (1962), The Logical Foundations of Probability, 2d ed. Chicago: University of Chicago Press.Google Scholar
Culp, Sylvia (1994), “Defending Robustness: The Bacterial Mesosome as a Test Case”, in Hull, David, Forbes, Malcolm, and Burian, Richard (eds.), PSA 1994: Proceedings of the 1994 Biennial Meeting of the Philosophy of Science Association. East Lansing, MI: Philosophy of Science Association, 4657.Google Scholar
Culp, Sylvia (1995), “Objectivity in Experimental Inquiry: Breaking Data-Technique Circles”, Objectivity in Experimental Inquiry: Breaking Data-Technique Circles 62:430450.Google Scholar
Franklin, Allan, and Howson, Colin (1984),“Why Do Scientists Prefer to Vary Their Experiments?”, Why Do Scientists Prefer to Vary Their Experiments? 15:5162.Google Scholar
Hacking, Ian (1983), Representing and Intervening. Cambridge: Cambridge University Press.10.1017/CBO9780511814563CrossRefGoogle Scholar
Hon, Giora (2003), “The Idols of Experiment: Transcending the ‘Etc. List’”, in Radder, Hans (ed.), The Philosophy of Scientific Experimentation. Pittsburgh: University of Pittsburgh Press, 174197.10.2307/j.ctt5hjsnf.13CrossRefGoogle Scholar
Hudson, Robert G. (1999), “Mesosomes: A Study in the Nature of Experimental Reasoning”, Mesosomes: A Study in the Nature of Experimental Reasoning 66:289309.Google Scholar
Krige, John (2001), “Distrust and Discovery: The Case of the Heavy Bosons at CERN”, Distrust and Discovery: The Case of the Heavy Bosons at CERN 92:517540.Google Scholar
Mayo, Deborah (1996), Error and the Growth of Experimental Knowledge. Chicago: University of Chicago Press.10.7208/chicago/9780226511993.001.0001CrossRefGoogle Scholar
Peirce, Charles S. (1992), The Essential Peirce, Vol. 1. Edited by Nathan Houser and Christian Kloesel. Bloomington: Indiana University Press.Google Scholar
Staley, Kent W. (2002), “What Experiment Did We Just Do? Counterfactual Error Statistics and Uncertainties about the Reference Class”, What Experiment Did We Just Do? Counterfactual Error Statistics and Uncertainties about the Reference Class 69:279299.Google Scholar
Staley, Kent W. (2004), The Evidence for the Top Quark: Objectivity and Bias in Collaborative Experimentation. New York: Cambridge University Press.Google Scholar
Tollestrup, Alvin (1995), interview by the author. Tape recording. 11 October, Fermilab, Batavia, IL.Google Scholar
Trout, J. D. (1993), “Robustness and Integrative Survival in Significance Testing: The World’s Contribution to Rationality”, Robustness and Integrative Survival in Significance Testing: The World’s Contribution to Rationality 44:115.Google Scholar
Whewell, William (1989), Theory of Scientific Method. Edited by Robert E. Butts. Indianapolis: Hackett Publishing Company.Google Scholar
Wimsatt, William (1981), “Robustness, Reliability, and Overdetermination”, in Brewer, Marilynn B. and Collins, Barry E. (eds.), Scientific Inquiry and the Social Sciences. San Francisco: Jossey-Bass, 124163.Google Scholar