Hostname: page-component-cd9895bd7-7cvxr Total loading time: 0 Render date: 2024-12-16T16:44:50.638Z Has data issue: false hasContentIssue false

Surveillance Is Not the Answer, and Replication Is Not a Test: Comment on Kepes and McDaniel, “How Trustworthy Is the Scientific Literature in I–O Psychology?”

Published online by Cambridge University Press:  07 January 2015

Maarten Derksen*
Affiliation:
University of Groningen
Eric F. Rietzschel
Affiliation:
University of Groningen
*
E-mail: e.f.rietzschel@rug.nl Address: Department of Psychology, University of Groningen, Grote Kruisstraat 2/1, 9712TS Groningen, The Netherlands

Abstract

Image of the first page of this content. For PDF version, please use the ‘Save PDF’ preceeding this image.'
Type
Commentaries
Copyright
Copyright © Society for Industrial and Organizational Psychology 2013

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bargh, J., Chen, M., & Burrows, L. (1996). Automaticity of social behavior: Direct effects of trait construct and stereotype activation on action. Journal of Personality and Social Psychology, 71, 230244.CrossRefGoogle ScholarPubMed
Bartlett, T. (2013). Power of suggestion. The Chronicle of Higher Education. Retrieved on from http://chronicle.com/article/Power-of-Suggestion/136907Google Scholar
Bernstein, E. S. (2012). The transparency paradox: A role for privacy in organizational learning and operational control. Administrative Science Quarterly, 57, 181216. doi: 10.1177/0001839212453028CrossRefGoogle Scholar
Collins, H. M. (1985). Changing order: replication and induction in scientific practice. London, England: Sage.Google Scholar
Doyen, S., Klein, O., Pichon, C.-L., & Cleeremans, A. (2012). Behavioral priming: It's all in the mind, but whose mind? PLoS ONE, 7(1), e29081. doi: 10.1371/journal.pone.0029081Google Scholar
Fanelli, D. (2013). Redefine misconduct as distorted reporting. Nature, 494(7436), 149. doi: 10.1038/494149aGoogle Scholar
Francis, G. (2012). The psychology of replication and replication in psychology. Perspectives on Psychological Science, 7, 585594. doi: 10.1177/1745691612459520Google Scholar
Frese, M., Brodbeck, F. C., Heinbokel, T., Mooser, C., Schleiffenbaum, E., & Thiemann, P. (1991). Errors in training computer skills: On the positive function of errors. Human–Computer Interaction, 6, 7793.CrossRefGoogle Scholar
Galak, J., & Meyvis, T. (2012). You could have just asked: Reply to Francis (2012). Perspectives on Psychological Science, 7, 595596. doi: 10.1177/1745691612463079CrossRefGoogle ScholarPubMed
Giner-Sorolla, R. (2012). Science or art? How aesthetic standards grease the way through the publication bottleneck but undermine science. Perspectives on Psychological Science, 7, 562571. doi: 10.1177/1745691612457576CrossRefGoogle ScholarPubMed
Keith, N., & Frese, M. (2008). Effectiveness of error management training: A meta-analysis. Journal of Applied Psychology, 93, 5969. doi: 10.1037/0021-9010.93.1.59Google Scholar
Kepes, S., & McDaniel, M. A. (2013). How trustworthy is the scientific literature in I-O psychology? Industrial and Organizational Psychology: Perspectives on Science and Practice, 6(3), 252268.CrossRefGoogle Scholar
Koole, S. L., & Lakens, D. (2012). Rewarding replications: A sure and simple way to improve psychological science. Perspectives on Psychological Science, 7, 608614. doi: 10.1177/1745691612462586CrossRefGoogle ScholarPubMed
Latham, G. P., Erez, M., & Locke, E. A. (1988). Resolving scientific disputes by the joint design of crucial experiments by the antagonists: Application to the Erez–Latham dispute regarding participation in goal setting. Journal of Applied Psychology, 73, 753772. doi: 10.1037/0021-9010.73.4.753CrossRefGoogle Scholar
LeBel, E. P., & Peters, K. R. (2011). Fearing the future of empirical psychology: Bem's (2011) evidence of psi as a case study of deficiencies in modal research practice. Review of General Psychology, 15, 371379. doi: 10.1037/a0025172CrossRefGoogle Scholar
Mellers, B., Hertwig, R., & Kahneman, D. (2001). Do frequency representations eliminate conjunction effects? An exercise in adversarial collaboration. Psychological Science, 12, 269275. doi: 10.1111/1467-9280.00350CrossRefGoogle ScholarPubMed
Neuroskeptic (2012). The nine circles of scientific hell. Perspectives on Psychological Science, 7, 643644. doi: 10.1177/1745691612459519Google Scholar
Nosek, B. A., Spies, J. R., & Motyl, M. (2012). Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspectives in Psychological Science, 7, 615631. doi: 10.1177/1745691612459058Google Scholar
Schmidt, S. (2009). Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology, 13, 90100. doi: 10.1037/a0015108Google Scholar
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2012). A 21 word solution. SSRN eLibrary. Retrieved from http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2160588CrossRefGoogle Scholar
Van Dyck, C., Frese, M., Baer, M., & Sonnentag, S. (2005). Organizational error management culture and its impact on performance: A two-study replication. Journal of Applied Psychology, 90, 12281240.CrossRefGoogle ScholarPubMed
Wicherts, J. M., & Bakker, M. (2012). Publish (your data) or (let the data) perish! Why not publish your data too? Intelligence, 40, 7376.Google Scholar
Yong, E. (2012). A failed replication attempt draws a scathing personal attack from a psychology professor. Discover Magazine. Retrieved from http://blogs.discovermagazine.com/notrocketscience/2012/03/10/failed-replication-bargh-psychology-study-doyen/#.UThx_TfmtYoGoogle Scholar