Hostname: page-component-848d4c4894-5nwft Total loading time: 0 Render date: 2024-06-08T20:01:20.847Z Has data issue: false hasContentIssue false
  • English
  • Français

Getting lost in an infinite design space is no solution

Published online by Cambridge University Press:  05 February 2024

Mario Gollwitzer Open the ORCID record for Mario Gollwitzer [Opens in a new window]  and
Johannes Prager Open the ORCID record for Johannes Prager [Opens in a new window]
Mario Gollwitzer*
Affiliation:
Department of Psychology, Ludwig-Maximilians-Universität München, München, Germany mario.gollwitzer@psy.lmu.de jo.prager@psy.lmu.de https://www.psy.lmu.de/soz_en/team/professors/mario-gollwitzer/index.html https://www.psy.lmu.de/soz_en/team/academic-staff/prager/index.html
Johannes Prager
Affiliation:
Department of Psychology, Ludwig-Maximilians-Universität München, München, Germany mario.gollwitzer@psy.lmu.de jo.prager@psy.lmu.de https://www.psy.lmu.de/soz_en/team/professors/mario-gollwitzer/index.html https://www.psy.lmu.de/soz_en/team/academic-staff/prager/index.html
*
*Corresponding author.
Get access Rights & Permissions [Opens in a new window]

Abstract

Almaatouq et al. argue that an “integrative experiment design” approach can help generating cumulative empirical and theoretical knowledge. Here, we discuss the novelty of their approach and scrutinize its promises and pitfalls. We argue that setting up a “design space” may turn out to be theoretically uninformative, inefficient, and even impossible. Designing truly diagnostic experiments provides a better alternative.

Type
Open Peer Commentary
Information
Behavioral and Brain Sciences , Volume 47 , 2024 , e44
Check for updates
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Aggarwal, I., & Woolley, A. W. (2013). Do you see what I see? The effect of members’ cognitive styles on team processes and errors in task execution. Organizational Behavior and Human Decision Processes, 122(1), 92–99. https://doi.org/10.1016/j.obhdp.2013.04.003CrossRefGoogle Scholar
Brunswik, E. (1955). Representative design and probabilistic theory in a functional psychology. Psychological Review, 62(3), 193–217. https://doi.org/10.1037/h0047470CrossRefGoogle Scholar
Bunderson, J. S., & Sutcliffe, K. M. (2002). Comparing alternative conceptualizations of functional diversity in management teams: Process and performance effects. Academy of Management Journal, 45(5), 875–893. https://doi.org/10.2307/3069319CrossRefGoogle Scholar
Campbell, D. T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54(4), 297–312. https://doi.org/10.1037/h0040950CrossRefGoogle Scholar
Fiedler, K. (2017). What constitutes strong psychological science? The (neglected) role of diagnosticity and a priori theorizing. Perspectives on Psychological Science, 12(1), 46–61. https://doi.org/10.1177/1745691616654458CrossRefGoogle Scholar
Fiedler, K., McCaughey, L., & Prager, J. (2021). Quo vadis, methodology? The key role of manipulation checks for validity control and quality of science. Perspectives on Psychological Science, 16(4), 816–826. https://doi.org/10.1177/1745691620970602CrossRefGoogle Scholar
Gollwitzer, M., & Schwabe, J. (2022). Context dependency as a predictor of replicability. Review of General Psychology, 26(2), 241–249. https://doi.org/10.1177/10892680211015635CrossRefGoogle Scholar
Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46(4), 806–834. https://doi.org/10.1037/0022-006X.46.4.806CrossRefGoogle Scholar
Mischel, W. (2008). The toothbrush problem. APS Observer [Online Resource]. https://www.psychologicalscience.org/observer/the-toothbrush-problemGoogle Scholar
Platt, J. R. (1964). Strong inference: Certain systematic methods of scientific thinking may produce much more rapid progress than others. Science (New York, N.Y.), 146(3642), 347–353. https://doi.org/10.1126/science.146.3642.347CrossRefGoogle ScholarPubMed
Wason, P. C. (1960). On the failure to eliminate hypotheses in a conceptual task. The Quarterly Journal of Experimental Psychology, 12, 129–140. https://doi.org/10.1080/17470216008416717CrossRefGoogle Scholar