Hostname: page-component-586b7cd67f-t7fkt Total loading time: 0 Render date: 2024-11-24T16:23:38.575Z Has data issue: false hasContentIssue false
  • English
  • Français

Data Access, Transparency, and Replication: New Insights from the Political Behavior Literature

Published online by Cambridge University Press:  03 July 2018

Daniel Stockemer ,
Sebastian Koehler  and
Tobias Lentz
Daniel Stockemer
Affiliation:
University of Ottawa
Sebastian Koehler
Affiliation:
University of Konstanz
Tobias Lentz
Affiliation:
Statistical Research Office in Hesse, Germany
Get access Rights & Permissions [Opens in a new window]

Abstract

Do researchers share their quantitative data and are the quantitative results that are published in political science journals replicable? We attempt to answer these questions by analyzing all articles published in the 2015 issues of three political behaviorist journals (i.e., Electoral Studies, Party Politics, and Journal of Elections, Public Opinion & Parties)—all of which did not have a binding data-sharing and replication policy as of 2015. We found that authors are still reluctant to share their data; only slightly more than half of the authors in these journals do so. For those who share their data, we mainly confirmed the initial results reported in the respective articles in roughly 70% of the times. Only roughly 5% of the articles yielded significantly different results from those reported in the publication. However, we also found that roughly 25% of the articles organized the data and/or code so poorly that replication was impossible.

Type
Articles
Information
PS: Political Science & Politics , Volume 51 , Issue 4 , October 2018 , pp. 799 - 803
Copyright
Copyright © American Political Science Association 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

In the original publication of this article, Tobias Lentz’s name was misspelled. The article has been updated to correct this error.

References

REFERENCES

Alvarez, R. Michael, Key, Ellen M., and Núñez, Lucas. 2018. “Research Replication: Practical Considerations.” PS: Political Science & Politics 51 (2): 422–6.Google Scholar
Evanschitzky, Heiner, Baumgarth, Carsten, Hubbard, Raymond, and Scott Armstrong, J.. 2007. “Replication Research in Marketing Revisited: A Note on a Disturbing Trend.” Journal of Business Research 60 (4): 411–15.CrossRefGoogle Scholar
Freese, Jeremy. 2007. “Overcoming Objections to Open-Source Social Science.” Sociological Methods & Research 36 (2): 220–26.CrossRefGoogle Scholar
Gherghina, Sergiu, and Katsanidou, Alexia. 2013. “Data Availability in Political Science Journals.” European Political Science 12 (3): 333–49.CrossRefGoogle Scholar
Isaac, Jeffrey C. 2015. “A Broader Conception of Political Science Publicity, Or Why I Refuse DA-RT and Yet Did Not Sign the ‘Delay DA-RT’ Petition.” The Plot: Politics Decoded. Blog, December 3. Available at www.the-plot.org/2015/12/03/a-broader-conception-of-political-science-publicity-or-why-i-refuse-da-rt-and-yet-did-not-sign-the-delay-da-rt-petition.Google Scholar
Ishiyama, John. 2014. “Data Access and Transparency in Political Science Journals.” Available at https://digital.library.unt.edu/ark:/67531/metadc501457/m2/1/high_res_d/Data%20access%20presentation%20Ishiyama.pdf. Accessed November 6, 2017.Google Scholar
Key, Ellen M. 2016. “How Are We Doing? Data Access and Replication in Political Science.” PS: Political Science & Politics 49 (2): 268–72.Google Scholar
King, Gary. 1995. “Replication, Replication.” PS: Political Science & Politics 28 (3): 443–99.Google Scholar
King, Gary. 2003. “The Future of Replication.” International Studies Perspectives 4 (1): 72–107.Google Scholar
King, Gary. 2011. “Ensuring the Data-Rich Future of the Social Sciences.” Science 331 (6018): 719–21.CrossRefGoogle Scholar
Lupia, Arthur, and Elman, Colin. 2014. “Openness in Political Science: Data Access and Research Transparency.” PS: Political Science & Politics 47 (1): 19–42.Google Scholar
Miguel, Edward, Camerer, Colin, Casey, Katherine, Cohen, Joshua, Esterling, Kevin M., Gerber, Alan, Glennerster, Rachel, et al. 2014. “Promoting Transparency in Social Science Research.” Science 343 (6166): 30–31.CrossRefGoogle Scholar
Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349 (6251): aac4716.CrossRefGoogle Scholar
Tenopir, Carol, Allard, Suzie, Douglass, Kimberly, Umur Aydinoglu, Arsev, Wu, Lei, Read, Eleanor, Manoff, Maribeth, and Frame, Mike. 2011. “Data Sharing by Scientists: Practices and Perceptions.” PloS One 6 (6): e21101.CrossRefGoogle Scholar