Navigating the Winds of Change: A Grad Student’s Journey Through the Replication Crisis, by Matthew J. Samson

One of the graduate students in my Replication Workshop writes about replication, the reproducibility crisis and validity in experimental psychology.

Guest post: Stop trusting other researchers

Guest post by L.J Zigerell: Current practice in the social sciences places trust in researchers regarding their data collection, analysis, and reporting of results. That trust is sometimes unwarranted. Instead, we should increase trust in social science by encouraging tools of reproducibility: replication studies, pre-registration, third-party data collection, and open data.

Guest Post: The Replication Paradox, by Michèle B. Nuijten

Will integrating original studies and published replications always improve the reliability of your results? No! Replication studies suffer from the same publication bias as original studies. In her guest post, Michèle B. Nuijten, who focuses on statistical errors and data manipulation in psychology, presents two solutions to this problem.

Guest Post: Leading international studies journal takes replication seriously, by Joseph Young

Transparency and data access – these public goods are crucial principals for science. But why don’t researchers implement them? Political scientist Joseph K. Young discusses incentives for reproducibility, and how he is tracking down old replication data for the leading international studies journal ISQ.

Guest Post: Publishing a replication? Definitely worth repeating, by Chris Hartgerink

Chris Hartgerink is a research master student at Tilburg University, the Netherlands. I invited him to write a guest post about his experience of publishing a replication project. It turns out that, among many other aspects of doing a replication study, one of the main take away points was that a replicator must be reproducible as well. He explains here why it is important to always have a second assessor on all the analysis code before submitting to a journal.

Guest Post: Two simple things to make your research more reproducible, by Thomas Wallis

In this guest post, experimental psychologist Thomas Wallis (University of Tübingen) proposes two simple ideas how you can make your work more reproducible.

Guest Post: Be a better scientist – how to make your scientific output more credible, by Thomas Leeper

Thomas Leeper, a political scientist at Aarhus University, recently wrote about where to store your replication data. In his second post, he explains what kind of data to archive, and why that makes you a better scientist. His post is packed with concrete steps and state-of-the-art software tips.

Guest Post: Archive your data or they die with you, by Thomas Leeper

Thomas Leeper is a political scientist at Aarhus University and focuses on public opinion, political psychology, and experimental methods. I invited him to write a guest post because he is a contributing developer for the rOpenGov and rOpenSci open source software projects. He also wrote the very useful dvn package that connects the statistical software R and the data archive Dataverse. In his post, Leeper explains why there is no reproducibility without proper data archiving.

Guest post: How to persuade journals to accept your replication paper

MIT students Mark Bell and Nicholas Miller recently got their replication paper “Questioning the Effect of Nuclear Weapons on Conflict” accepted by the Journal of Conflict Resolution. They wrote the paper as an assignment for Gary King‘s class on Advanced Quantitative Research Methodology. They first published their analysis on a dataverse, and then rewrote the paper for the journal. In this guest post they show how they persuaded the journal and its reviewers to publish the replication.