Category Archives: reproducible research

Navigating the Winds of Change: A Grad Student’s Journey Through the Replication Crisis, by Matthew J. Samson

One of the graduate students in my Replication Workshop writes about replication, the reproducibility crisis and validity in experimental psychology.
Continue reading

Advertisements

Guest Post: The case for pre-registration in social science, by Jamie Monogan

pre-registration replicationPolitical scientist Jamie Monogan, University of Georgia, discusses preregistration: Why should you announce your data analysis beforehand? Which journals support preregistration? And where can you register your study?
Continue reading

Tagged , , ,

Guest post: Stop trusting other researchers

Guest post by L.J Zigerell: Current practice in the social sciences places trust in researchers regarding their data collection, analysis, and reporting of results. That trust is sometimes unwarranted. Instead, we should increase trust in social science by encouraging tools of reproducibility: replication studies, pre-registration, third-party data collection, and open data.
Continue reading

Tagged , , ,

Guest Post: Leading international studies journal takes replication seriously, by Joseph Young

Transparency and data access – these public goods are crucial principals for science. But why don’t researchers implement them? Political scientist Joseph K. Young discusses incentives for reproducibility, and how he is tracking down old replication data for the leading international studies journal ISQ.
Continue reading

Tagged , , , ,

What is a failed replication?

failed replicationA lot of original authors are concerned about their reputation when their work is replicated, and the replication fails. But when can we actually label a replication as “failed”? And how should we deal with unhappy original authors who feel ‘bullied’? Continue reading

Against publication bias: Politics journal invites pre-registered papers

After fields like Psychology have explored pre-registration of studies, now Political Science follows the trend for more transparency in research. A high ranking journal, Comparative Political Studies, plans a special issue in which all papers have to be pre-registered and are submitted without the results section. I asked Michael Findley, one of the editors behind the initative, about publication bias and transparency in the field. Continue reading

Tagged , , , , , ,

Guest Post: Publishing a replication? Definitely worth repeating, by Chris Hartgerink

Chris Hartgerink is a research master student at Tilburg University, the Netherlands. I invited him to write a guest post about his experience of publishing a replication project. It turns out that, among many other aspects of doing a replication study, one of the main take away points was that a replicator must be reproducible as well. He explains here why it is important to always have a second assessor on all the analysis code before submitting to a journal.
Continue reading

Tagged , , ,