Guest Post: Six Crucial Steps to Strengthen a Replication, by Mallory Kidwell

Scientific research advances knowledge by making transparent the methodology and evidence supporting scientific claims. This way, others can evaluate the basis of evidence and repeat the research in order to confirm the conclusions. However, the current incentive structures emphasizing publication can cause a disconnect between the valued ideals and daily practices of individual researchers.
Continue reading

Tagged ,

Replication & Reproducibility 2014: The best stories

replication_head_smIn 2014, the debate on replication and reproducibility in the social sciences moved towards pre-registration, new guidelines for replication studies, but also increasing criticism of replicators.
Continue reading

Tagged , ,

Most read pieces on reproducibility in 2014

Replication 2014
To recap the reproducibility discussions on this blog in the last 12 months I checked what readers clicked on most. Here are the three top pieces on the Political Science Replication blog in 2014.
Continue reading

Tagged , , , ,

Guest Post: The case for pre-registration in social science, by Jamie Monogan

pre-registration replicationPolitical scientist Jamie Monogan, University of Georgia, discusses preregistration: Why should you announce your data analysis beforehand? Which journals support preregistration? And where can you register your study?
Continue reading

Tagged , , ,

Re-Blogged: Solid science – How graduate students foster research transparency

replication nicole janz in mindRe-Blogged from the InMind blog (and written by me): Reproducibility is seen as the gold standard for solid science. However, three are few incentive to work transparently, and even less incentives to conduct replication studies. To change this, more and more teachers are assigning replication studies to graduate students as a class assignment. Will this turn early career researchers into witch hunters?
Continue reading

Tagged ,

Checklist for a Gold Standard Replication

Screen Shot 2014-12-14 at 15.37.50Many social scientists agree that replication studies are necessary to provide quality standards in research. But how does a good replication study look like? Here is the checklist I will use in my Replication Workshop.
Continue reading

Tagged , , , ,

Guest post: Stop trusting other researchers

Guest post by L.J Zigerell: Current practice in the social sciences places trust in researchers regarding their data collection, analysis, and reporting of results. That trust is sometimes unwarranted. Instead, we should increase trust in social science by encouraging tools of reproducibility: replication studies, pre-registration, third-party data collection, and open data.
Continue reading

Tagged , , ,

Teaching reproducibility for stats beginners – give me seven ideas!

ReplicationI’m teaching reproducibility as part of a lecture for statistics beginners in the social sciences. I reserved seven slides for that and I have 15 minutes. What would you include?

I’m thinking of these topics, and I would really need input on how to rank these, or additions on what I missed. Please comment below or on twitter (@polscireplicate).

  • Definition of reproducibility and research transparency
  • Recent scandals in the social sciences
  • How to save your project files in a transparent way (structuring your files)
  • Software tools 1: Rstudio and Rscripts
  • Software tool 2: knitr and R markdown
  • What can happen if you don’t work reproducibly

If you know of lecture slides or other materials, please share the links so I can give them to my students. I will also publish a link list on this blog. Thank you!

Tagged , , ,

Repost: Do Political Scientists Care About Effect Sizes – Replication and Type M Errors

Repost of an article by Christoper Gandrud: Reproducibility has come a long way in political science. Many major journals now require replication materials be made available either on their websites or some service such as the Dataverse Network. This is certainly progress. But what are political scientists actually supposed to do with this new information?

Continue reading

Tagged , , , , ,

Guest Post: The Replication Paradox, by Michèle B. Nuijten

Will integrating original studies and published replications always improve the reliability of your results? No! Replication studies suffer from the same publication bias as original studies. In her guest post, Michèle B. Nuijten, who focuses on statistical errors and data manipulation in psychology, presents two solutions to this problem.
Continue reading

Tagged , , , , , ,
Follow

Get every new post delivered to your Inbox.

Join 2,232 other followers