Currently swamped – but I’m sending my data soon

Nicole,

I would be more than happy to share my data with you, but I am currently swamped and have not had time to clean up the dataset that you requested. Normally, this wouldn’t take much but was originally part of a larger dataset that I had created, and that dataset includes data from other authors which did not give me permission to share (Don’t worry – this data is nothing used in the article). It will likely be a few weeks before I can get to this. Will this be too late?

Out of curiously, what type of project are you working on that you would need the dataset? (…)

Best,
______________

I sent two follow-up emails. The author never replied again.

Advertisement

Leading journal verifies articles before publication – so far, all replications failed

The American Journal of Political Science recently announced that every article will be externally verified before it is published. Authors have to provide all data, code and materials which will be verified by an external statistician. I talked to the editor William G. Jacoby about the goals of the new policy, and why no author has provided ‘perfect’ files yet.

Guest Post: Six Crucial Steps to Strengthen a Replication, by Mallory Kidwell

Scientific research advances knowledge by making transparent the methodology and evidence supporting scientific claims. This way, others can evaluate the basis of evidence and repeat the research in order to confirm the conclusions. However, the current incentive structures emphasizing publication can cause a disconnect between the valued ideals and daily practices of individual researchers.

Replication & Reproducibility 2014: The best stories

In 2014, the debate on replication and reproducibility in the social sciences moved towards pre-registration, new guidelines for replication studies, but also increasing criticism of replicators.

Most read pieces on reproducibility in 2014

To recap the reproducibility discussions on this blog in the last 12 months I checked what readers clicked on most. Here are the three top pieces on the Political Science Replication blog in 2014.

Checklist for a Gold Standard Replication

Many social scientists agree that replication studies are necessary to provide quality standards in research. But how does a good replication study look like? Here is the checklist I will use in my Replication Workshop.

Guest post: Stop trusting other researchers

Guest post by L.J Zigerell: Current practice in the social sciences places trust in researchers regarding their data collection, analysis, and reporting of results. That trust is sometimes unwarranted. Instead, we should increase trust in social science by encouraging tools of reproducibility: replication studies, pre-registration, third-party data collection, and open data.

Repost: Do Political Scientists Care About Effect Sizes – Replication and Type M Errors

Repost of an article by Christoper Gandrud: Reproducibility has come a long way in political science. Many major journals now require replication materials be made available either on their websites or some service such as the Dataverse Network. This is certainly progress. But what are political scientists actually supposed to do with this new information?

Guest Post: The Replication Paradox, by Michèle B. Nuijten

Will integrating original studies and published replications always improve the reliability of your results? No! Replication studies suffer from the same publication bias as original studies. In her guest post, Michèle B. Nuijten, who focuses on statistical errors and data manipulation in psychology, presents two solutions to this problem.

Share your replication: Political Science Replication Initiative

Earlier this year, we sent out a survey on replication in political science to the Political Methodology (PolMeth) mailing list. Our survey results, which we wrote up in a post on the Monkey Cage blog, indicated quite a bit of interest in a site to share replication studies.