Journal editor: It is up to the author to release their data

I received this email from a journal editor in political science after I asked about their replication policy. My original email is below.
Continue reading

Tagged , ,

Currently swamped – but I’m sending my data soon

Nicole,

I would be more than happy to share my data with you, but I am currently swamped and have not had time to clean up the dataset that you requested. Normally, this wouldn’t take much but was originally part of a larger dataset that I had created, and that dataset includes data from other authors which did not give me permission to share (Don’t worry – this data is nothing used in the article). It will likely be a few weeks before I can get to this. Will this be too late?

Out of curiously, what type of project are you working on that you would need the dataset? (…)

Best,
______________

I sent two follow-up emails. The author never replied again.

Tagged , ,

Leading journal verifies articles before publication – so far, all replications failed

The American Journal of Political Science recently announced that every article will be externally verified before it is published. Authors have to provide all data, code and materials which will be verified by an external statistician. I talked to the editor William G. Jacoby about the goals of the new policy, and why no author has provided ‘perfect’ files yet.
Continue reading

Tagged , , , ,

Open peer review: What are the benefits and pitfalls?

Should journals publish review reports alongside a paper? At the meeting “The future of scholarly scientific communication” at the Royal Society it seemed that there is a general agreement: yes – we need more transparency. However, opinions were divided if reviewers’ names should be published as well.

Continue reading

Tagged , ,

Royal Society discusses changing peer review – but where does that leave early career researchers?

At the meeting “The future of scholarly scientific communication” opinions were divided about how to fix peer review. Should we abolish it, publish everything and let the world decide if it’s good science? Or do we need journals and editors to pre-select good quality work for us?

Continue reading

Journal introduces replication pre-check

Many political journals have no replication policy, or only implement it half-heartedly. Now a leading journal introduces innovative guidelines for authors that include a verification of the analysis before publication.
Continue reading

Guest Post: Research Data Review is Gaining Ground, by L. Peer and A. Green

Data Review ReplicationThis we know: Sharing research data with the goal of advancing science is slowly becoming the norm in many disciplines, and a rich ecosystem has sprung up in recent years to support that effort. Yes, technological and cultural challenges remain, but anyone watching this space would agree that much progress has been made. A guest post by Limor Peer and Ann Green.

Continue reading

Tagged , , ,

Good practice in data collection and storing

Research starts with data collection. Before you can do your analysis, you spend hours, weeks, months merging tables and transforming variables. This time is wasted if you don’t keep detailed logs about this process. Here’s a good practice guide.
Continue reading

Tagged , , ,

Navigating the Winds of Change: A Grad Student’s Journey Through the Replication Crisis, by Matthew J. Samson

One of the graduate students in my Replication Workshop writes about replication, the reproducibility crisis and validity in experimental psychology.
Continue reading

Guest Post: Six Crucial Steps to Strengthen a Replication, by Mallory Kidwell

Scientific research advances knowledge by making transparent the methodology and evidence supporting scientific claims. This way, others can evaluate the basis of evidence and repeat the research in order to confirm the conclusions. However, the current incentive structures emphasizing publication can cause a disconnect between the valued ideals and daily practices of individual researchers.
Continue reading

Tagged ,
Follow

Get every new post delivered to your Inbox.

Join 2,433 other followers