Getting published by replicating work

There are three motivations to replicate someone else’s work. First, you learn statistics and methods. Second, you provide a service to the community by advancing knowledge and validating results. Third, and most importantly for many, if you add value, you can get it published. Here are some success stories from the social sciences about papers that got published by replicating existing work.

More and more often, stories appear about retraction of papers due to misconduct, for example in the journal of Infection and Immunity (see New York Times), when several papers had to be retracted because the author had made up results. Another paper in the British Journal of Social Psychology was retracted due to fabrication of data (see Retraction Watch). The Conflict Resolution Quarterly journal retracted an article in which the author had combined two other articles into one, claiming it was his own work (see Retraction Watch). A study on childbirth at home versus in the hospital in Feminism & Psychology was retracted after conclusions were not actually supported by the results – women were discouraged from home birth based on inadequate evidence (see Retraction Watch). After the twitter hype about misconduct in the academic world (#overlyhonestmethods) the discussion on replication, reproducibility and data sharing is attracting even more attention.

Journal expect novel research

However, we will only ever find out about misconduct if we reproduce more work. Often, motivation for this task is not always high. Journals expect novel research, and especially graduate students get pushed by their institutions to produce and publish original work as soon as possible. So why would anyone take the time to replicate?

The way social sciences work today, the main motivation can only be publication. Replicating work should not only lead to retractions, but journals should invite replications – with added value – to be published as a stand-alone paper. I’m trying to push my students in the Cambridge Replication Workshop to get to a point when they add robustness checks, new variables and interactions, updated data, multiple imputation and improved methods to their replication project so they can write a publishable project (see Gary King‘s tips on how to write a publishable article based on replication).

Replication articles: political science

This is a selection of interesting replication articles that made it into journals in political science in the last years.

If you have more articles I could add to this list, or a list of wider social science replication papers, please comment below.

About these ads
Tagged , , , , , , ,

5 thoughts on “Getting published by replicating work

  1. Winston Lin says:

    “Attributing effects to a cluster-randomized get-out-the-vote campaign” by Ben Hansen and Jake Bowers, Journal of the American Statistical Association, 2009, vol. 104, pp. 873-885

    Like

  2. [...] article” (Gary King, How to Write a Publishable Paper as a Class Project). There is now a range of replication articles that made it into high ranking journals in political science in the last [...]

    Like

  3. kerokan says:

    Dafoe, Allan. 2011. “Statistical Critiques of the Democratic Peace: Caveat Emptor.” American Journal of Political Science. 55(2): 247-262.

    Like

  4. […] might also want to read “Getting published by replicating work“, “Publishing as a grad student: replication helps” and other articles on […]

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 2,012 other followers

%d bloggers like this: