#overlyhonestmethods Best tweets about tricks and manipulation in social sciences

Screen Shot 2013-01-10 at 11.52.23 PM
This week thousands of researchers used the hashtag #OverlyHonestMethods to admit how they or their colleagues manipulated data, gave up on experiments, included nonsense because a reviewer requested it. These confessions are hilarious, and a bit unsettling. Here’s a selection of tweets interesting for political and social scientists. After reading those, we don’t have to wonder anymore why no one provides their replication data. The main themes right now for social and political scientists seem to be: didn’t read citations; pleasing reviewers; statistics manipulation; please don’t replicate my study; qualitative and mixed methods issues; my supervisor told me so; forging significance; I don’t know what I’m doing.

Tweets about replication and reproducibility

Since the first #overlyhonestmethods hash tag was used on January 7, 23 tweets include concerns or jokes about reproducibility. I summarize them here. Tweets including “replication” are here.

Selected posts relevant for political and social scientists

Screen Shot 2013-01-11 at 6.18.03 PM

Screen Shot 2013-01-11 at 6.18.27 PM

Screen Shot 2013-01-09 at 5.32.54 PM

Screen Shot 2013-01-09 at 5.37.49 PM

Screen Shot 2013-01-11 at 6.18.48 PM

Screen Shot 2013-01-09 at 5.38.29 PM

Screen Shot 2013-01-09 at 5.38.40 PM

Screen Shot 2013-01-09 at 5.39.09 PM

Screen Shot 2013-01-09 at 5.40.11 PM

Screen Shot 2013-01-09 at 5.41.37 PM

Screen Shot 2013-01-09 at 5.42.12 PM

Screen Shot 2013-01-09 at 5.43.01 PM

Screen Shot 2013-01-09 at 5.43.09 PM

Screen Shot 2013-01-09 at 5.43.33 PM

Screen Shot 2013-01-09 at 5.43.59 PM

Screen Shot 2013-01-09 at 5.44.20 PM

Screen Shot 2013-01-09 at 5.45.10 PM

Screen Shot 2013-01-09 at 5.50.32 PM

Screen Shot 2013-01-09 at 5.51.04 PM

Screen Shot 2013-01-09 at 5.51.20 PM

Screen Shot 2013-01-09 at 5.51.47 PM

Screen Shot 2013-01-09 at 5.52.10 PM

Screen Shot 2013-01-09 at 6.21.58 PM

Screen Shot 2013-01-09 at 6.25.33 PM

Screen Shot 2013-01-09 at 5.16.37 PM

Screen Shot 2013-01-09 at 5.17.50 PM

Screen Shot 2013-01-09 at 5.18.07 PM

Screen Shot 2013-01-09 at 5.18.43 PM

Screen Shot 2013-01-09 at 5.18.54 PM

Screen Shot 2013-01-09 at 5.19.21 PM

Screen Shot 2013-01-09 at 5.19.37 PM

Screen Shot 2013-01-09 at 5.21.50 PM

Screen Shot 2013-01-09 at 5.22.01 PM

Screen Shot 2013-01-09 at 5.22.11 PM

Screen Shot 2013-01-09 at 5.22.26 PM

Screen Shot 2013-01-09 at 5.22.40 PM

Screen Shot 2013-01-09 at 5.22.51 PM

Screen Shot 2013-01-09 at 5.23.06 PM

Screen Shot 2013-01-09 at 5.23.58 PM

Screen Shot 2013-01-09 at 5.25.12 PM

Screen Shot 2013-01-09 at 5.25.30 PM

Screen Shot 2013-01-09 at 5.25.45 PM

Screen Shot 2013-01-09 at 5.25.55 PM

Screen Shot 2013-01-09 at 5.26.06 PM

Screen Shot 2013-01-09 at 5.26.25 PM

Screen Shot 2013-01-09 at 5.26.52 PM

Screen Shot 2013-01-09 at 5.27.23 PM

Screen Shot 2013-01-09 at 5.27.39 PM

Screen Shot 2013-01-09 at 5.27.48 PM

Screen Shot 2013-01-09 at 5.28.20 PM

Screen Shot 2013-01-09 at 5.29.37 PM

Screen Shot 2013-01-09 at 5.30.21 PM

Screen Shot 2013-01-09 at 5.06.39 PM

Screen Shot 2013-01-09 at 5.07.31 PM

Screen Shot 2013-01-09 at 5.07.47 PM

Screen Shot 2013-01-09 at 5.08.04 PM

Screen Shot 2013-01-09 at 5.08.24 PM

Screen Shot 2013-01-09 at 5.08.35 PM

Screen Shot 2013-01-09 at 5.08.53 PM

Screen Shot 2013-01-09 at 5.09.06 PM

Screen Shot 2013-01-09 at 5.09.16 PM

Screen Shot 2013-01-09 at 5.09.27 PM

Screen Shot 2013-01-09 at 5.09.38 PM

Screen Shot 2013-01-09 at 5.10.14 PM

Screen Shot 2013-01-09 at 5.10.25 PM

Screen Shot 2013-01-09 at 5.11.02 PM

Screen Shot 2013-01-09 at 5.11.13 PM

Screen Shot 2013-01-09 at 5.11.22 PM

Screen Shot 2013-01-09 at 5.11.30 PM

Screen Shot 2013-01-09 at 5.11.44 PM

Screen Shot 2013-01-09 at 5.11.55 PM

Screen Shot 2013-01-09 at 5.12.04 PM

Screen Shot 2013-01-09 at 5.14.16 PM

Screen Shot 2013-01-09 at 5.03.00 PM

Screen Shot 2013-01-09 at 5.04.47 PM

Screen Shot 2013-01-09 at 4.41.08 PM

Screen Shot 2013-01-09 at 4.40.54 PM

Screen Shot 2013-01-09 at 4.40.15 PM

Screen Shot 2013-01-09 at 4.40.02 PM

Screen Shot 2013-01-09 at 4.39.45 PM

Screen Shot 2013-01-09 at 4.39.20 PM

Screen Shot 2013-01-09 at 4.39.13 PM

Screen Shot 2013-01-09 at 4.38.54 PM

Screen Shot 2013-01-09 at 4.37.16 PM

Screen Shot 2013-01-09 at 4.37.00 PM

Screen Shot 2013-01-09 at 4.36.07 PM

Screen Shot 2013-01-09 at 4.35.36 PM

Screen Shot 2013-01-09 at 4.34.49 PM

Screen Shot 2013-01-09 at 4.34.35 PM

Screen Shot 2013-01-09 at 4.34.22 PM

Screen Shot 2013-01-09 at 4.33.39 PM

Tagged , , , , , , , ,

7 thoughts on “#overlyhonestmethods Best tweets about tricks and manipulation in social sciences

  1. Terrific T says:

    I just wrote something about this too (maybe more from a biological/health science point of view). Thanks for sharing the collection.

    Like

  2. Hi, “Bookscout” here and I would like to unpack my tweet a bit.
    My jab was at review articles and how they tend to be used as a reference instead of people bothering to track ideas to the origin. Fair enough, but a substantial review with 200 references is an enormous amount of labor to create – typical scientists read (and by this I mean read every bit, not skim) about 250-300 articles a year (I believe this is from a Tenopir/King paper). Lack of time and need for a concise summary is why reviews exist (and perhaps as a way to get easy citations for young scholars).
    So it’s a bit lazy to cite a review, but social scientists are pretty happy to cite a well-written academic book instead of going to the primary texts on which they are based, or the many journal articles that get cited along the way in a book. I’m a librarian now, so citation analysis and the gap between what influences and what is actually cited is one of my personal hobbyhorses.
    Your overall mission – more replication – is truly noble. I wish you the best of luck.
    Ian McCullough, “Bookscout”

    Like

  3. [...] evidence (see Retraction Watch). After the twitter hype about misconduct in the academic world (#overlyhonestmethods) the discussion on replication, reproducibility and data sharing is attracting even more [...]

    Like

  4. Reblogged this on Make Coffee Not War and commented:
    This makes me feel better about my masters thesis. Apparently, not many of us know what we’re doing.

    Like

  5. Pablo Gustavo Rodriguez says:

    It helps to reinforce the idea tha social science are a fake. Thanks! What about this practices in the straight “Sciences” (with uppercase)? What do you do when you are not defaming social sciences? I´m a llttle tired of this bullshit

    Like

  6. […] early January, the twitter hashtag #overlyhonestmethods revealed the current state of replication and reproducibility in the sciences. Thousands of […]

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 1,908 other followers

%d bloggers like this: