I don't blame the Duke researchers for the flawed reporting on the gaiter study. Any science reporter knows you talk to more than one expert for a story. So much harm is done when we don't do our homework. (a thread)
Even for peer reviewed studies, experienced science writers call other experts in the field. We want to be sure there is consensus, and that we're not missing something important that only experts would see. Pro tip: If the news is really, really surprising, proceed with caution.
Recently there was a very exciting mask study co-authored by a Nobel laureate. I sent out several queries to experts in the field -- I alerted the newsdesk. But soon...it was immediately clear the study was seriously flawed. Eventually this happened. https://www.nytimes.com/2020/06/18/health/coronavirus-retractions-studies.html
But even if the gaiter reporter was on deadline and couldn't do more interviews, there were red flags in the study itself. The gaiter finding was not statistically significant. The error bars alone were a huge red flag. Also, the entire premise was based on A SINGLE EVENT.
But the damage is done. I just heard a university pulled it's mascot-themed gaiters after the study broke. The lesson for academics -- the press will jump on something new, different, surprising. Does it need to be said that an N=1 should not be emphasized in the summary?
The lesson for reporters -- in science, all news but especially surprising news should be vetted by multiple experts. Of course I've made mistakes too. You can avoid mistakes by talking to more experts and not relying on study authors or a single source to explain their work.
You can follow @taraparkerpope.
Tip: mention @twtextapp on a Twitter thread with the keyword “unroll” to get a link to it.

Latest Threads Unrolled:

By continuing to use the site, you are consenting to the use of cookies as explained in our Cookie Policy to improve your experience.