This “checklist science” terminology I chose proved more controversial than I imagined. Some clarification: Specific checklists and guidelines can be useful in specific cases and for specific individuals. That’s obvious. And also trivial. Basically a non-issue. /1 https://twitter.com/zerdeve/status/1350670766644240384
So the issue is not being pro or anti checklists. It’s what their role in scientific endeavor is and whether scientific process can be reduced down to procedures. There isn’t any good reason to expect that mindless imposition of arbitrary rules will advance science. Also👇🏼 /2 https://twitter.com/irisvanrooij/status/1352656230641258500
I don’t see checklists as playing an important role in scientific epistemology. They may facilitate certain procedures, be useless for others and harmful in other situations (see 👇🏼). But they’re very context specific and need to be written/read/implemented with care & nuance. /3 https://twitter.com/b_penders/status/1352514036043284480
The problems we’ve been cautioning against are top-down imposition of narrowly applicable checklists/guidelines as cureall problems, their being mindlessly adopted with the unshaken belief that they equal better science, & the outsourcing of scientific rigor to external rules. /4
Myriad examples show how deceptively attractive simple rules are and how quickly they replace good judgment (p < .05, anyone?). How do we cultivate good judgment? Training, learning, questioning, practice, critique, hard work, thinking and thinking some more,... No formulas. /5 https://twitter.com/zerdeve/status/1353798024254742528
Anyway I’m not against using any checklists. I use recipes that I never stick to. They might be a good starting point. But then again, I don’t use any recipes that include a cup of mayo 🤷🏻‍♀️ And I don’t tell anyone to use my recipe or imply that they cannot cook without one. /6
Interesting paper on the problems with checklists. ”[T]he story that checklists are a ‘simple, evidence-based solution successfully used in other industries’ has many of the characteristics of ‘Cargo Cult’ or pseudoscience.” https://www.researchgate.net/profile/Stephanie_Russ/publication/278789222_The_problem_with_checklists/links/5603c44e08ae4accfbb8c12c/The-problem-with-checklists.pdf
You can follow @zerdeve.
Tip: mention @twtextapp on a Twitter thread with the keyword “unroll” to get a link to it.

Latest Threads Unrolled:

By continuing to use the site, you are consenting to the use of cookies as explained in our Cookie Policy to improve your experience.