Thursday, April 3, 2025

Two Simple Rules to Avoid Drowning in Bad Science

Let’s be honest: Scientific literature is a cornerstone of our work, but it's becoming increasingly tricky to navigate. Non-reproducible studies, paper mills, predatory journals, and dubious peer reviews are making it harder to separate genuine data from bad science.

I’ve been in this business for about 20 years, and I’m tired of wasting my time. This isn’t just preaching; this is a strategy I actually use. It works pretty well in the biomedical field (and I suspect it’ll work in any other research-intensive field).

Stick to High-Impact Journals. We all know that the impact factor isn't perfect, and ideally, we shouldn't obsess over it. Blah blah... But as a practical scientific reality, a paper published in Nature is far more likely to contain reproducible findings and undergo rigorous review compared to something published in the "World Journal of Whatever."

Favor Society-Endorsed Journals. Journals published or endorsed by respected societies usually have rigorous editorial standards, and they tend to attract more experienced reviewers. Stick to journals affiliated with established academic societies and credible editorial boards. This is especially useful for specialized stories that high-impact journals might ignore despite solid data. And yes, even if many journals from publishers starting with M, F, or B seem like trashcans, some are genuinely maintained by real scientists committed to quality science.

And the third rule is... No, wait, actually, this is it. Cheesy, I know, but honestly, 90% of the useful literature can be filtered effectively using just these two rules. As a quick, practical guide to avoid drowning in nonsense, this works surprisingly well.

So, What's Your Strategy?
I’d love to hear how others cut through the noise. Feel free to share your own filtering methods or rip apart mine.

No comments:

Post a Comment

Vaccines, fertility, and a cargo cult

I originally planned to write another response to the reaction of SMIS to this article , but I realised there's no point in arguing wit...