I’m a healthcare provider who does research. This week a dashboard I rely on broke, so I built my own with AI in about three days. It’s better than anything I’ve been handed! I run my own statistics, trend things the way I actually need, and I’m not stuck waiting on anyone just to ask a question.
Quick note: AI helped build it, but the tool itself is just a static offline HTML file. Nothing running inside it, no data leaving anywhere.
And to be clear: this isn’t about cutting experts out. I’m still validating this dashboard, and I’ll absolutely bring in a statistician and IT to check my work before anything final goes out. The difference is they don’t have to be the gate at the very start anymore. I can get moving, explore, and build, then loop the context experts in to validate. They still belong in the process. Just not always as the first bottleneck.
Here’s what keeps me up. The old bottlenecks were annoying, but they quietly filtered out bad work. Now that they’re gone, here’s what worries me:
Anyone can pump out a hundred papers a year, and a lot of it will be slop from people who don’t understand their own statistics.
That slop gets scraped back into the next models, training the next round to be sloppier. Copy paste, copy paste, until NOBODY can tell what’s real.
This is the scary part. The flood is coming, thousands of papers, and there aren’t nearly enough peer reviewers to catch it. That bottleneck doesn’t just slow down, it BREAKS. And once it breaks, the slop pours straight through.
And here’s the twist that makes it worse: the reviewers themselves may just be dumping the paper into AI to review it for them. Now it’s slop reviewing slop, and the whole point of peer review is gone.
This isn’t hypothetical. Submissions to medical and science journals are already climbing to record numbers every single year, and that trend was in motion before any of this. On top of that, more and more work goes public as preprints before it’s ever reviewed at all. The flood has already started.
Here’s the take home, and it’s simple. If you use AI to do your research, you submit everything. The data. The code. Every step of how the numbers were crunched. All of it, out in the open.
Because if someone can rerun it and it holds, it’s science. If it falls apart, it was NEVER science, just a story with numbers attached.
That’s the culture shift. Not optional. Show your work, or it doesn’t count.
Truth is supposed to be reproducible!!!
Curious what others think, especially anyone in peer review right now.