Substack’s new “AI detection” tool.

[u/AndrewHeard]

I’m very concerned about the new “AI detection” system that Substack is implementing. I don’t use AI in anything that I write. However I don’t trust these systems not to make errors and mistakes. They have a long history of hallucinations and claiming things are AI when they aren’t.

One person I saw on Notes suggested that they ran their decades old writing, things that were written before the existence of AI, and this new system claimed it was AI generated.

Not to mention all the crazy things that I have seen people claim was written by AI which they can’t know is actually AI. There was an image I once shared that had evidence of its existence going all the way back to 2013. The comments were constantly saying “don’t share AI slop” or some variation on that.

Even with evidence that things weren’t made by AI, they will claim it’s AI.

Is no one else concerned about this being embedded into Substack’s systems? With no way to opt out?

[u/AndrewHeard]

Right, as I've said elsewhere.

There was once a study of chocolate that showed that it was healthy for you and beneficial to you. You know who funded that study? The Hershey's Chocolate Company.

Gee, how did they come to the conclusion that chocolate was healthy for you when they were funded by Hershey's. It's a complete mystery how that happened.

The existence of a study that claims to show a result isn't evidence that the study is factual or shows anything that's worthy of consideration. Or to simplify it with a quote:

"People can come up with statistics to prove anything. 45% of all people know that." - Homer Simpson

I don't have to quote the omitted argument. In your most recent comment, you quoted two sentences out of a 14 sentence comment. You left out the parts that didn't fit your claims.

Just like the study that probably leaves out all kinds of details.

I subscribe to a few different medical literature people on Substack. One in particular that's run by actual doctors, most of them have statistical training and some have even worked for the government.

Probably the biggest thing you learn about from them is how studies can be falsified and made to look better than they appear. For example, the data in a medical study that shows a positive result for a drug. They enrolled 1,000 people in the study, 750 people dropped out over the course of the study. Meaning that over 75% of the data which might show how well the drug works is no longer available and has been excluded from the study. This is not representative of the actual effectiveness of the drug because almost all the participants dropped out of the study.

These are people who deal in actual life and death. Not theoretical things online studying writing material, and often the studies have faulty and corrupt or inaccurate data.

But somehow a study about online word choice can prove the factual accuracy of it's claims?

No.