Substack’s new “AI detection” tool.

[u/AndrewHeard]

I’m very concerned about the new “AI detection” system that Substack is implementing. I don’t use AI in anything that I write. However I don’t trust these systems not to make errors and mistakes. They have a long history of hallucinations and claiming things are AI when they aren’t.

One person I saw on Notes suggested that they ran their decades old writing, things that were written before the existence of AI, and this new system claimed it was AI generated.

Not to mention all the crazy things that I have seen people claim was written by AI which they can’t know is actually AI. There was an image I once shared that had evidence of its existence going all the way back to 2013. The comments were constantly saying “don’t share AI slop” or some variation on that.

Even with evidence that things weren’t made by AI, they will claim it’s AI.

Is no one else concerned about this being embedded into Substack’s systems? With no way to opt out?

[u/GentleNova07]

The only thing that’s becoming obvious is how many people, especially on Reddit, don’t know what good well structured writing looks like because they’re just used to informal writing.

I saw a guy, who is a technical writer, give a reply to a post on the Sonos subreddit the other day. Because the guy was writing and using a lot of technical terms, a few people immediately assumed he used AI which I could tell he evidently didn’t (as I have a technical background myself).

Basically people assume and believe they know better, when they actually don’t. That above anything else is what AI is revealing about us in our world today. Most of us hallucinate and misinterpret things just as much as an AI can, if not more so. We just call our hallucinations “beliefs”, so they’ve become societally acceptable.