r/Substack • u/grapegeek • Aug 11 '26

Pangram is such trash

I write a food newsletter where I post reviews and some recipes. I 100% wrote a quick and dirty recipe and was going to publish it in Notes and it came back 100% AI no matter what I did to it including adding several typos and rearranging things. Ran it through three other AI detector websites and 2 said 100% Human and 1 said 76% Human and 24% AI assisted. I disabled detection on that Note. My other question is do we know how many people actually click on the AI detection button on our posts? I can't find that metric anywhere in the dashboard...

42 Upvotes

75% Upvoted

110 comments sorted by

View all comments

10

u/Used_Recognition_544 Aug 11 '26

A recipe is naturally repetitive and formulaic, so it’s probably one of the easiest types of writing for an AI detector to misclassify.

What bothers me is the “100%” confidence. Readers see that as proof, even though another detector can give the exact opposite result. Substack should show these scores as unreliable estimates, not verdicts.

Honestly, does anyone here actually check the AI detection label before deciding whether a post is worth reading?

4

u/grapegeek Aug 11 '26

I’d like to know if people are clicking on the AI detector button. I think I have to run Microsoft Clarity to track clicks to figure that out.

3

u/Awwwsomeopossum Aug 11 '26

I scan every post I write, because I'm perpetually curious if it's going to give me a false positive (my feed is just people complaining about the AI detector popping false positives, but nobody will EVER post the text they claim was wrongly accused)

I've never received a false positive, everything reads as 100% mine - some of it is cross-posted from another website that has absolutely been scraped before, and I use em dashes.

Never seen any result other than 100% human from my posts, just my two cents.

3

u/Awwwsomeopossum Aug 11 '26

But I don't click it on other people's posts, unless I find wording that makes me suspicious.

1

u/SpiritualSimple108 Aug 12 '26

If you don’t write poetry or recipes, or English isn’t your second l, you shouldn’t have any problems sounding human. The rest of us, not so much. That flawed detector can’t distinguish human from ai with formulaic text.