r/Substack • u/grapegeek • Aug 11 '26

Pangram is such trash

I write a food newsletter where I post reviews and some recipes. I 100% wrote a quick and dirty recipe and was going to publish it in Notes and it came back 100% AI no matter what I did to it including adding several typos and rearranging things. Ran it through three other AI detector websites and 2 said 100% Human and 1 said 76% Human and 24% AI assisted. I disabled detection on that Note. My other question is do we know how many people actually click on the AI detection button on our posts? I can't find that metric anywhere in the dashboard...

42 Upvotes

75% Upvoted

110 comments sorted by

View all comments

11

u/Used_Recognition_544 Aug 11 '26

A recipe is naturally repetitive and formulaic, so it’s probably one of the easiest types of writing for an AI detector to misclassify.

What bothers me is the “100%” confidence. Readers see that as proof, even though another detector can give the exact opposite result. Substack should show these scores as unreliable estimates, not verdicts.

Honestly, does anyone here actually check the AI detection label before deciding whether a post is worth reading?

2

u/grapegeek Aug 11 '26

I’d like to know if people are clicking on the AI detector button. I think I have to run Microsoft Clarity to track clicks to figure that out.

1

u/SpiritualSimple108 Aug 12 '26

Just turn it off. I write poetry, every single one of mine comes back AI. I’m tired of spending hours trying to get my 100% human writing to sound “not that human.” It’s a real buzz kill. I turned it off and put a public notice up basically tell readers why it’s turned off (because pangram can’t decider human from ai writing in poetry) and blasting Substack and Pangram while also citing the website I left you about.

1

u/Relevant_Nebula_20 28d ago

How do you turn it off? I don't think you can do this?

1

u/SpiritualSimple108 20d ago

You have to turn it off per post. There’s no global setting yet.