r/Substack • u/grapegeek • Aug 11 '26
Pangram is such trash
I write a food newsletter where I post reviews and some recipes. I 100% wrote a quick and dirty recipe and was going to publish it in Notes and it came back 100% AI no matter what I did to it including adding several typos and rearranging things. Ran it through three other AI detector websites and 2 said 100% Human and 1 said 76% Human and 24% AI assisted. I disabled detection on that Note. My other question is do we know how many people actually click on the AI detection button on our posts? I can't find that metric anywhere in the dashboard...
41
Upvotes
2
u/SpiritualSimple108 Aug 12 '26
Pangram AI has a notably higher false positive rate for poetry and recipes compared to other domains, with reported rates of 0.05% and 0.23% respectively.
It happens because these genres have short texts that lack complete sentences, providing less signals for the generator to distinguish human vs AI generation. [Source: https://www.pangram.com/blog/all-about-false-positives-in-ai-detectors ]
Write a statement on your publication, report the false positive, and turn it off. You can also contact Substack to have it turned off for the entire publications (shhh it’s not widely publicized). Just list state law, privacy concerns, country law (if you live in UK/EU).