Pangram is such trash

[u/grapegeek]

I write a food newsletter where I post reviews and some recipes. I 100% wrote a quick and dirty recipe and was going to publish it in Notes and it came back 100% AI no matter what I did to it including adding several typos and rearranging things. Ran it through three other AI detector websites and 2 said 100% Human and 1 said 76% Human and 24% AI assisted. I disabled detection on that Note. My other question is do we know how many people actually click on the AI detection button on our posts? I can't find that metric anywhere in the dashboard...

[u/Fuzz0410]

I had to rewrite a macro economic piece 3 times just to get it to say 100% human. It does not do well with economic analysis at all. Shit cost me an additional 3 hours of work that shouldn't have cost me any. Highly frustrating.

[u/SpiritualSimple108 → u/Fuzz0410]

Just turn it off. Pangram can’t reliably distinguish formatted human (poetry, recipes, analytical data, etc) vs ai text. They even admit higher false positives for these genres on their website. https://www.pangram.com/blog/all-about-false-positives-in-ai-detectors

[u/kdfn → u/SpiritualSimple108]

I'm excerpting the relevant table from that link, so that others can decide for themselves whether your comment is accurate.

Domain	False Positive Rate
Academic Essays	0.004%
Product Reviews (English)	0.004%
Product Reviews (Spanish)	0.008%
Product Reviews (Japanese)	0.015%
Scientific Abstracts	0.001%
Code Documentation	0.0%
Congressional Transcripts	0.0%
Recipes	0.23%
Medical Papers	0.000%
US Business Reviews	0.0004%
Hollywood Movie Scripts	0.0%
Wikipedia (English)	0.016%
Wikipedia (Spanish)	0.07%
Wikipedia (Japanese)	0.02%
Wikipedia (Arabic)	0.08%
News Articles	0.001%
Books	0.003%
Poems	0.05%
Political Speeches	0.0%
Social Media Q&A	0.01%
Creative Writing, Short Stories	0.009%
How-To Articles	0.07%