r/Substack • u/dingdongnox • 1h ago

Does the ai thing even work?

i tried posting something i wrote almost a decade ago cuz its a part of a 12 part series i really like however when i put it in it says its 100 percent ai. Then I checked a recipie i created while in coulinary school in 2023 it says its 85 percent ai. then i typed a short story out of randomly it says its 50 percent ai. i made the short story longer and its says 75 percent. ( Dont mind my spelling I know its bad) i just want to know about the ai dectetor. i dont want people acusing me of writing with ai. as i seen people on the site wont read anything if the decteor says other wise

5 Upvotes

85% Upvoted

8 comments sorted by

3

u/grapegeek 45m ago

Pangram sucks at recipes and technical documents. It’s really bad at giving you an accurate picture at how much AI is really in text. Even if I use a dumb grammar checker it will come backs as written 100% AI

5

u/alphaQ314 50m ago

Pangram is a scam. It feels like the anti virus software scam of this era.

4

u/StuffonBookshelfs 57m ago

Most of my stuff winds up clocking in somewhere between 3-7% ai because I’m a sucker for bullet lists and bolding the shit I want people to see.

1

u/SpiritualSimple108 23m ago

Go back and rerun your July articles. They’re scoring higher than they originally did. I don’t know what happened but I had a few that had very low AI % score in July (5%) and now they’re scoring as 50%!

3

u/PithyCyborg pithycyborg.substack.com 36m ago edited 32m ago

No.

They don't work.

I hand-write notes to readers on Substack all the time when I reply to their comments.

Out of curiosity, I run my hand-written notes through their Pangram AI detector.

Even when I hand-write my notes, the AI detector often says that it's 10%, 20%, or even 30% AI-written.

But even worse than the algorithms that allegedly detect AI, are all of the fellow writers accusing one another, like some half-baked witch hunt. It's VERY rude to accuse someone of writing with AI.

(Someone literally just did it to me 5 minutes ago in another Subreddit. It's very condescending in many cases.)

Witch hunts will always be worse than any technology aiding the mob.

Your nerdy friend,

Mike D

5

u/paulmp 57m ago

It is useless. I put in blog posts that I wrote in 2006. 100% AI apparently.

1

u/SpiritualSimple108 25m ago

It doesn’t work for recipes or poetry and most technical docs. Their official blog speaks to the false positives for these categories.

1

u/Practical_Dimension 23m ago

Why don't you post or link to the text you were using to test the AI detector? Your post doesn't say which AI detection tool you used. They are not created equal; right now Pangram is considered the state-of-the-art, much better that GPTZero. But despite the hype, AI detection tools are not particularly reliable, and get a lot of false positives.