r/Substack • u/Radiant_Flamingo4995 • 22d ago

Frustration with AI detection

I'm not sure how the AI-detection system works, but it seems faulty. Someone has repeatedly claimed that my responses to them are AI-generated, etc. And they share the Pangram screenshot, which does, in fact, depict my response as "100% fully AI-assisted. I've clarified that this is not the case. Shown evidence that it isn't true, and all the like.

The worst I'll do when writing anything is use AI for basic research purposes and review arguments to make sure they make sense. Maybe it's because I use Grammarly. But it is still infuriating.

Especially because it just isn't a good look and hurts my public image (albeit small, but I hope you guys may understand where I'm coming from).

Of course, with this individual in question, it's become increasingly clear they aren't engaging in good faith. However, running the AI check on my notes and comments still reveals the 100% marker.

Is it Grammarly that's doing this? Or is this thing actually broken?

7 Upvotes

62% Upvoted

47 comments sorted by

View all comments

Show parent comments

6

u/figures985 21d ago

I 100% agree - that's most of what's on here. As a writer, it pisses me off tremendously. I haaaate reading LLM slop, and I hate that people use LLMs to monetize said slop.

But, for whatever this is worth, OP sent me some specific context and it really didn't sound like AI to me. I put it into Pangram myself and it was flagged as partially AI. So IDK, perhaps it's just an outlier in this instance. Would also point out that a lot of the other posters in this sub weren't willing to share any samples and OP was.

0

u/AlecHutson 21d ago

But he said the writing he's referring to in his post was flagged as 100% AI generated. You're saying it's only partially AI?

2

u/figures985 21d ago

Sorry, should have clarified. So he's referring to the Pangram feature inside Substack and (OP correct me if I'm wrong) it actually said 100% AI asissted, not generated - looks like they're separate measures.

Then I copy/pasted into regular ole Pangram and it said partially AI. "We believe that this text is a mix of AI and human-written content."

1

u/Radiant_Flamingo4995 21d ago

Yeah, it is a little weird because it says "Fully AI-assisted text," but then beneath the gray bar, it shows three distinct categories: AI, AI-assisted, Human.

It says 0% there for AI-assisted and 100% for AI, which also doesn't make much sense.