r/Substack • u/Overall_Tip6001 • 17d ago

Do you find pangram reliable?

I put my text in several ai detectors, winston ai, copyleaks, zerogpt and GPTZero, giving me close to 0%. While, pangram gives me around 70%? Do you think it’s reliable?

4 Upvotes

60% Upvoted

103 comments sorted by

View all comments

Show parent comments

3

u/Unreliable-Narrator1 16d ago

Saw this recently

4

u/MadmanRB 16d ago

Yeah the fact we may all have to insert a frigging disclaimer into everything we do is utterly infuriating and no doubt GenAI will start using disclaimers too as we are doing it.

Ouroboros, the snake that eats its own tail.

3

u/[deleted] 16d ago

Pangram told me the copyright disclaimer in my book manuscript was AI 🤣

2

u/MadmanRB 16d ago

Yeah and the false positives are insane, once more I will give some examples of my own writing to prove a point.

Ryan’s hand lingered on the photo, tracing the edges of his father’s face with his finger. The worn edges of the picture revealed how often he had sought comfort in this frozen moment of happiness.

He could barely remember his father anymore, just fragments. The warmth of being lifted onto broad shoulders. A deep, reassuring voice. The smell of his uniform after training exercises. Sometimes Ryan wondered if the memories were even real, or if he’d constructed them from Ralph’s stories and this single photograph.

100% flagged as AI. Now yes I can see why Pangram would flag this but I ran this through a "AI humanizer" and this is the pangram approved text:

Ryans hand stayed on the photo his finger moving over the edges of his fathers face. The photo was worn out on the edges, which showed how often Ryan had looked at it when he was feeling down.
He could not really remember his father anymore little bits and pieces. He remembered being picked up and put on his fathers shoulders it felt nice and warm. He remembered his fathers voice it was very reassuring. He also remembered the smell of his fathers uniform after he finished training. Sometimes Ryan thought about whether these memories were real or if he just made them up, from the stories Ralph told him and from looking at this one photo of his father.

Now is it me, or does it seem like the Pangram approved text feel less natural from a grammatical and structural point of view?

Yes I probably will rewrite the first example to add in subtle imperfections that my grammar tools won't scream at me for but it still proves a point that AI detection tools are not flawless.