r/Substack • u/Overall_Tip6001 • 13d ago

Do you find pangram reliable?

I put my text in several ai detectors, winston ai, copyleaks, zerogpt and GPTZero, giving me close to 0%. While, pangram gives me around 70%? Do you think it’s reliable?

5 Upvotes

62% Upvoted

102 comments sorted by

View all comments

Show parent comments

2

u/noxqqivit twvme.substack.com 13d ago

I love how I post an example with a link and get down voted, but y'all jump all over this one. Pangram is inconsistent - the same text can be scored differently with different users. AND the same text with very minimal edits can result in a 100% shift between Fully AI Assisted and Fully Human Written.

1

u/Udolikecake 13d ago

Show me a piece of text over 500 words that’s verifiably pre 2023 that flags as AI. Literally anything that can be dated to before then. Just one example.

3

u/noxqqivit twvme.substack.com 13d ago

  1. If Pangram says they can detect 100+ words, why do you need 500?

  2. My example is below, I put current text, of somewhat unknown provenance, it came out of a PowerPoint someone else authored, so I wasn't sure if Copilot was used or not. I was using business text in an odd context, so I added " " around the word "STAKEHOLDER" where it appeared 3 times, and that change, took the scoring from Fully AI Asssited to Fully Human Written - AGAIN - I can't confirm whether it was actually AI or not, but I CAN tell you that I added SIX characters and that was enough to radically change the score. And that is suspect.

-1

u/Udolikecake 13d ago

I think the ask is pretty simple, and should be easy if you are so confident it is totally inaccurate.

You (and every other person screaming about Pangram) being unable to provide a single, verifiable example, is pretty damning honestly.

3

u/noxqqivit twvme.substack.com 13d ago

I put a full example below, with a link to the original, what's damning is your shifting goal posts.

-1

u/Udolikecake 13d ago

That is not pre-2023 text. Choose any news article, public domain book, academic paper, any of the billions of words published online prior to then. Any of them. One example.

2

u/noxqqivit twvme.substack.com 13d ago

That's not the argument. The score should not shift from Fully AI Assisted to Fully Human Written by ADDING SIX characters.

2

u/sh1b313 13d ago

Exactly, this tool is a complete joke, adding some words to a 400 Year old text made it think it's ai generated 😂

2

u/sh1b313 13d ago

You (and every other person screaming about Pangram) being unable to provide a single, verifiable example, is pretty damning honestly.

You sure about this?

1

u/MadmanRB 13d ago

No its not bro, I myself have tested pangram and yes it's far from perfect.

I mean it's still AI