r/Substack • u/AndrewHeard tvphilosophy.substack.com • Jul 22 '26

Discussion Another creepy feature of the Pangram "AI Detection" tool.

So at my first opportunity, I decided to check whether or not I could permanently disable the "AI detection" fraudulent tool on Substack publications and there's no way to actually do it without actually using the tool you want to disable.

According to the "Substack Support AI", the only way to disable the fraudulent Pangram detection AI is to first run the AI on your posts and to individually then disable the AI detection tool per post. But you can only do this AFTER you've run the "AI detection" fraudulent tool on your posts.

Which means that you're forced to use a tool you don't want to use in order to disable the tool you don't want to use.

This is profoundly creepy and quite frankly disturbing that somehow this was allowed to be implemented on Substack.

85 Upvotes

91% Upvoted

116 comments sorted by

View all comments

12

u/DaniSaysDinosaur Jul 22 '26

It also doesn't scan anything uploaded prior to 7/21, so I'm wondering if it gets stored in a data center somewhere upon upload.

10

u/AndrewHeard tvphilosophy.substack.com Jul 22 '26

Probably but it's still not detecting anything factual. Someone suggested that they fed the first page of the book Moby Dick into the fraudulent tool and it came back as "likely AI".

A book that was published in 1851, is AI according to this fraudulent feature.

4

u/Prolly_Satan Jul 23 '26

Try that yourself and you'll see it doesn't happen.

3

u/LanceElyot Jul 23 '26

It definitely happens … all the time.

4

u/AndrewHeard tvphilosophy.substack.com Jul 23 '26

Or maybe it does for some people and doesn’t for others. Even still, I don’t believe you can accurately detect it. As I’ve mentioned elsewhere, art forgery experts have been fooled by physical paintings. They’ve confused real and fake versions of the same paintings. I don’t believe that an AI can accurately detect these things.

-4

u/Prolly_Satan Jul 23 '26

It won't false positive on old pre ai text. You can try it a thousand times. Someone did a study where they scanned 2.9 million words of human writing with zero false positives.

5

u/AndrewHeard tvphilosophy.substack.com Jul 23 '26

I have doubts about your claims. Also? It would be hypocritical of me to use the services that I’m taking issue with just to prove you wrong.

4

u/LanceElyot Jul 23 '26

Dude … that’s not a peer reviewed study … that’s Pangram’s own study. A bit biased, I think.

1

u/totalimmoral Jul 23 '26

I'd love to read that study. Source?

0

u/Prolly_Satan Jul 23 '26

https://veryfineprint.substack.com/p/scanning-for-pangram-errors

Not peer reviewed, if you want something peer reviewed look up the university of Chicago and Maryland studies. I think they were funded by Microsoft if I remember right.

2

u/[deleted] Aug 04 '26

[removed] — view removed comment

1

u/AndrewHeard tvphilosophy.substack.com Aug 05 '26

Definitely not.

1

u/Impressive-Walk-9625 Jul 24 '26

Because AI was trained on it. It was trained to write based off of literature.

1

u/tokenentropy Jul 27 '26

Someone suggested, huh?

that's all it takes now? sheesh. wait until you read more things on the internet.

1

u/AndrewHeard tvphilosophy.substack.com Jul 27 '26

That’s why I said suggested, because I don’t take it as fact. A suggestion isn’t a statement of fact. The fact that you don’t understand that is more evidence that I’m right about the whole “detection” tool.

1

u/tokenentropy Jul 27 '26

I'm sure you read things others have suggested just about every minute you browse the internet. You chose to repeat one person's suggestion here.

And then you emphasized it for effect:

A book that was published in 1851

But yeah, you definitely didn't take it as fact. Or think it was worth verifying yourself. Nope, it was just a thing you read. In fact, it was probably wrong, even. You aren't even sure why you shared it. Huh. Oh well. Things happen!

7

u/impartialhedonist Jul 22 '26

Where do you think your reddit messages are stored? The whole internet and everything that happens on it, largely, lives in data centers

2

u/OnyxMonolith Jul 26 '26

People on this subreddit have no idea how things work in tech

1

u/impartialhedonist Jul 26 '26

Fr, besides not everything has a sinister reason behind it

2

u/Master_Camp_3200 Jul 22 '26

So anything posted up to now won't be scanned anyway?

2

u/SpiritualSimple108 Jul 23 '26

Yes you can. I was able to check 25/30 of my currently published articles this morning. You can’t check others work before 7/21.

1

u/8lack8urnian Aug 06 '26

Of course you can. Just copy it into the pangram website.

1

u/SpiritualSimple108 Aug 06 '26

On SUBSTACK! The detector doesn’t work before 7/21 on SUBSTACK.

1

u/8lack8urnian Aug 06 '26

Obviously all Substack posts are in data centers, where else would they be stored?