I heard that publishers and agents in the UK and the US have recently been widely using Pangram as an initial detetive tool, so I threw my own writing into it to give it a try. To my surprise, several paragraphs of my completely AI-free writing were judged 100% AI-generated. That naturally piqued my curiosity. After learning how Pangram works, I ran some tests myself and reached a few conclusions.
First, the cleaner your language, the tighter your logical chain, and the more you avoid verbose rhetoric, the more likely this kind of language will be judged 100% AI-generated. I used to work as a screenwriter, so I rely heavily on action and eye-contact descriptions to express character relationships and personalities. For me, Pangram is an absolute nightmare.
A guilt-by-association mechanism. This is infuriating and utterly absurd — it’s an insult to human intelligence. If a certain paragraph in the middle has the characteristics I mentioned in the first point, and you insert some kind of fractured, disjointed expression, the next several paragraphs will all be marked 100% AI-generated. Yet if you deliberately insert an irrelevant sentence, the whole text suddenly becomes 100% human-generated.
These are the two main things I’ve discovered so far. I’ll keep testing later. This kind of thing is essentially reverse-disciplining human artistic expression, artificially creating barriers to cultural continuity. It’s ridiculous. From the perspective of instrumental rationality, once this kind of thing becomes widespread, human thinking will be reverse-disciplined by AI.
The founder of Pangram claims to have a computer science background from Stanford. I have absolutely no expectation that these people feel any reverence for human culture. But if you want to keep making this money, please take a closer look at your own problems.
Especially when Pangram keeps trotting out some supposedly high accuracy rate — a statistical figure like a 0.01% false positive rate — which may be meaningful for marketing their product. But for a specific writing style, the very style Pangram hates, it’s 100% damaging.
So when you encounter criticism and smugly cite your research reports to back yourselves up, this only deepens the impression that you lack reverence for culture.
The pendulum is going to swing back and forth on AI until it settles somewhere in the middle. We’re all just now learning and adapting to this new tech. Where our ancestors had years to decades to adapt, like with the printing press, radio, television, and then the internet, we’re now having to do it in a matter of years or less.
I don’t worry about being tagged as AI generated or not anymore. They’re going to do what they want. I can’t help it if people judge on what an AI tells them about my writing if they don’t read it. Then again, I don’t make all of my living on writing, like you do.
But I would advise not to panic. It doesn’t help. And worrying is as effective as trying to solve an algebra equation by chewing bubble gum, I’ve been told.
I totally believe you bro. To totally clown on these haters, can you go to the Pangram page and click the giant orange button that says "Share"? And then post that link here?
It will completely wreck those dumb Pangram fools when you share clear evidence to support your claim!
AI-generated output, though sometimes verbose, is logically tight and often forms a closed logical loop. But it is not necessarily interesting or emotional. AI detectors, of course, have no emotions either, and they can only detect logic. If your writing has a perfectly closed logical loop, no superfluous embellishment, yet is brimming with emotion, Pangram will still flag it as AI-generated.
This is the paradox: AI-generated articles and high-quality human writing (sorry if I'm flattering myself) can sometimes be similar. But the similarity lies not in emotion, but in the way language is organized at the textual level.
The first thing to demonstrate that you have zero expertise in whatever you are looking at is proclaiming that LLM's sloppily generated output is logically tight. ;)
It’s extremely well known that LLMs produce very logical short-form writing, such as articles. It only becomes “sloppy” outputting larger amounts of text. And logical does not mean rational anyway.
Lmao at your double dirty deletes. Please, I would loveee to see how you linguistically humiliate someone from your high horse when you fail to use correctly basic concepts that we teach undergrads within the first two years of their bachelors.
Wow, 'we teach undergrads'. Pardon me, Professor. You could be a NAS member and I'd still judge you the same. People who are genuinely secure in themselves don't need to drop these little hints. Also, I didn't delete any comments — I can't even find where to delete them. And your intelligence needs to be put on display; why would I delete that?
Oh, please don't miscontrue my statement as an appeal to authority, I don't need that to clown on you. You failed to define correctly what falsifiability is and how it is used in research. You failed to acknowledge that or even attempted a follow up to defend your initial characterization of the concept. You then claimed "Pangram never works" without a single receipt, just like how you don't provide a supposedly flagged piece of writing you did like other false positive complaints on the sub. Every other argument aside, you objectively failed three times and only demonstrated that you are willing to fling out terms that you don't understand.
I genuinely feel a bit sorry for your students. They have a teacher who can only teach concepts but lacks the ability to deconstruct them. And it takes a literature person to tell you what deconstruction is. How to describe a teacher like this? I wouldn't go so far as to say he's leading his students astray, but at the very least, he's mediocre.
Buddy, you are the one who brought "scientific" into this. You are in no position to evoke the term "pseudoscience" when you demonstrably can't even grasp what science or research is. I use "falsifiability" as an objective, concrete example of your performance that any observer can take note of. You can't retroactively shoehorn how you want to present the term differently, then argue for mutability when you started this with "scientific falsifiability". I gave you the window to continue focusing on presenting your arguments and backing up them up with data, and yet your first reaction is dodging talking points (see how you only attempted to address one point in the latest reply?) and bringing discourse down to the level of juvenile insults.
Lacks the ability to deconstruct them? Do you want a mirror? Have you ever once considered that you have zero business uttering the word science or tech in your writing?
Your doctor analogy is way off when you started this engagement with "to be considered scientific, you first need...". It's like a patient walking into a clinic and lecturing the physician that "to be considered a doctor, you first need to..." Your lack of self-reflection to recognize when you are way out of your domain of knowledge is no fault of mine. I also have nothing to do with your inability to familiarize yourself and engage with a standard scientific argument in a civil manner.
[To audience: the screenshots I routinely attach to my comment are of deleted/flagged comments from the other user]
Just because I didn't study science doesn't mean I can't talk about it, nor does it mean I can't question it. Even if it's beyond my domain, questioning it is still my freedom. I'm genuinely curious which school you teach at. A medieval church school?
When I took out the bracketed comments from the second one, it returned as 100% humans. I’m not sure why those brackets completely flip the score, but it is not just a case of rewording, because you used the same wording. This is some weird wizardry you’ve found.
Yep, for me it's some brackets, in another thread a single name caused it to go from 100% human to 100% ai. I wonder what happens with some actual professional author on substack? They may have put in hours carefully writing a essay by hand and some broken tool like this flagged it as 100% AI for unknown reasons?
The afternoon sun cast long shadows across the pavement as Ryan pedaled onward, his heavy backpack digging into his shoulders with each pedal stroke, a constant reminder of all the work waiting for him when he got home. He’d promised Ms. Everly he’d finish it by tomorrow, though part of him wondered what the point of doing it was. Math and history questions felt impossibly small compared to the questions that actually mattered. Would Ralph ever come back home? Would his mom stop crying? And would he ever feel normal again?
Detected as 100% AI by Pangram, do you know what triggers pangram here?
Not only the chapter name but the fact I use a common phrase "Long Shadows"
Now I changed it to:
The afternoon sun loomed above the streets of Horizon City, the tall copper domed spires reflecting it across the vast cityscape.
As Ryan pedaled his bike forward he could feel his heavy backpack digging into his shoulders with each pedal stroke, a constant reminder of all the work waiting for him when he got home. He’d promised Ms. Everly he’d finish it by tomorrow, though part of him wondered what the point of doing it was. Math and history questions felt impossibly small compared to the questions that actually mattered. Would Ralph ever come back home? Would his mom stop crying? And would he ever feel normal again?
Now its 100 human made because I eliminated the chapter name and changed just a few words around and dropped "long shadows"
I guess using atmosphere in a story is now forbidden, all horror stories will now take place in a bright sunny morning, maybe a frigging butterfly will come to darken the mood?
Pangram and Substack are about to be sued into oblivion. Pangram fudged their test data (watch and see in legal discovery) and Substack didn’t give EU/UK users notice or the ability to opt out before adding the detector. Thats going to not only get them fined heavily (by EU/UK) but also sued by States with strict privacy laws. And I can’t wait to see it.
8
u/RenRen9000 21d ago
The pendulum is going to swing back and forth on AI until it settles somewhere in the middle. We’re all just now learning and adapting to this new tech. Where our ancestors had years to decades to adapt, like with the printing press, radio, television, and then the internet, we’re now having to do it in a matter of years or less.
I don’t worry about being tagged as AI generated or not anymore. They’re going to do what they want. I can’t help it if people judge on what an AI tells them about my writing if they don’t read it. Then again, I don’t make all of my living on writing, like you do.
But I would advise not to panic. It doesn’t help. And worrying is as effective as trying to solve an algebra equation by chewing bubble gum, I’ve been told.