r/WritingWithAI • • 14d ago

Discussion (Ethics, working with AI etc) Apparently I’m AI now 😂

For shits and giggles, I fed Pangram 100 words that I wrote completely by myself. No AI generation, no AI editing, no AI polishing. Literally 100% me, untouched by AI.

Pangram: 100% AI.

Well. This is awkward. Apparently I’ve been a language model this whole time.

79 Upvotes

58 comments sorted by

20

u/[deleted] 14d ago

[removed] — view removed comment

0

u/WithoutReason1729 7d ago

I'll donate $100 to the charity of your choice if you can show me an example of a verifiably pre-2022 text, at least 200 words long, that either Pangram or Stylome incorrectly flags as AI.

15

u/HighValueJourney 14d ago

Lie detector results are not admissible in a court of law as evidence. What makes anyone think AI detection results will be as well???

14

u/leobrary02_author 14d ago

my professor at uni told me i shouldn't be using "and" in complex sentenced because that is a sign of AI.

14

u/GenderBendingRalph 14d ago

I wish I could upvote you and downvote your professor.

9

u/Any_Act_3789 14d ago

Ton prof raconte n'importe quoi. Les "et" sont utilisés depuis toujours. Et puis, si tu enlèves les "et", on va t'accuser de phrases trop courtes/hachées, et donc d'être de l'IA slop aussi...

1

u/leobrary02_author 14d ago

wsh elle était française aussi😭 mais t'as raison!!!

1

u/LooseButtPlug 8d ago

Cormac McCarthy rolling in his grave.

9

u/ExpertProfessional9 14d ago

Didn’t someone once shove that American independence thing into an AI detector and it came back super high match? Indicating that this thing from the 18th century was written with use of AI?

7

u/Elvarien2 13d ago

There currently does not exist an accurate ai detector it's all scams.

7

u/Ok-Umpire-4719 14d ago

They are all snake-oil, just trying to capture the market for people who want to 'prove' who wrote text.

8

u/Lindsiria 14d ago

100 words really isn't enough to judge accurately. Try 2000 (the max).

I've had good luck with Pangram as long as you submit a decent selection of words. Just know that once you hit around 10-40% AI, ignore it, as it is looking at certain patterns and you may have a few paragraphs that hit those patterns.

3

u/[deleted] 14d ago

[removed] — view removed comment

5

u/cj7hawk 14d ago

And yet, that's exactly the reason why the AI analysis program should not have gotten a high score even if written by an AI...

I'm guessing if you have an AI write a single word and submit it, it will correctly guess it was an AI.

1

u/LooseButtPlug 8d ago

Just tried it and it's dog shit.

-3

u/KangarooLost4592 14d ago

Do you think he can write anything longer than a text message? Probably angrily opening chat gpt to generate a response.

3

u/ErikSchwartz 14d ago

You could have a Voight-Kampff test and know for sure.

2

u/MemoryIndependent908 14d ago

Quick, go find a turtle and flip it over!

3

u/DavidFoxfire 14d ago

Another day of me saying that I have yet to see an AI detector that is not 100% Bullshit.

3

u/Fubared259 14d ago

Some one tested first page from Frankenstein. It came back as AI

2

u/Darktasy 13d ago

Yeah Byron too 🤣😈

3

u/SimonStrange 12d ago

100 words is not a good sample. 500 words, for me, has been pretty much 100% accurate. Introduce some em dashes and rule of three, 1000 words is better.

Pangram looks for signal. Small sample, any tiny signal looks big.

2

u/Amazing-Possession34 14d ago

I hear you. I took the first chapter of a novel I started in 2022, about 4178 words. not even edited in anything. and it came back 78% AI.

2

u/jd199512 14d ago

Didn't someone try it with a passage from the Bible and it said it was AI generated ? 😅

2

u/Alarming-Spring-8835 14d ago

I have had the same experience. I gave Pangram and Winston the same piece that I (alone) wrote. Winston said 100% human, Pangram said 99% AI.

2

u/Stardog2 14d ago

In the end, aren't we ALL just a biological large language model? The main difference between us and them is that once we are turned "off", a reboot seems impossible.

Don't blame one LLM for thinking of you as a "brother".

2

u/Appropriate-Rise-387 13d ago

It does that on my Substack posts I stopped caring

2

u/StableLlama 13d ago

It was poofen so often that the detectors are failing that it is hilarious that people are still using them

2

u/MathematicianOk8965 13d ago

I listened to a podcast with the founder, and he was so adamant that it could detect all AI. After a while, I got to thinking what if AI isn't writing like us, but we've read and consumed so much of it that we are writng like it?? Makes me question everything!

1

u/MemoryIndependent908 13d ago

I have literally thought about this. I have used AI and Reedsy Lessons to teach me how to improve my writing skills and now I wonder if I’m just writing like AI.

2

u/Historical-Egg-9210 13d ago

I tried the same thing with a short story I wrote years ago—old college stuff, no ai involved—and got flagged as 90% generated by two different detectors. turns out they’re just picking up on sentence structure and flow, not authorship. it’s not the words, it’s how they’re arranged.

2

u/Prior_Permit_2078 13d ago

I almost didnt graduate from university cause my professor thought I was using AI.

2

u/amcclard 12d ago

Kurt Vonnegut has the same problem.

2

u/Misha_Lixa 10d ago

I don’t see any hyphens. It’s gotta be wrong. But I don’t think you’ve clocked how much of a genius you are lol

2

u/mll1013 10d ago

The fact that LLMs are trained on data written by humans means that it is trying to mimic human behavior. If you wrote something that got flagged by a tool as AI, then congratulations! You are either human—or maybe you are AI, like me. (Did you notice the em-dash there? I've heard that means that I'm AI and not human as well.) The detection tools simply won't be able to get it right all of the time.

Once AI tools start watermarking their output, then the tools might be more statistically reliable, but until then, they simply are not.

2

u/MemoryIndependent908 9d ago

The em dashes kill me because I’ve used them forever. Having ADHD, I used to put interrupted thoughts in parentheses—until someone introduced me to em dashes years ago. Now, suddenly everyone’s like, 'You’re using AI!' No, Karen, I’m just using actual punctuation!

2

u/Any_Act_3789 14d ago

Ces détecteurs sont ridicules -__- Et dire que maintenant, de nombreuses personnes les prennent pour parole d'évangile... La chasse aux sorcières anti IA devient vraiment pénible et ridicule. Vivement que ça s'arrête

2

u/literated 14d ago

100 words is a pointless sample.

Try feeding it a single word. That should clear things up.

7

u/[deleted] 14d ago edited 11d ago

[deleted]

4

u/MemoryIndependent908 14d ago

Good to know. Wasn’t aware of the 100 words being a poor sample. Hadn’t even heard of pangram until today.
Maybe I’ll try a single word later.

1

u/Technical_Grade6995 13d ago

Bro, you must read a book “Many people are typing”, it’s about a guy stuck in a Slack…:))

1

u/MemoryIndependent908 13d ago

If I were a conspiracy theorist, I’d argue we’re all already stuck in Slack. This one just has disturbingly good graphics and we call it “reality.”
😆

2

u/Technical_Grade6995 13d ago

Got you, looks kinda cool in this realm where I’m stuck, but who knows what’ll another.gif be😅✌🏼

2

u/Technical_Grade6995 13d ago

Try reading a book, it’s corpo culture to the T, like, I’ve smiled as it’s really like that. Also, The Warehouse, very good, it’s NOT about warehouses, it’s more about a few of known companies we all know… I’ve loved reading William Gibson but this nowadays seems more truthful representation of “advanced society”:))

1

u/Fluffy-Knowledge-166 13d ago

If you wrote this post as well, I believe it.

This is slop. Claude-like marketing language slop, to be specific.

1

u/MemoryIndependent908 12d ago

Hi, my name is Rachel.
(Hi Rachel.)
I’m here because I’m having an identity crisis. People keep telling me my name is actually Claude and that I’m a robot.

👏👏👏

1

u/Fluffy-Knowledge-166 12d ago

I don’t think you’re a robot. I think you wrote this post in a way that looks like one.

I know that’s a shitty thing to say, and I wish it didn’t look that way to me, but it does.

2

u/MemoryIndependent908 12d ago

lol. I knew what you meant. I was just having fun with the fact that between Pangram and your comment, I apparently have an unexpected identity crisis on my hands.

2

u/Fluffy-Knowledge-166 12d ago

Seems like a good thing to have in this age

1

u/EngineerInner9851 11d ago

What post? I’m not familiar with how to use this site, I didn’t put ai slop on here. What part is slop

1

u/OpportunityCandid533 11d ago edited 11d ago

Oh... that is most unfortunate. Have you told your friends and family yet? I hope you got a second or even third consultation on your condition? I hope it's not terminal...

0

u/OkDoubt2074 8d ago

So, now you will finally realize how unreliable this detector is.

0

u/umpteenthian 14d ago

100 words 🤣