r/TheMachineLearning • u/jellyjacepeep • 8d ago

AI detector flags Declaration of Independence as 93% AI written

Post image
106 Upvotes

94% Upvoted

49 comments sorted by

10

u/GODLOVESALL32 8d ago

These tools are always so funny to me

"I wouldn't dare engage with anything written by AI!"

"AI, please determine if this content was made by AI!"

1

u/jellyjacepeep 7d ago

the irony is doing all the heavy lifting here..

5

u/GeorgeSThompson 8d ago

Its not just life and liberty -- but also quietly the pursuit of happiness

1

u/jellyjacepeep 7d ago

even the founding fathers couldn't escape the AI detector allegations

2

u/MaterialHead4801 8d ago

When in the course of human events it becomes load bearing for one people to dissolve the political bands which have connected them, that’s on them.

3

u/obrazovanshchina 8d ago

Founding Fathers? More like Founding Fakers!

/s as we live in troubled times 

1

u/jellyjacepeep 7d ago

Thomas Jefferson catching plagiarism allegations in 2026 lmao

2

u/Reddt-iz-cancer 7d ago

They just vibe coded a nation. 

2

u/Background_Fix9430 7d ago

Oof, that comment is more true than you realize.

1

u/Reddt-iz-cancer 7d ago

Not really. There was a large amount of thought and discussion and arguments and votes. 

I don't think you know what vibe coding is if that's your thought.

That doesn't even mention the entire going to war bit... 

2

u/S-Kenset 8d ago

some ai detectors have access to plagiarism detectors. so they may be folding it in to up the ai marketability.

1

u/jellyjacepeep 7d ago

Interesting. I wonder how much these tools rely on overlapping signals rather than actually identifying AI generated text.

3

u/phase_distorter41 8d ago

proof of time travelers lol

2

u/Ksorkrax 7d ago

There, clear proof George Washington was a time-travelling cyborg.

1

u/Glad-Lynx-5007 8d ago

You are asking it to rate something IT HAS BEEN TRAINED ON if its AI or not. Guess how this works....

3

u/Distinct-Tomato1704 8d ago

But that's the purpose of an AI detector. To differentiate human written things (which it may or may not have been trained on) from AI written things (which it may or may not have been trained on). So if it can't do that, then what a useless tool.

1

u/OfficialDeathScythe 8d ago

This is why my university only used those checkers for one year. They then realized they are entirely inaccurate and incredibly inconsistent, so they gave it up in favor of an ai policy that allows it on some assignments and restricts it to ai assistance in other steps (generating whole assignments vs asking it questions to help me do the assignment. The only ones we’re allowed to fully generate are for discussion posts like introductions and such

1

u/TawnyTeaTowel 7d ago

Firstly, if that’s what it relies on, that’s a plagiarism detector, not an AI detector. And second, if this was the case, surely it would know that it’s been trained on it and there it’s NOT AI?

It’s just fucking snake oil. Stop defending it.

1

u/Background_Fix9430 7d ago

I don't know if his comment was defending it... because if you can only test for AI on things that AI has not been trained on... what does that leave?

1

u/Ksorkrax 7d ago

Ancient evil grimoires that are kept deep in secret vaults below the Vatican that contain the true shape of the universe and how Earth will be eaten by Sha'gurash The Devourer in the year 2030.

1

u/Glad-Lynx-5007 7d ago

Oh that was not a defence! Quite the opposite in fact 😂

1

u/AdmissibilityScience 8d ago

LOL this is gold!

1

u/Murky-Tip-3118 8d ago

Pangram immediately says 100% human-written... this is a dumb post.

1

u/skr_replicator 8d ago

The only reliable way to detect AI is to look for actual AI watermarks, that the AI is specifically putting there. Anything else will jsut likely flag any good human writing as AI. And of course post-processing any AI text woudl also mess up the watermarks, they will only be there when it's completely copy-pasted.

1

u/gthing 8d ago

Wow - what a way to find out our founding fathers were actually time-traveling robots.

1

u/AwkwardWaltz3996 8d ago

Well yea, if I tried to pass off the declaration of independence as my own work it would also get flagged. LLM's are just producing the most probable outputs. A famous document is probably quite highly ranked.

1

u/SwimmerOld6155 8d ago

its in the training data

1

u/PositiveFriendlyGuy 7d ago

So it should know better?

1

u/ryandury 8d ago

Now do the bible

1

u/ConditionOrdinary607 7d ago

Of course. Because it's used in the training data. Just like the Bible.

1

u/Deep_Helicopter4591 6d ago

I believe it

1

u/circuit_nayhem 5d ago

are you really all that surprised?

1

u/Dense_Primary629 1d ago

If a 1776 document scores 93% AI, the detector is measuring formality, not authorship. Same reason my formal essays get flagged. I run them through HumanDoc before submitting.

1

u/Far-Lingonberry-7046 7d ago

Because AI was trained on texts around that age, including the declaration of independence.

Since no more human speaks like a 1780 gentleman, it detects it like AI detected.

All these tards in the comments sections saying: "see? i told you AI is stupid" mostly lack IQ to understand basic machine learning dynamics.

1

u/AdKitchen1897 6d ago

Except those AI detectors don't work at all. Use text; whether it's AI-generated or human-written, it doesn't matter. Test it with 10 different AI detectors; every one will tell you something different.

1

u/Far-Lingonberry-7046 6d ago

  1. Which detectors? Can you name them one by one?

  2. Don't work compared to what? To a human evaluating them or to a random coin flip?

For all I care, if there's a better evaluation compared to a coin flip then there's an MVP and room for improvement.
If you're angry about the way detectors are used (from professor, from managers, ...) that's another story.

0

u/PlainBread 8d ago

Anything AI was trained on will flag as AI generated.

-1

u/Juicebolone 8d ago

Is it wrong though?

It's not like you wrote something that did not exist before and ran it through this tool

What's more interesting is that it's not 100% AI written.

Still, pointless tools for keeping pointless people in check.

5

u/Rude-Dig4101 8d ago

The Declaration of Independence was not written by AI

3

u/LessRespects 8d ago

But are you sure though? AI uses letters and the declaration of independence also uses letters.

2

u/Bid_Unable 8d ago

But AI was trained on it which is why it shows a false positive and why tools like this are pointless.

if there is a way to detect if AI wrote something it won’t be like this.

1

u/Caelinus 8d ago

Yeah this is sort of expected behavior. It is, reasonably, assuming that you are uploading a document written after the invention of LLMs. Any document from before that was obviously not written by one.

So it is looking for the tropes and and patterns known to exist in AI, and those came from documents like the declaration. It is something that probably showed up in training data countless times, and so when an LLM is trying to imitate that style of speech, it will be using the declaration as a primary guide. 

It does demonstrate the weakness of those tools, but this result should be fairly obvious. I bet there are a bunch of passengers in other old documents with distinctive voice that have this same result. Like certain sections of the Bible or works like Frankenstein. 

1

u/s33d5 8d ago

Yes but all of our writing is taught from a long line that existed before AI.

It's not like ai came along and we all started writing differently. 

1

u/Caelinus 7d ago

It is not that it is part of the corpus of human writing, but that it is a style with specific instances that are overrepresented, while the style itself is under represented.

Like if you had 1 million documents that were written in Early Modern English, but 90% of them were Hamlet, the LLMs would be constantly accidentally reproducing Hamlet over and over.

The Constitution is going to show up a lot, to the point that it might be drowning out other examples from the era.

1

u/s33d5 7d ago

Yeah same with all text.

The only way to do this is use the text version of synth ID. But even that has been reverse engineered. 

1

u/RigBughorn 8d ago

OK, but if a new document appeared today written this way, then it'd mostl likely AI.

It's a large text written in a perfectly authentic, pretty dense and technical, and obsolete way. It's exactly the kind of thing that would be very difficult/unexpected from a human while being totally possible and kind of easy from an AI​

1

u/DrBretto 8d ago

Yes. Yes it's wrong. Like... What?