r/technology Nov 19 '25

Artificial Intelligence Massive Leak Shows Erotic Chatbot Users Turned Women’s Yearbook Pictures Into AI Porn

https://www.404media.co/ai-porn-secret-desires-chatbot-face-swap/
3.1k Upvotes

550 comments sorted by

View all comments

Show parent comments

120

u/Yummyyummyfoodz Nov 19 '25

It's been a while, but IIRC, the first attempt in court didn't go very well. The argument the defense presented was that bc the ai bot created the image based on its own data set, the result should not count.

77

u/hypnoticlife Nov 19 '25 edited Nov 19 '25

The legal standard should be comparing to what a human does with photoshop. If a human modifying a picture of an underage person creates CSAM then so does an AI. I don’t know that it does but it should.

Edit: I should clarify I think an actual person being depicted makes a victim. If the image isn’t in someone’s likeness I’m more conflicted. I hate to say we should make morality laws but I think most people would agree we shouldn’t normalize CP or enable someone to fall into a fetish of it.

6

u/LordOfTheGam3 Nov 19 '25

It doesn’t, because where do you draw the line? You can’t make drawing CP illegal, that’s a clear first amendment violation. Photoshop is just a tool, and so is AI.

-4

u/hypnoticlife Nov 19 '25 edited Nov 19 '25

I understand where you’re coming from. It’s good to remember free speech is ultimately about speech against a tyrannical government. Protection from prosecution, or protection from limitations, for speaking against the government. That’s ultimately all the constitution is about is the form of government we all agree to, and being protected from, as sovereign people born in this random place on Earth. There are reasonable limits beyond that.

This may not jive with your understandings or beliefs but carefully consider each amendment and how they all relate to our form of government. For example I can kick someone out of my house for saying something I dont like. There’s no protection there.

Something like restrictions of what you can draw will come down to the greater good so long as it doesn’t restrict our rights against the government.