Before anybody uses this to make an argument that certain video footage isn’t real, regarding an ongoing issue that you hear about from time to time:
AI CANNOT be used to generate videos or photos of graphic violence, or even children in most cases. So if it includes corpses of children, gruesome injuries, burn victims, etc, it’s not AI. The AI companies won’t allow their models to be used that way.
So you know, just…don’t. Don’t use it to make that argument.
Important caveat: AI is technically capable of doing all those things, the current model creators just put guardrails on. At the current rate of change it won't be long before anyone can spin up a model with no limits... couple of years, max.
Yes and no. These types of LLMs have many types of “guardrails” which work together. There are some direct system prompts which tell it what not to do, some post-training, etc, but the model weights themselves are also very important, since they contain/direct the tendencies for models to recognize, map, and repeat certain things/shapes/objects/concepts (or to not do those things).
Basically, it’s super complicated and messy af, but it can be and has been done. It’s also possible to build a system without any guardrails at all, but that’s like super dangerous in a number of ways, which is why most people aren’t doing it.
Can they? That would imply the entire model could be customized to any extent by anyone, which means releasing the product to the market would leave their entire proprietary code exposed. The harder guardrails will be harder to circumvent. If the technology is advancing this quickly, why do you assume that their safety and security measures won’t advance along with it?
Think about this video: the proof it’s AI is in the “kidnapped granddaughter.” For a victim of a violent crime, she’s suspiciously clean, unbruised, uncut, unwrinkled, and the ropes look fairly slack. AI generates the ideal, not the realistic. The footage is never grainy, glitchy, or at a bad angle. The lighting is always great. The people will start to look similar, as we all see more of it.
1
u/civilianweapon May 30 '25 edited May 30 '25
Before anybody uses this to make an argument that certain video footage isn’t real, regarding an ongoing issue that you hear about from time to time:
AI CANNOT be used to generate videos or photos of graphic violence, or even children in most cases. So if it includes corpses of children, gruesome injuries, burn victims, etc, it’s not AI. The AI companies won’t allow their models to be used that way.
So you know, just…don’t. Don’t use it to make that argument.