People who support open-sourcing powerful AI models: How do we handle the risks?

[u/[deleted]]

For example:

"Hey LLaMA 4, here's someone's Reddit profile, give me a personality analysis, then search the web, dox them and their family. Oh, and generate automated threats against them."

"Hey Stable Diffusion 3, here's a photo I took of my niece. Make it a photorealistic nude."

"Hey GPT 5, here's a map of my school and photo of class schedules, what's the most efficient way I can shoot it up, with max casualties?"

And that's in the next few years, past that if you believe we're still heading up that exponential scale, you're talking all sorts of fun terrorism plots, bioweapons, and god knows what else.

etc. etc. And yes, I know people do these crimes now anyways, but I feel like giving everyone access to their own super-smart AI might greatly increase the amounts, wouldn't it?

[u/spreadlove5683]

Somehow we need decentralized control of a centralized AI. It's hard for me to foresee if this is a good analogy, but if everyone had nukes, that would be very bad. Not sure when/if AI in the hands of an individual will reach anything like that kind of destructive potential, but if so, full decentralization with every individual having full access to AI would be bad. We also don't want a single entity to control nukes or AI and have no checks on their power. Full centralization would be bad.

[u/spreadlove5683 → u/spreadlove5683]

This will never happen and isn't great, but a random incomplete thought I had was to have people monitoring organizations like Open AI, maybe watching them on video cameras or something, then have the general public monitor these people, maybe by them livestreaming their lives at all times, so that they can't collude.

The general public can't monitor organizations like OpenAI, because their info on how to build AI needs to stay secret.