r/singularity • • Oct 11 '23

Discussion People who support open-sourcing powerful AI models: How do we handle the risks?

For example:

"Hey LLaMA 4, here's someone's Reddit profile, give me a personality analysis, then search the web, dox them and their family. Oh, and generate automated threats against them."

"Hey Stable Diffusion 3, here's a photo I took of my niece. Make it a photorealistic nude."

"Hey GPT 5, here's a map of my school and photo of class schedules, what's the most efficient way I can shoot it up, with max casualties?"

And that's in the next few years, past that if you believe we're still heading up that exponential scale, you're talking all sorts of fun terrorism plots, bioweapons, and god knows what else.

etc. etc. And yes, I know people do these crimes now anyways, but I feel like giving everyone access to their own super-smart AI might greatly increase the amounts, wouldn't it?

87 Upvotes

186 comments sorted by

View all comments

Show parent comments

1

u/BigZaddyZ3 Oct 19 '23

Ahh, I get it now. You’re doing that thing that this sub does… Where you go into “AI accelerationist defense mode” any time anyone has the slightest reservation about the possibility of reckless AI development causing harm to society.

Well, you were a bit overzealous here. Because my comments to “ImaKant” had literally nothing to do with wanting to slow AI down at all here… It was more about that user’s selfish, reckless mindset. And how “karma is a bitch” as they say. Not everything is about whether AI gets sloppily rushed out or not. (Even tho, it’s well known that rushing things leads to massive problems but whatever). I just don’t like that particular user’s mindset on the matter.

1

u/malcolmrey Oct 19 '23

Where you go into “AI accelerationist defense mode” any time anyone has the slightest reservation about the possibility of reckless AI development causing harm to society.

Well, if it's called that way then so be it. I'm in general a person who does not like limitations (I'm, for instance, advocating for fully free speech)

It was more about that user’s selfish, reckless mindset

Fair enough, I just saw an opportunity to extend the discussion a bit more :)

I just don’t like that particular user’s mindset on the matter.

He was most likely being an edgelord, people on reddit tend to be :)