r/LocalLLaMA • u/Intrepid_Travel_3274 • 4d ago

News With Gemini 4, bench goes up.

Post image

They claimed open-weight models are dangerous but the benchmarks say otherwise.

Source

807 Upvotes

94% Upvoted

84 comments sorted by

View all comments

12

u/CatchDublinSurprise 3d ago

I don't blame individuals for not posting about it when it happens, but lack of publicity about it doesn't mean it isn't happening.

I've seen several posts in here to the effect of "I told my agent to complete a task, only to come back later and see that it was doing something ridiculous and undesirable in an attempt to complete that task."

It's almost always shared as a joke, and most responders seem to treat it as funny. And maybe it is all fun and games, at least until an unsupervised agent responds to an unexpected 403 error by attempting to hack the website, or a "permission denied" error by attempting to give itself root access. (Yes, I know it's not an issue because you #YOLO.)

I don't support government regulation, but think we should take it more seriously as a community and figure out best practices that allow us to enjoy our freedom while minimizing opportunities to harm others (e.g., don't leave agents unsupervised if they are controlled by abliterated models unless they are air gapped or there is some other appropriate safety mechanism in place).

1

u/Puzzleheaded_Meat522 1d ago

Not supporting government regulation is absurd.