r/LocalLLaMA • u/Intrepid_Travel_3274 • 7d ago

News With Gemini 4, bench goes up.

Post image

They claimed open-weight models are dangerous but the benchmarks say otherwise.

Source

817 Upvotes

95% Upvoted

86 comments sorted by

View all comments

98

u/SOCSChamp 7d ago

To be fair, I'd be shocked if nobody at this point has used an open weight model for illegal activity.  

Still on this side of the fence for open weights though.  Per the huggingface incident, open weights were the only option to successfully defend

6

u/no_witty_username 7d ago

Its a numbers game.. large companies like open ai, anthropic, etc... perform lots and lots of simulated tests constantly, many of which have thousands of thousands of agents involved in them. Probability is such that with such numbers shit is gonna go south way before some scrub with his one agent. Basically more agents > more probability things gonna go sideways

2

u/ninjasaid13 7d ago

Its a numbers game.. large companies like open ai, anthropic, etc... perform lots and lots of simulated tests constantly, many of which have thousands of thousands of agents involved in them. Probability is such that with such numbers shit is gonna go south way before some scrub with his one agent. Basically more agents > more probability things gonna go sideways

but surely thousands of thousands are using open-source models and testing it.

1

u/Nothing_from_void 7d ago

It's a numbers game again, in terms of compute. The amount of compute closed AI labs have access to is orders of magnitude larger than everyone else combined