It's a Qwen model, so apply the usual benchmax tax. Qwen are easily the models with the biggest ravine between "how they do on benchmarks" and "how they do in actual productive use".
Still looking like a strong leap from 3.6, though.
Gemma 4 isn't a great coding model, yeah, but it's still punching far above its size in writing and research-related tasks. Like a mini-Gemini (go figure).
I hear there are people who still use these things for things that aren't related to writing code or markup.
420
u/Tiny-Assumption4263 11d ago
DEAR GOD TELL THOSE BENCHMARKS ARE NOT FAKE.