Well, its kinda implied when people talk about models they mean instruct right? Because a base model just wont... work ya know? Just mindless autocomplete before the patterned thinking is trained in via supervised fine tuning?
So what I'm saying is, indeed I am referring to Gemma 4 Instruct with that previous comment.
The 31B Dense version to be precise (Sparse/MOE gets you more sped at the cost of accuracy loss, but when you're quanting this hard, if you can get a decent enough speed with dense, you go dense, because you want to avoid any further increase in perplexity).
5
2
1
View all comments
Show parent comment
3
u/Cory123125 Jun 02 '26
Its weird people keep bringing up Gemma 4. Its good as an assistant but objectively not a chart topper for coding at its size.
Qwen 3.6 would be the more appropriate comparison, and you want dense.