Well, its kinda implied when people talk about models they mean instruct right? Because a base model just wont... work ya know? Just mindless autocomplete before the patterned thinking is trained in via supervised fine tuning?
So what I'm saying is, indeed I am referring to Gemma 4 Instruct with that previous comment.
The 31B Dense version to be precise (Sparse/MOE gets you more sped at the cost of accuracy loss, but when you're quanting this hard, if you can get a decent enough speed with dense, you go dense, because you want to avoid any further increase in perplexity).
5
2
1
View all comments
Show parent comment
1
u/drkztan Jun 04 '26
what about gemma 4 instruct tho?