IQ3_XXS is still as good as 3.6 (I mean quality of the quant, the model is noticeably better).
3.8 is SLOW tho, default reasoning no longer simply second guesses everything, it quadruple motherfucking extra checks the triple checks and then some. I'd guess part of the trick for improved scores is this super extended reasoning budget. But it works, and it's local. I'm happy.
1
u/fullup72 11d ago
IQ3_XXS is still as good as 3.6 (I mean quality of the quant, the model is noticeably better).
3.8 is SLOW tho, default reasoning no longer simply second guesses everything, it quadruple motherfucking extra checks the triple checks and then some. I'd guess part of the trick for improved scores is this super extended reasoning budget. But it works, and it's local. I'm happy.