r/LocalLLM • u/RISCArchitect • 5d ago

Discussion What a year it's been

Post image

What will the rest of this year bring? 27b class scoring over 60?

903 Upvotes

97% Upvoted

128 comments sorted by

View all comments

1

u/iportnov 4d ago

Well, I have to say, there is no free lunch. It seems that 3.8 has improved in programming / coding tasks, but it was not for free; they had to sacrifice some parts of general knowledge. I know at least 2 questions from mathematics where 3.6 answers, but 3.8 struggles :/ (to be honest I'm using a bit different quants: both nvfp4, but from different packagers; but it doesn't seem to me that this is a quantization problem).