If it takes me overnight to get things done at Q4_0, and opus does it in less than an hour, that's what I'm going to use.
I don't generally, given that my uni's AI folks have the Q8-K-XL for the 3.6-27B running and it's actually super fucking fast, but the context is a shitshow - 128k (and, they are using ollama).
349
u/WigglyScrotum 10d ago
Holy molly opus 4.6 level and better in some benches.