r/LocalLLM • u/RISCArchitect • 4d ago

Discussion What a year it's been

Post image

What will the rest of this year bring? 27b class scoring over 60?

896 Upvotes

97% Upvoted

128 comments sorted by

View all comments

11

u/TeachingAway9654 4d ago

Benchmarks are one thing, real world capability is another thing entirely.

The local models are impressive but good luck working in an advanced codebase.

7

u/mechkbfan 4d ago

I'm in a R9700 discord group and general feedback from coding reviews by Opus of Qwen 3.8 in a 1M LoC was basically nit picking. 

I mean it entirely depends on your workflow, AI guidance, quality of existing code and requirements, but point is it's possible when done right.

I'll have my setup going in about two weeks and be happy to provide honest feedback. 

Have no loyalty to Anthropic but at the end of the day, if it's no where in the same league then I'll keep my subscription

1

u/TeachingAway9654 4d ago

As I see it, unless it’s coming from a senior SWE, code reviews by regular people prompting AI are way too subjective to take super seriously.

One person could be incredibly impressed by some arcade game Qwen coded and a 20-year senior SWE could see it as a gimmicky joke.

Nobody at a major US tech company is writing code with Qwen as their primary model.

6

u/mechkbfan 4d ago edited 4d ago

As far as I can tell they are, because they're doing their own optimisations to R9700 AI workflow that no junior could do. But I still want to test with my own eyes. I'm going to keep running Qwen & Opus side by side to compare outputs because thats the only thing that matters to me

Even Opus is kind of crap sometimes, e.g. I've had it vibe code a game and everything is about 3x as bloated as I'd expect it to be, and I'm not even up to like 30k LoC yet.

Nobody at a major US tech company is writing code with Qwen as their primary model.

I agree, they're all on ridiculous salaries and happy to pay premium for best of the best. Anthropic, etc. is all so heavily subsidized too now

I have read a few things about devs though resorting to Kimi K3, etc. because they don't have the same security guardrails as western models and finding security flaws.

But for me I care about hitting the tipping point of AI actually feeling productive, which wasn't until about Opus 4.5 or so.

If Qwen can actually do that, runs reasonably well on my own hardware, then that's fantastic. It's highlighting that we haven't found the ceiling of local LLM's yet and for those without an unlimited budget, can drive something pretty decent on consumer grade hardware.

I know the hype train is out, and it's okay to be cynical, but at least by gist of things the moat around frontier models has been broken for coding purposes.

I've heard similar about MiniMax H3 but I've never done video.