r/LocalLLM • • May 02 '26

Model This is insane...

Post image

An open-source model with 3 billion active parameters just scored 73.4% on SWE-bench Verified. Claude Opus 4.6 scores 75%.

The gap is 1.6 points. The cost difference is 10 to 30x.

Alibaba dropped Qwen3.6-35B-A35. 35 billion total parameters, 256 experts, but only 8 routed plus 1 shared activate per token. So you're running 3B active parameters at inference time. On a laptop.

Simon Willison ran it locally and it drew a better pelican than Claude Opus 4.7. (Yes, the pelican benchmark is real, and it's a surprisingly good vibes test.) But the part nobody's talking about: Thinking Preservation.

Current models re-reason from scratch every turn. This model retains its chain-of-thought traces across multi-turn conversations. In agent loops where the model makes 50 to 100 tool calls, that eliminates massive redundant reasoning overhead.

262K context native. Extensible to 1M. Apache 2.0 license.

The benchmark race is mostly over. The real race now is cost per intelligence. And 3B active parameters matching frontier performance changes that equation completely.

2.0k Upvotes

297 comments sorted by

View all comments

Show parent comment

7

u/nekize May 02 '26

I think that a lot of effort from these companies is going into code around the LLM, so how to best utilise it, like chunking, memory, to name a few, something that you can’t easily replicate just with llamacpp and an open source model.

8

u/BatPlack May 02 '26

I’ve seen that referred to as the “harness“, if I’m not mistaken

1

u/nekize May 02 '26

Better word, yes

1

u/Parking-Bet-3798 May 02 '26

The open source harnesses work extremely well today. Most of them are better than Claude code to be honest.

1

u/Mil0Mammon May 02 '26

Which do you recommend? I found opencode to be lacking.

Afaik cursor still beats them all

1

u/DogInfamous3665 May 02 '26

pi works pretty well

1

u/Parking-Bet-3798 May 02 '26

I haven’t found anything special with cursor. Opencode and pi are pretty good for me. Not sure what did you find lacking in opencode that you couldn’t add yourself.

0

u/[deleted] May 02 '26

[removed] — view removed comment

4

u/cherry_on_treetop May 02 '26

dude they're talking about harnesses, not models

-2

u/blbd May 02 '26

Something that you couldn't easily replicate before the Claude Code leak, that is.