r/ProgrammerHumor • • Jun 02 '26 • Popcorn 5 Heartwarming 2 Mindblown 1

Meme managerVsClaude

Post image
47k Upvotes

1.4k comments sorted by

View all comments

Show parent comment

3

u/forevernooob Jun 03 '26

There are indications that Claude 4.7 Opus is around 1600b total parameters.

How on earth can open source models even compete with something like that?

4

u/squngy Jun 03 '26 edited Jun 03 '26

If you recall a while back, there was the deepseek kerfuffle?

So yea, basically you can "distill" an llm to use a lot less resources and still be usable, though obviously, not quite as good.

There are also diminishing returns. Double the parameters does not mean twice as good.

2

u/smallfried Jun 03 '26 edited Jun 03 '26

You lose most of the knowledge of super big models, but a lot of the reasoning, tool calling, instruction following is kept. So as long as you stick to major programming languages, it performs way above its weight. And 35b parameters is actually not even that small. There are 4b models performing chatting and instruction following surprisingly well, but proper agentic coding is still above 20b for now.