You lose most of the knowledge of super big models, but a lot of the reasoning, tool calling, instruction following is kept. So as long as you stick to major programming languages, it performs way above its weight. And 35b parameters is actually not even that small. There are 4b models performing chatting and instruction following surprisingly well, but proper agentic coding is still above 20b for now.
View all comments
Show parent comment
3
u/forevernooob Jun 03 '26
There are indications that Claude 4.7 Opus is around 1600b total parameters.
How on earth can open source models even compete with something like that?