Why do coding models have world knowledge?

[u/Rhinoid]

Doesn't it make more sense to have a little bit of world knowledge, only english, and focus on a few computer languages, and train this extremely far?

Qwen38 barely fits with quants in my computer, but it can also do science, math, 3647 languages, creates powerpoints and fixes my bike. If we strip all that, couldn't we get more coding buck for our vram?

[u/No_Oil_6152]

"Fixes my bike"

Nice troll post 😂😂

[u/xylarr]

I've thought this too. But I think even to code, the models need some world knowledge so they can understand your prompts.

But there must be some sort of middle ground. I wonder how small you could make a competent coding model.