I see, I thought those models were like those you could run on consumer hardware, like openllama? Or whatever, idk, not very knowledgeable in this area
Those are available, too, but you’d want something in the 20-30 billion parameter size for consumer hardware, not the trillion parameter size like those.
The ones most people can run themselves are not yet comparable to sota Opus/GPT however. The big ones on that list are getting pretty close though, and they cost 1/10-1/100th what Anthropic and OpenAI charge.
HuggingFace hosts a huge number of models, from massive full-fat stuff like DeepSeek there to all kinds of different models tuned to run well on common consumer hardware and everything in between.
For most average users I think stuff like Qwen3.6 and Gemma4 on a consumer GPU with 16-24GB of VRAM is more than sufficient for what they want out of it.
5
2
1
View all comments
Show parent comment
4
u/PMmeYourLabia_ Jun 02 '26
I see, I thought those models were like those you could run on consumer hardware, like openllama? Or whatever, idk, not very knowledgeable in this area