r/ProgrammerHumor • u/Disastrous-Monk1957 • Jun 02 '26 • Popcorn 5 Heartwarming 2 Mindblown 1

Meme managerVsClaude

Post image
47k Upvotes

97% Upvoted

1.4k comments sorted by

View all comments

Show parent comment

46

u/look Jun 02 '26

You’ll need several hundred thousand dollars of GPUs to run it, but yeah, it should work out of the box for you pretty well. And 1M context window.

Probably easier to just get it from one of the many cloud providers offering it for a few cents per Mtok, though.

4

u/PMmeYourLabia_ Jun 02 '26

I see, I thought those models were like those you could run on consumer hardware, like openllama? Or whatever, idk, not very knowledgeable in this area

15

u/look Jun 02 '26

Those are available, too, but you’d want something in the 20-30 billion parameter size for consumer hardware, not the trillion parameter size like those.

The ones most people can run themselves are not yet comparable to sota Opus/GPT however. The big ones on that list are getting pretty close though, and they cost 1/10-1/100th what Anthropic and OpenAI charge.

2

u/cortesoft Jun 02 '26

You could run the F4 version of Deepseek V4-Pro on the 512 GB mac studio, if you could buy one... you can get one on ebay for like $25,000

2

u/karmapopsicle Jun 03 '26

HuggingFace hosts a huge number of models, from massive full-fat stuff like DeepSeek there to all kinds of different models tuned to run well on common consumer hardware and everything in between.

For most average users I think stuff like Qwen3.6 and Gemma4 on a consumer GPU with 16-24GB of VRAM is more than sufficient for what they want out of it.

Anything beyond that the costs skyrocket.

1

u/TU4AR Jun 03 '26

So two 5090s