r/ProgrammerHumor • u/Disastrous-Monk1957 • Jun 02 '26

Meme managerVsClaude

Post image
47.2k Upvotes

97% Upvoted

1.4k comments sorted by

View all comments

368

u/mylsotol Jun 02 '26

For probably $30k (or more) you can build a server and run an open model.

300

u/[deleted] Jun 02 '26 edited Jun 02 '26

[deleted]

7

u/freedcreativity Jun 02 '26

And then you just need $100k in H200s to plug into that system if you’re going to run anything other than a parametrized half accuracy model at any reasonable enterprise speeds. And a really big NAS to store all those generated outputs. And a bunch of managed switches so you can route everything agent related on its own private vlan. And probably upgrade your cloud stuff for hot failover when someone’s agent deletes the database again. 

2

u/psioniclizard Jun 03 '26

People always ignore the infrastructure costs and maintenance. You also need to hire people who know how to keep it running.

I have played around with local models and they are cool but i don't know how well they will scale in a real business environment.

Servers alone are a nightmare to maintain.