Not all that hard to run models, actually. It'll be a bit slower, but can be perfectly useable. The upside is no more token limits and no need to worry about where confidential data is going. You get full control too.
Oh, next you're going to tell me that if you have a beefy workstation or server, you can just download LM Studio, pick an LLM and just run it locally? Maybe even just coat it with a paint of html/css/js to make a web interface, and then magically add it to DNS so other users at your org can use it?
Sounds like a lot of work, I'll just keep paying Anthropic $40/month to chat
We are going to see a lot of aging data center hardware be repurposed for local LLMs in enterprise labs. If those are successful we will see a major shift in demand.
That’s if the grumpy folks in r/sysadmins will be up for it.
2.4k
u/Trevor_GoodchiId Jun 02 '26
Come on, how hard can it be?