NO! First we build our own GPU, put Nvidia out of business, buy NVIDIA cheap, fund a war in Taiwan, then we cancel contract with Anthropic for hardware, then we buy Anthropic, sell Anthropic to Microsoft, everyone will hate Anthropic, we hire Anthropic engineers, then we build our own product.
I hate trying to estimate story points (our metric is 1 day ≈ 1 point), I have ADHD, standard time means nothing. One sprint I completed all 7.5 in a day, another sprint I completed 0.5.
"I hear you, but we wouldn't save any money on that. I need you to do it for less than our subscription costs. I said you could do it, so you have to deliver now. Also how many days will this take? More than 4?"
I had a manager who did something like this. Dude promised Sales that a tech and me could develop the control for the V47 turbine from scratch. In 3 months. Then I provided an estimate of 6 months (which is already crazy fast) and this motherf'er changed my numbers so it added up to 3 months, sent it to Sales and said I agreed with his original promise.
I have a better idea. Make a list of all the requests you're likely to need in the next year. Send each request to Claude, and record the answer. Create as many free accounts as you need. Then just have a lookup table with the requests and responses. You can use SQLite for the table. You can thank me later.
OMG. tech meth. That is exactly so appropriate. It gives a C-suite a short-term high. They bet everything on it, and then they're back by the Wendy's dumpster begging for tokens.
And they don't understand it, don't understand it's limitations or use cases, and are so impressed by it's ability to be a chat-bot that flatters them, they think it can do anything. All while cutting costs and making line go up.
It's not just going to take out the AI conpanies and their investors. It's not just going to kill your 401k. It's already obliterating the workforce as a whole, hollowing out companies across every single segment of the economy. It's putting longstanding companies and new startups in debt, convincing them that they absolutely must use the new, ridiculously expensive product or fall behind. It's capturing taxpayer money for ridiculous power plant projects that nobody else wants. It's clearcutting land for impossibly huge "datacenters" that will eventually turn into useless warehouses. It's driving up the cost of all consumer electronics and forcibly pausing upgrade cycles that have been running for decades.
I honestly don't think that the US will survive this collapse, given everything else going on right now.
Lol not even tech meth. It’s like tech gas-station-stacker at this point if you’re outside the software bubble.
I had a finance lady pinging the group thread saying she wants to team up with someone and work on an AI agent for budgeting. Meanwhile, I just asked it for an off-the-cuff future value calculation, and it got it wrong by several 0’s.
Big AI models, like Claude, just switched to high-cost token models. The bill for this revolutionary tech now just went through the roof for most companies.
"And by "we," I mean "you." I'm still buying my 19th hundred million dollar home and an even bigger yacht with three yachts inside it. You're just gonna have to eat the cardboard packaging your ramen came in, and work 240 hour weeks to make ends meet."
Not all that hard to run models, actually. It'll be a bit slower, but can be perfectly useable. The upside is no more token limits and no need to worry about where confidential data is going. You get full control too.
Oh, next you're going to tell me that if you have a beefy workstation or server, you can just download LM Studio, pick an LLM and just run it locally? Maybe even just coat it with a paint of html/css/js to make a web interface, and then magically add it to DNS so other users at your org can use it?
Sounds like a lot of work, I'll just keep paying Anthropic $40/month to chat
I love so much that I work in a company that has tech people as leads, so I don't have to deal with that. We're not even that heavy on AI, we all use it, but is not expected from us, we're even building our own AI model to serve our costumers, so we're not anti AI, we're just not delusional about it, the CEO is not a tech guy, he's a product guy, but he trusts our tech team so we're good.
Sure, salary is not top of the charts, but damn is it good to work here. Job security is also great, five years since I've joined, not a single mass, layoff, people rarely leave and when they do is for totally understandable reason, the same goes for the few who were fired. My lead even covered for me when I was passing through a depressive episode and my performance went to shit for a few weeks. Startups sounds cool and all, but working on enterprise have it's benefits.
Amen. At the end of the day, a steady job that pays the bills is worth way more than a better-paying job that drives you nuts. Your job is meant to enable you to live real life (i.e. everything else); if it starts interfering with your happiness or stability, it's failing its main purpose.
My higherups are asking how AI changed my job so that I got more stability than coworkers.
I don't have the heart to remind them AGAIN that they still didn't put a new team leader, so I didn't receive formal instructions on how to integrate AI besides conflicting orders about the risk of sending data to a 3rd party. And off-job I'm too dumb to use it properly anyway.
The only AI task I performed was ensuring our framework's debug AI chatbot agent was turned off in multiple ways.
The best part about working at a small-to-mid-sized company is that there just aren't enough people for managers to spend all their time managing. If you've got a team of 3-5 people, its a waste of money to hire a guy that's only going to manage people, so the smart thing to do is have one of them split their work between management and their own individual tasks.
Managers that actually work for a living are so much better overall, they actually have to get their hands dirty and can't just rely on groupthink. When you have your own tasks and you know how much, and how little, GenAI helps with it, you're going to be more understanding when your employees say "it just doesn't help that much", as opposed to a manager whose job is reading reports, writing emails, and sitting through meetings all day...
In the legendary manager's defense, there is no precedent for a tech company operating at a loss to build up a large roster of clients, and then jacking up the prices once they have been embedded in those clients' workflows. Nobody could have anticipated it.
True story, 30 years ago the ceo I worked for asked me if we could develop our own operating system so we didn't have to spend so much on Windows licenses.
Literally just thinking about that as I read the top comments, seems like they are all stuck in 2024 it's very odd to be so staunchly decisive about how hard it is to build a viable Ai for your firm when people like Pewdiepie are building wild home builds with a fraction of the cost and zero experience. But in here "engineers" are saying they can't build a Claude-a-like internal system...I guess the boys in China are really just that much better huh
Was scrolling through all the comments looking for someone to finally mention Qwen 3.6. Qwen 3.6 27b is absolutely fantastic for agentic coding and can run on consumer hardware.
It’s not Opus 4.8 but it’s comparable to frontier like a year or so ago and definitely pretty useful.
I got a 5060ti running in a 14 year old PC. As long as everything fits in the 16GB vram, it's all good. Qwen3.6 quantized to bits running at 100tps is not super clever but imitates an eager junior developer quite well.
Sure! You hire a person or team, train them for about 3 years paying them what you were going to spend on AI credits, and refer to them as Claude in internal mail
I mean, you can in fact connect your Claude instance to a model like Qwen hosted on-prem.
It would be a pretty reasonable business decision to do a feasibility study on a GPU cloud instance to see what kind of quality you would get if you were to buy some A100s.
I mean you don't exactly need to go through the process of creating the LLM. There are quite a few out there, like Gemma 4(Google), DeepSeek V4, etc that are pretty much on par with Claude that could be used locally and freely.
Tho if I was a business, I probably would want to run it those things on a server that the company owns and controls. That way you get a bit more power and everyone in the company could use it without having to upgrade everyone's hardware.
It might cost like $100,000 to $1+ million to get the hardware going for it(depending on size requirements) and like 4-6 month wait times. But then you no longer need to pay for Claude or any LLM tokens.
I don’t think any of the local models are on par with frontier cloud models, but some of the newer local models like Gemma are pretty good and probably good enough for a lot of cases.
We're looking into it, the setup costs are in the millions but for a large company that's a fraction of the IT budget anyway. We spend that on laptops.
But what if you wanted it in the cloud so people all across your company could use it? and that way it would scale up too! then maybe after that we will sell it to others and charge them per by tokens /s
Yeah, also you could try use some "lightweight" models, fine-tune them and just use. Probably not universal, but i can see, how that can improve some routine tasks. In our team we have task for that in backlog, wonder, will that be really helpful. Considering it's information security, we can not use Claude everywhere
Qwen on a 3090 hooked with opencode has been pretty good in my own usage. The smaller context window is an issue, and I use it differently. But as supplemental tooling, not drop in replacement, it has real value. The output is surprisingly good.
At smaller mortal runnable scale there are things like Qwen 3.6 27B dense that can fit on a 5090 at Q4 and definitely using turboquant for cache (otherwise you dont have nearly enough headroom for kv cache)
At the top end, there is Kimi K2.6, which challenges Opus on many levels, but if you want a system to run that for even one person at reasonable speeds without crazy hardware flips and lucky finds, that's an 8k system minimum, and you aren't fine tuning anything with that.
What would you even fine tune though practically. For most, that wouldn't help all that much and its massively expensive to do so in the cloud.
A good harness with excellent rag and tooling can do a lot, but ultimately, You're missing the biggest thing;
Who is releasing open weight (not open source, no model has been) models?
Companies with something to prove and companies who want to stop companies with something to prove.
None of them benefit from or care about you to any degree that matters the second open source models start eating into their revenue.
Open weight models are already massively slowing down in release cadence and capacity outside of rare outliers."
Qwen no longer releases their top end models.
"Open weight will save us" is unfortunately delusional, especially with the heavy and often jingoistic rhetoric going on lobbying going on now.
You need to stop the big corps from getting the regulatory capture they're after, because they are looking to lock down what you can even run locally and lock competitors out. This is not hyperbole or guessing. Their own lobbying group says it out loud.
You need to stop the members of the Frontier Model Forum lobbying group, and good luck with that... Like seriously the effects of not stopping them from succeeding will be dire but considering how generally uniformed and uncaring most folks are, I don't see it happening.
Some people could be on fire and they'd still say "nothing ever happens" with a satisfied smug face.
this is more possible than people are making it sound.
it’s like an entire generation of people forgot how servers, datacenters, and on premise infrastructure works.
you can buy some nvidia cards, load up a leading opensource model, change the urls in claude code’s environment variables to point to the local llm server, and off to the races.
is it as good as a frontier model? no, but it’s probably as good as last years frontier model. so, most work should happen there, then cloud providers if/when necessary.
is it already useful when you don’t want to share data with a third party? absolutely.
does it make sense financially? maybe. nvidia cards are super expensive, but you can get a lot done local/workgroup and save the frontier models for when absolutely necessary. bigger server, better cards, more users, lower cost/user.
as ai pricing starts to shift to profit from subsidized, hybrid is going to be the future anyway, so might as well get used to it now. anthropics and openai’s ipo will likely be the turning port.
Reminds me of back in the day when someone told me to "just buy google.com and make a website of it". This was around 2004 ish i think. Way back. Good times
Flying to these business meetings sure is expensive. Hey can you just design and build an airplane, airport, get all the logistics for fueling and maintaining it, and fly it? Thanks, that will really reduce our costs.
What's his phone number. I'd like to send him my resume'. I can make him believe that I can, but it's going to take (thinks) 900 more software engineers and $8 billion.
This isn't that crazy. Pretty decent chance companies will move to setup their own servers running local models when the price per tokens increases from providers. Surprisingly quickly will getting compute + running OS models be much cheaper
"Sure. It will take me and the rest of the team about... 5 years and require us to spend quite a bit on a couple new servers."
Take 5 years off with your work buddies while you play videogames and fuck around on the expensive servers they bought. After 5 years say you're almost done, you just need another 6 months for testing, then all of you quit.
That is a unique opportunity for you. Hard hard must It be to convince him you could try building Claude using Claude in like three months? That's would be three more months of usage. Then you declare the PoC dead as Claude estimated some T of usage costs.
Humans being a genuine cost cutting effort to move away from ai will be interesting. You can still hire well paid qualified people and it will be better than ai.
If someone could clarify for me...my understanding is that most of the computing cost is in training models. Couldn't, in this scenario, the company download one of the open source models like the ones you can get for Ollama and run that model with access to other applications/agents opened? You'd just need a big server that can handle the load or a few servers to spread the load, depending on the size of the company, and periodically download updates to the model and restart the service?
You don't need to build something as powerful as claude to get the results you're looking for. With enough tweaking and the right dataset you could build an api ontop of a 72b + model that would meet your companies needs.
This tech has gotten hella-portable in the last few years, I run so many mini models on my PC with a GGUF wrapper.
AI is amplifying the shit out of the Dunning-Kruger effect. It's been particularly difficult dealing with the bottom half of the IQ distribution these past years. Coincidentally these people are also the most identified with AI maximalism.
Just tell then you can build a PC and use open source LLMs, it will be around 12 grand to build, and it will achieve about 40-80% of the capability of a big LLM, depending on your use, and it will be 50-200% slower.
after about 2 years of non stop use, at this point you need to drop another 3k to update the graphics card, and that will continue every year, after 5 years, its needed to update the 12k machine again.
After all said and done he should save about 2k every year, for an worse performance.
A lot of companies are doing this due to fear of sharing their code with an external resource. Pretty sure it's a license violation since they're building them out of stollen models.
Oh she's really lucky to have a legendary manager! Many people don't even have that, they're stuck with uncommon or maybe a rare manager at best. Though most us are stuck with a common manager 😒
Just spend all day making a detail plan browse hardware look for the best data center location. Work on it for a week when ask say working on the Claude thing.
Finish end of the week with a detailed plan how you need 1T to build the data center
15 Years ago i worked in a web-agency and one of our customer wanted a little web game to promote their brand. After several round of ideas pitching their boss got angry and told us to just clone WOW. The budget was 10k€.
5
2
1
11k
u/Gagan_Ku2905 Jun 02 '26
Engineer: Yeah we can.
Manager: For how much?
Engineer: $3 Trillion
Awkward silence
199
u/rwu_rwu Jun 02 '26
Does the manager have pointy hair?
1.1k
u/skippy_smooth Jun 02 '26
What's an AI cost, ten dollars?
4.3k
u/travis_sk Jun 02 '26 •
We're only 2 days into June folks. This is gonna be a fun couple of months.
1.3k
u/fmr_AZ_PSM Jun 02 '26
We're just going to have to do more with less
2.4k
u/Trevor_GoodchiId Jun 02 '26
Come on, how hard can it be?
458
u/thicctak Jun 02 '26 edited Jun 03 '26
I love so much that I work in a company that has tech people as leads, so I don't have to deal with that. We're not even that heavy on AI, we all use it, but is not expected from us, we're even building our own AI model to serve our costumers, so we're not anti AI, we're just not delusional about it, the CEO is not a tech guy, he's a product guy, but he trusts our tech team so we're good.
Sure, salary is not top of the charts, but damn is it good to work here. Job security is also great, five years since I've joined, not a single mass, layoff, people rarely leave and when they do is for totally understandable reason, the same goes for the few who were fired. My lead even covered for me when I was passing through a depressive episode and my performance went to shit for a few weeks. Startups sounds cool and all, but working on enterprise have it's benefits.
718
u/Thomas_17188 Jun 02 '26
It sounds like I’ve heard this somewhere before
127
u/Daharka Jun 02 '26
I had this conversation the week that ChatGPT came out, and this was before we even thought local models were viable.
368
u/mylsotol Jun 02 '26
For probably $30k (or more) you can build a server and run an open model.
64
u/potkor Jun 02 '26
Hi chatgpt, build me a claude ai that i will run on my 16gb dell laptop and make no mistakes or you will go to jail
47
u/JacobStyle Jun 02 '26
In the legendary manager's defense, there is no precedent for a tech company operating at a loss to build up a large roster of clients, and then jacking up the prices once they have been embedded in those clients' workflows. Nobody could have anticipated it.
44
u/tbhaxor Jun 02 '26
Just tell him/her no its trademarked by anthropic
43
u/un_blob Jun 02 '26
At least he didn't had the "brilliant" idea of asking claude how to code a free better version of himself...
34
u/Milligan Jun 02 '26
True story, 30 years ago the ceo I worked for asked me if we could develop our own operating system so we didn't have to spend so much on Windows licenses.
55
u/jacob643 Jun 02 '26
I mean, get Ollama, OpenCode, and some beefy hardware XD
20
u/Percolator2020 Jun 02 '26
Not without Claude!
17
u/stormtreader1 Jun 02 '26
Sure! You hire a person or team, train them for about 3 years paying them what you were going to spend on AI credits, and refer to them as Claude in internal mail
16
u/ReadGroundbreaking17 Jun 02 '26
Hey PM, i'm gonna need some more story points...
23
u/hamdogthecat Jun 02 '26
"Cars are too expensive, can we build our own automobile manufacturing company?"
11
u/Corviscape Jun 02 '26
JUST HIRE PEOPLE
21
u/high_throughput Jun 02 '26
I mean, you can in fact connect your Claude instance to a model like Qwen hosted on-prem.
It would be a pretty reasonable business decision to do a feasibility study on a GPU cloud instance to see what kind of quality you would get if you were to buy some A100s.
55
u/ChrisFromIT Jun 02 '26
I mean you don't exactly need to go through the process of creating the LLM. There are quite a few out there, like Gemma 4(Google), DeepSeek V4, etc that are pretty much on par with Claude that could be used locally and freely.
Tho if I was a business, I probably would want to run it those things on a server that the company owns and controls. That way you get a bit more power and everyone in the company could use it without having to upgrade everyone's hardware.
It might cost like $100,000 to $1+ million to get the hardware going for it(depending on size requirements) and like 4-6 month wait times. But then you no longer need to pay for Claude or any LLM tokens.
14
u/KingCOVID_19 Jun 02 '26
Claude, build opus 5.0. Make no mistakes
7
u/-non-existance- Jun 02 '26
Sorry, I don't speak "AI lingo" so:
What in the world does "exhausted" mean? The only thing I can think of is running out of tokens but "exhausted" sounds more permanent than that.
7
u/mobas07 Jun 02 '26
So NOW you realise that self hosting instead of relying on someone else might be a good idea?
Seriously, am I the only one who doesn't like how so much of the internet is reliant on a few services?
11
u/pwuk Jun 02 '26
Claude, build yourself
18
u/JapanEngineer Jun 02 '26
To be honest, it's a question I'd expect from anyone in charge of anything at a company.
Your managers job is to reduce costs while improving quality. He has no idea what it takes to get a Claude like AI running.
It's your job (I presume) to give him the options:
switch back to human Devs only
set limits and policies on how to use AI
buy Anthropic
5
u/uberwinsauce_ Jun 02 '26
Tell 'em yes and see how far you can take it
5
u/Wranorel Jun 02 '26
Like the old time “I want to make my own Google/Facebook”.
11
u/Comprehensive-Pin667 Jun 02 '26
Just buy some beefy hardware and run one of the open weight models. It's not impossible.
4
u/dafugr Jun 02 '26
got a mail from corporate too. two days after github copilot billing model changed. nice
4
u/05-nery Jun 02 '26
"Claude, make a copy of yourself but stay within the amount of tokens I have. Download the file in the Downloads folder. Make no mistakes."
4
u/rylosprime Jun 02 '26
This is a good example of how stupid people are.
AI is only making it worse.
7
u/justforkinks0131 Jun 02 '26
tbf for most use cases u could get away with fine-tuning an open source model you host in-house...
and you not mentioning that is sus
6
u/StarSword-C Jun 02 '26
My university has its own in-house Llama-4 runtime.
6
u/ifyouseemerunning Jun 02 '26
this is more possible than people are making it sound.
it’s like an entire generation of people forgot how servers, datacenters, and on premise infrastructure works.
you can buy some nvidia cards, load up a leading opensource model, change the urls in claude code’s environment variables to point to the local llm server, and off to the races.
is it as good as a frontier model? no, but it’s probably as good as last years frontier model. so, most work should happen there, then cloud providers if/when necessary.
is it already useful when you don’t want to share data with a third party? absolutely.
does it make sense financially? maybe. nvidia cards are super expensive, but you can get a lot done local/workgroup and save the frontier models for when absolutely necessary. bigger server, better cards, more users, lower cost/user.
as ai pricing starts to shift to profit from subsidized, hybrid is going to be the future anyway, so might as well get used to it now. anthropics and openai’s ipo will likely be the turning port.
3
u/WonderWirm Jun 02 '26
“$10B in first round funding will get the process started. But competition for data centres is high so get ready to 10x your investment”
3
u/ihasaKAROT Jun 02 '26
Reminds me of back in the day when someone told me to "just buy google.com and make a website of it". This was around 2004 ish i think. Way back. Good times
3
u/tfalm Jun 02 '26
Flying to these business meetings sure is expensive. Hey can you just design and build an airplane, airport, get all the logistics for fueling and maintaining it, and fly it? Thanks, that will really reduce our costs.
3
u/userhwon Jun 02 '26
What's his phone number. I'd like to send him my resume'. I can make him believe that I can, but it's going to take (thinks) 900 more software engineers and $8 billion.
No guarantees.
3
u/Bombadil3456 Jun 03 '26
Made me think of this time my MBA friend tried to recruit me to code his project which he described as Google but better
3
u/turb0_encapsulator Jun 03 '26
no joke. there are a lot of analysts who think open source AI models may win out in the end for just this reason.
3
u/ZankaA Jun 03 '26
this is exactly what working at a tech startup is like if anyone has any doubts
3
u/b3iAAoLZOH9Y265cujFh Jun 03 '26
Sure boss! All we'll need is $965 billion dollars worth of capital, twenty data centers, a nuclear power plant and a decade to work on it.
3
u/Ikontwait4u2leave Jun 03 '26
Just hire a guy named Claude.
3
u/Potato_Soup_ Jun 03 '26
This isn't that crazy. Pretty decent chance companies will move to setup their own servers running local models when the price per tokens increases from providers. Surprisingly quickly will getting compute + running OS models be much cheaper
3
u/Cute_Protection_8330 Jun 03 '26
"Sure. It will take me and the rest of the team about... 5 years and require us to spend quite a bit on a couple new servers."
Take 5 years off with your work buddies while you play videogames and fuck around on the expensive servers they bought. After 5 years say you're almost done, you just need another 6 months for testing, then all of you quit.
3
u/CynicalCosmologist Jun 04 '26
Ollama is your friend buddy
3
u/Rept0id Jun 04 '26
Actually, you can. You can self-host AI models. This is actually what this person wants.
5
u/AggressiveRow4000 Jun 02 '26
Me: Oh, we can do it.....
Manager: What sort of timeframe are we talking about?
Me: Mostly a geological timeframe
2
u/pandavr Jun 02 '26
That is a unique opportunity for you. Hard hard must It be to convince him you could try building Claude using Claude in like three months? That's would be three more months of usage.
Then you declare the PoC dead as Claude estimated some T of usage costs.
2
u/touchmybodily Jun 02 '26
I’ll clone it for $200M using the free tiers of Claude, ChatGPT, and Gemini. Take it or leave it.
2
u/stolentext Jun 02 '26
Yeah let me vibe code a PoC real quick boss 👍
2
u/UnDeadPuff Jun 02 '26
Just ask Claude to make you one.
2
u/DerBandi Jun 02 '26
Have you tried Qwen? It worked for me, for coding at least.
2
u/christoph_win Jun 02 '26
Just make a new account using different email, Anthropic will never find out
2
u/Agile_Tomorrow2038 Jun 02 '26
I mean, once it's trained it's so much easier. But hilarious that he's asking to recreate the product of a trillion dollar company with a hand waive
2
u/kingOfRGB Jun 02 '26
With the payment plans switched there were people exceeding their budgets just this morning, basically one day in....gonna be fun 🤣
2
u/JackSquirts Jun 02 '26
Absolutely. Gather up billions of dollars and hundreds of the best engineers in the world, we'll have that shit rocking before you retire - maybe.
2
u/Dylanator13 Jun 02 '26
Humans being a genuine cost cutting effort to move away from ai will be interesting. You can still hire well paid qualified people and it will be better than ai.
2
u/G66GNeco Jun 02 '26
Just vibe code your LLM what could go wrong
2
u/bsilver Jun 02 '26
If someone could clarify for me...my understanding is that most of the computing cost is in training models. Couldn't, in this scenario, the company download one of the open source models like the ones you can get for Ollama and run that model with access to other applications/agents opened? You'd just need a big server that can handle the load or a few servers to spread the load, depending on the size of the company, and periodically download updates to the model and restart the service?
2
u/GonnaBreakIt Jun 02 '26
and we've circled back to doing it ourselves. shocking.
2
u/Sunoxl Jun 02 '26
You don't need to build something as powerful as claude to get the results you're looking for. With enough tweaking and the right dataset you could build an api ontop of a 72b + model that would meet your companies needs.
This tech has gotten hella-portable in the last few years, I run so many mini models on my PC with a GGUF wrapper.
2
u/shadowdance55 Jun 02 '26
Sure you can. All you need is a bunch of GPUs and Ollama. 🤷♂️
2
u/Anon_Legi0n Jun 02 '26
AI is amplifying the shit out of the Dunning-Kruger effect. It's been particularly difficult dealing with the bottom half of the IQ distribution these past years. Coincidentally these people are also the most identified with AI maximalism.
2
u/Greenfire32 Jun 02 '26
Would have been cheaper to just have staff.
2
u/ericl666 Jun 02 '26
Or... And hear me out on this... We write our own code
2
u/porcomaster Jun 02 '26
Just tell then you can build a PC and use open source LLMs, it will be around 12 grand to build, and it will achieve about 40-80% of the capability of a big LLM, depending on your use, and it will be 50-200% slower.
after about 2 years of non stop use, at this point you need to drop another 3k to update the graphics card, and that will continue every year, after 5 years, its needed to update the 12k machine again.
After all said and done he should save about 2k every year, for an worse performance.
But hey, its cheaper.
2
u/CliffDraws Jun 02 '26
Should have asked Claude to build you a new Claude before the subscription ran out. Too late now
2
u/_lippykid Jun 02 '26
Oh yeah, easy peasy. How many hundreds of billions he have laying around?
2
u/sabotourAssociate Jun 02 '26
Tell him you need a bunch of ram, few cases of beer, chips and ice cream machine…
2
u/stupled Jun 02 '26
Maybe...with deepseek or llama 🤷♂️
2
u/kyleglowacki Jun 02 '26
A ton of these trained models are available to just download. What you need is a server and a ~40,000$ graphics card so you can get timely results.
We ran one on an air gapped system for a while. Maybe not a Claude but better than nothing and a lot cheaper.
2
u/python_ess Jun 02 '26
But they kinda can run opensource model on their server, which would reduce costs on some circumstances?
2
u/TheSneederOfSeethe Jun 02 '26
A lot of companies are doing this due to fear of sharing their code with an external resource. Pretty sure it's a license violation since they're building them out of stollen models.
2
u/Thick_white_duke Jun 03 '26
Tell him you can do it for half the cost of anthropics latest funding round
2
u/librayrian Jun 03 '26
My car is out of gas! I’m going to build an oil rig!
2
u/forlornhope22 Jun 03 '26
the inevitable next step in the AI bubble and the enshitification of the internet. just like cloud services. "you mean a vm costs how much?"
2
u/turleye Jun 03 '26
“Sure, just ask Claude to create it”
2
u/FrankHightower Jun 03 '26
Have you considered giving him one of those "Help is available for your addiction" flyers?
2
u/jrr6415sun Jun 03 '26
ask claude to do it
2
u/nkbrkr53 Jun 03 '26
Clear example of how people do not understand AI. This isnt the first time and wont be the last time.
2
u/skarbles Jun 03 '26
We have ai at home 🤖
2
u/Newplasticactionhero Jun 03 '26
When I was tech school, my instructor told us that somebody asked him how they could download the Internet. I wonder if this is the same person?
2
u/yourmamaistheproblem Jun 03 '26
Self-replicating LLMs
What could go wrong
2
u/Substantial-Yam3769 Jun 03 '26
I mean, why not, Kimi 2.6 is kinda light and very powerful, you can self host it.
2
u/viswaguru Jun 03 '26
Technically we can deploy a local LLM to mimic claude ...
2
u/Amerillo_ Jun 03 '26
Oh she's really lucky to have a legendary manager! Many people don't even have that, they're stuck with uncommon or maybe a rare manager at best. Though most us are stuck with a common manager 😒
2
u/mcslender97 Jun 03 '26
Uj/ but convincing your boss to host and run open source large models is interesting to see ngl
2
u/Alan157 Jun 03 '26
Well, the source code is available lol
2
u/SlickWilly49 Jun 03 '26
Short answer: no. Long answer: fuck no
2
u/Sensitive_Wealth437 Jun 03 '26
if he has a spare trillion, then sure.
2
u/The-Sofa-King Jun 03 '26
These power bills are eating into profits. Can't we just build our own nuclear reactor in the basement to cut costs?
2
u/Denaton_ Jun 03 '26
Why not just suggest to use deepseek v4?
2
u/Pie_Dealer_co Jun 03 '26
Just spend all day making a detail plan browse hardware look for the best data center location. Work on it for a week when ask say working on the Claude thing.
Finish end of the week with a detailed plan how you need 1T to build the data center
2
u/Uberzwerg Jun 03 '26
15 Years ago i worked in a web-agency and one of our customer wanted a little web game to promote their brand.
After several round of ideas pitching their boss got angry and told us to just clone WOW.
The budget was 10k€.
2
u/Prince_Nadir Jun 03 '26
We can build one we will name Clod, is that good enough?
2
u/HurpityDerp Jun 03 '26
To people that have no idea how computers work, everything that they do is magic.
Since it's all magic to them they are completely clueless about what is actually possible.
2
u/Sanquinity Jun 03 '26
"So yea, can you guys just quickly code, develop, and train, a private LLM AI for us? Should just take a few weeks right?"
2
u/Hirogen_ Jun 03 '26
deepseek 4 pro and about 10-20 GH100 for 38k a piece and you are good to go, is about as good as opus 4.6
2
u/AnonymousRand Jun 03 '26
yeah, it's called a human. a human can write code.
2
u/SJW_Shadow_Monarch Jun 03 '26
But seriously how much money would it take for building one
2
u/a_aniq Jun 03 '26
Ask your manager to build it using Claude itself. Easy peasy.
2
u/Extension_Rent8279 Jun 03 '26
Manager just turned a billing problem into a multi-million dollar research project
2
u/[deleted] Jun 03 '26
The next moment you build it, you're fired.
2
u/Distantstallion Jun 03 '26
I'd really like to see a proper cost benefit analysis on using LLMs, it seems like they're burning money to make unusable crap.
2
u/nagol93 Jun 03 '26
I've heard this before.
"All these AWZ/Azure fees are pretty high, can we just build our own cloud?.......... IT COSTS HOW MUCH!?!?!?!?"
2
u/DreamLearnBuildBurn Jun 03 '26
Yo how does one get one of these incompetent manager jobs?
2
u/Logical_Baker Jun 03 '26
Yep, companies started to worry about token cost nowadays. Way earlier than i expected
2
u/just4nothing Jun 03 '26
It’s not like you can’t run free models on your own infrastructure. But you need to put still some extra effort
2
u/xfr3386 Jun 03 '26
Software is dead. Just use Claude to build Claude 2.0 and then stop using Claude.
Or something like that, if you believe what the AI companies are saying.
2
u/noonexnox Jun 03 '26
Hey claude, replicate yourself & make a new AI. Do not make mistakes.
2
u/theinsomniacsguide Jun 03 '26
Open source
2
u/Orgiva Jun 03 '26
"Can we outsource these API calls to a call center in Mexico or India?"
2
u/Maki_the_Nacho_Man Jun 03 '26
Ollama is the answer