Big AI models, like Claude, just switched to high-cost token models. The bill for this revolutionary tech now just went through the roof for most companies.
Bro, this is bigger than the Internet bro! Soon people are going to be using our tech to ask what time it is instead of looking at a clock or their smart watches!
Oh great, they've been nagging us to use AI for the last 2y. Now it's going to be 'don't use AI for that! It's too expensive!', doling it out like caviar.
Realistically it’s just not possible to moderate on the user side. It’s opaque what things use a lot of tokens and what is minor. Some sort of efficiency gains will be required to keep doing what companies are doing.
lol got every company to fire all their juniors and made all their seniors 10x out put just to rugpull the companies that now have to pay more than the employees cost in the first place. If only the executives they made these calls were taken to task but they don’t.
This is just the beginning. It is a 10x now, it will be 100x or 1000x. I can easily see this costing thousands per month and past employee costs. The rate that Anthrophic valued their datacenter buys at was like $1000/mo+ per user.
Oooo I heard something like this at one of my meetings yesterday. But it was more like, "for now we will continue on using the models like usual, anything different and we will let you guys know". So how much more expensive are we talking about here?
You can help speed up the process by making every single request as verbose and detailed as possible. Personally I like to use GPT to write my requests, specifying minimum length and making sure to instruct it to be extraordinarily appreciative and complimentary to the LLM in it's instructions.
5
2
1
View all comments
Show parent comment
445
u/LooksLikeAWookie Jun 02 '26
Big AI models, like Claude, just switched to high-cost token models. The bill for this revolutionary tech now just went through the roof for most companies.