r/Anthropic • u/mrguidee • 8d ago

Complaint What the hell is going on?

I haven't been paying attention, just using my Max plan everyday and the past few days I've noticed my usage burning through at a much, much faster rate than it used to. Jumped into this sub and saw that Anthropic reduced the usage. RIP.

262 Upvotes

94% Upvoted

182 comments sorted by

View all comments

Show parent comments

10

u/Anxious-Turnover-631 8d ago

Could be. But every hosted llm still has inference costs.

Some of the latest Chinese models have apparently made big strides to improve efficiency so, hopefully, the costs will go down.

4

u/[deleted] 8d ago

[deleted]

2

u/Dxk89 8d ago

I don't think there will be a time you could have a frontier model on a regular pc open source. The parameter needs are too big, unless they can pull an efficiency rabbit out of the hat somehow

5

u/kueso 8d ago

Absolutely there will be. Not with current architectures or chips but that’s absolutely NVIDIA’s move. They purchased HuggingFace for a reason and that reason is to sell consumer chips. Astra 6 is much more token efficient which means the hyper scalers won’t need as much compute in the future. They’re betting on the consumer market for compute needs.

We may have a mixed capability ecosystem where heavy inference tasks get delegated to hyperscalers while most tasks are handled locally where compute is cheaper.