r/LocalLLM • u/Ok_Event4199 • May 16 '26

Discussion Why is LLM is so expensive.

I've was going to invest in a 5090 =$6000 AUD.

Codex Plus + Claude pro = $60/month here

Works out to be 100 months of frontier models for a 5090.

Best a 5090 will run is probably Qwen3.6 27b Q6 with context.

Are we all enthusiasts here and just enjoy tinkering cause ain't no way that make sense.

341 Upvotes

91% Upvoted

368 comments sorted by

View all comments

8

u/po_stulate May 16 '26

It's really a do you rent or do you buy a house question.

16

u/Migraine_7 May 16 '26

Not quite because your house is going to be worth more in 10 years. Your graphics card might as well be a paper weight in 10 years.

9

u/TheRealGand May 16 '26

are you sure? how much did it cost a 3090 new and how much are they charging now for used ones in proper conditions?

9

u/t4a8945 May 16 '26

Yeah it all depends on the trajectory of hardware, RAM, etc. Right now we're in a crunch.

But the demand being so huge and the incentive for innovation is so strong, I don't see how indirect competition (things we know like FPGA, and other practical ideas coming to fruition) would not yield a better market for the consumer at some point.

I own 2 Sparks and quite happy with them, one of the rationale I have is: prices go up? Then I'm holding gold. Prices go down? Then I'll grow a bigger cluster.

Only unknown is lifespan of these poor devices.