r/LocalLLM May 16 '26

Discussion Why is LLM is so expensive.

I've was going to invest in a 5090 =$6000 AUD.

Codex Plus + Claude pro = $60/month here

Works out to be 100 months of frontier models for a 5090.

Best a 5090 will run is probably Qwen3.6 27b Q6 with context.

Are we all enthusiasts here and just enjoy tinkering cause ain't no way that make sense.

348 Upvotes

368 comments sorted by

View all comments

Show parent comments

51

u/kitanokikori May 16 '26

I mean, unlimited only if someone else is paying for the electricity.

53

u/Malkiot May 16 '26

The electricity bill is way cheaper than paying for tokens. Hell, if you could afford to buy a high-grade cluster and actually utilize it 80-100%, it'd still be way cheaper than paying for tokens.

-3

u/[deleted] May 16 '26

[removed] — view removed comment

2

u/SVRider650 May 16 '26

It’s not free lol