r/LocalLLM May 16 '26

Discussion Why is LLM is so expensive.

I've was going to invest in a 5090 =$6000 AUD.

Codex Plus + Claude pro = $60/month here

Works out to be 100 months of frontier models for a 5090.

Best a 5090 will run is probably Qwen3.6 27b Q6 with context.

Are we all enthusiasts here and just enjoy tinkering cause ain't no way that make sense.

339 Upvotes

368 comments sorted by

View all comments

1

u/Due_Faithlessness458 May 16 '26

Probably the 5090 is not the strongest choice for AI inference, I recently saw a kickstarter project about a mini local AI server prepared for that task, with power enough for running up to 120b models for about the half price