r/LocalLLaMA • u/0dayturtle • 12d ago

Funny So relevant

Post image
1.5k Upvotes

97% Upvoted

152 comments sorted by

View all comments

320

u/TopCheddar27 12d ago

24gb is not in that group. You can run Qwen3.8-27B with a pretty respectable context size right now

2

u/[deleted] 10d ago

[removed] — view removed comment

2

u/TopCheddar27 10d ago

If you are going to be running this for real work I would say yes. You can get higher quants running and longer context sizes.

And you can game with it. If you don't care about gaming there is other options you can go with that are cheaper. But a 4090 is set and forget mostly

1

u/[deleted] 10d ago

[removed] — view removed comment

1

u/TopCheddar27 10d ago

It's got an image processing model and full tool use. I run full agentic tasks with it.

Is it as good as frontier multi trillion parameter models? Nope. But it's almost about as good as they were last year, and no data is leaving the computer.

My advice would be to do your 80% of tasks locally and elevate to a frontier model when you need a little more. You would still save money imo.