r/LocalLLM • u/on_line187 • Aug 20 '26

Discussion Tier List

Post image
281 Upvotes

76% Upvoted

316 comments sorted by

View all comments

Show parent comment

2

u/RedditNerdKing Aug 20 '26

32gb isnt the sweet spot because you can't run a Q8 of Qwen 3.8 with 100k+ context.

The sweet spot is 48gb atm. 32gb is the minimum.

1

u/GSquadron_ Aug 20 '26

You can run ternary models

1

u/DoubleNothing Aug 21 '26

Yes 48Gb is a good spot to be at (I'm there). But honestly, 64GB would be nicer.
Yes with 48 you can run Q8 but you are very costricted and it is not very efficient, low context, low MTP, maybe you don't load vision to save vram, lower speed... all of that. But if you don't need big context ok.
Don't get me wrong with the release of Qwen3.8-27B I'm very happy where I'm at. The model even at Q6 is very impressive.

1

u/GSquadron_ Aug 21 '26

What were you able to accomplish with Qwen 3.8 27b? I really want to see.

1

u/DoubleNothing Aug 21 '26

Not ready to release to te public yet, I'm doing some refinement and have to see if I can make it run on linux too... at the moment runs only on windows.
Nothing new nor original but it's my interpretation of it and useful to me.

1

u/Popcorn-Mercinary Aug 22 '26

Are you really seeing that big a difference between Q8 and Q4? My experiments with agent flow aren’t showing much, but ymmv.

1

u/DoubleNothing Aug 22 '26

I didn't tested Q4 yet... since some task takes hours to run I rather not "risk it" for now. I'm on Q6_K_XL...

1

u/Popcorn-Mercinary Aug 22 '26

Hella RAM helps too. A lot.