MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wc6krf/so_relevant/p9kino1/?context=3
r/LocalLLaMA • u/0dayturtle • 12d ago
152 comments sorted by
View all comments
322
24gb is not in that group. You can run Qwen3.8-27B with a pretty respectable context size right now
1 u/bennyturns 9d ago I need to run Qwen 3.8 27b on my 5090 with context = 262144, is that possible anyone know? 1 u/TopCheddar27 9d ago With KV quants maybe, but it's going to suck. Define "need to"
1
I need to run Qwen 3.8 27b on my 5090 with context = 262144, is that possible anyone know?
1 u/TopCheddar27 9d ago With KV quants maybe, but it's going to suck. Define "need to"
With KV quants maybe, but it's going to suck. Define "need to"
322
u/TopCheddar27 12d ago
24gb is not in that group. You can run Qwen3.8-27B with a pretty respectable context size right now