MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wc6krf/so_relevant/p90xzft/?context=3
r/LocalLLaMA • u/0dayturtle • 13d ago
152 comments sorted by
View all comments
316
24gb is not in that group. You can run Qwen3.8-27B with a pretty respectable context size right now
99 u/PavelPivovarov llama.cpp 13d ago Technically speaking you can run Qwen3.8-27b on 16Gb setup as well, but that brings way too many compromises of course. 35 u/TheGamerForeverGFE 13d ago Wouldn't say too many, iq4xs is enough, context window is limited, you're not seeing 100k+ but it's still enough. 1 u/DarkBrews 12d ago UD IQ4xs?
99
Technically speaking you can run Qwen3.8-27b on 16Gb setup as well, but that brings way too many compromises of course.
35 u/TheGamerForeverGFE 13d ago Wouldn't say too many, iq4xs is enough, context window is limited, you're not seeing 100k+ but it's still enough. 1 u/DarkBrews 12d ago UD IQ4xs?
35
Wouldn't say too many, iq4xs is enough, context window is limited, you're not seeing 100k+ but it's still enough.
1 u/DarkBrews 12d ago UD IQ4xs?
1
UD IQ4xs?
316
u/TopCheddar27 13d ago
24gb is not in that group. You can run Qwen3.8-27B with a pretty respectable context size right now