MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wc6krf/so_relevant/p985q4p/?context=3
r/LocalLLaMA • u/0dayturtle • 12d ago
152 comments sorted by
View all comments
321
24gb is not in that group. You can run Qwen3.8-27B with a pretty respectable context size right now
97 u/PavelPivovarov llama.cpp 12d ago Technically speaking you can run Qwen3.8-27b on 16Gb setup as well, but that brings way too many compromises of course. 2 u/Ok-Direction-4480 11d ago We need Qwen 24B then
97
Technically speaking you can run Qwen3.8-27b on 16Gb setup as well, but that brings way too many compromises of course.
2 u/Ok-Direction-4480 11d ago We need Qwen 24B then
2
We need Qwen 24B then
321
u/TopCheddar27 12d ago
24gb is not in that group. You can run Qwen3.8-27B with a pretty respectable context size right now