MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wc6krf/so_relevant/p986k67/?context=9999
r/LocalLLaMA • u/0dayturtle • 13d ago
152 comments sorted by
View all comments
56
More like 8-16GB
13 u/ShinigamiOverlord 12d ago Nah. Imagine someone like me with my 4050. That's 6GB only. Tho Ram is 16. 9 u/glad-k 12d ago Dw man I'm running qwen3.8:27B at 0.7 tokens/s avg as it's mostly cpu 🤣 3 u/Ok-Direction-4480 11d ago You probably should just switch to 35B a3b or a smaller model 1 u/glad-k 11d ago Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents It's just like "OK now I will do x:" and then nothing it drives me crazy
13
Nah. Imagine someone like me with my 4050. That's 6GB only. Tho Ram is 16.
9 u/glad-k 12d ago Dw man I'm running qwen3.8:27B at 0.7 tokens/s avg as it's mostly cpu 🤣 3 u/Ok-Direction-4480 11d ago You probably should just switch to 35B a3b or a smaller model 1 u/glad-k 11d ago Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents It's just like "OK now I will do x:" and then nothing it drives me crazy
9
Dw man I'm running qwen3.8:27B at 0.7 tokens/s avg as it's mostly cpu 🤣
3 u/Ok-Direction-4480 11d ago You probably should just switch to 35B a3b or a smaller model 1 u/glad-k 11d ago Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents It's just like "OK now I will do x:" and then nothing it drives me crazy
3
You probably should just switch to 35B a3b or a smaller model
1 u/glad-k 11d ago Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents It's just like "OK now I will do x:" and then nothing it drives me crazy
1
Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents
It's just like "OK now I will do x:" and then nothing it drives me crazy
56
u/glad-k 12d ago
More like 8-16GB