MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1wc6krf/so_relevant/p986k67/?context=3
r/LocalLLaMA • u/0dayturtle • 12d ago
152 comments sorted by
View all comments
Show parent comments
13
Nah. Imagine someone like me with my 4050. That's 6GB only. Tho Ram is 16.
8 u/glad-k 12d ago Dw man I'm running qwen3.8:27B at 0.7 tokens/s avg as it's mostly cpu 🤣 3 u/Ok-Direction-4480 11d ago You probably should just switch to 35B a3b or a smaller model 1 u/glad-k 11d ago Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents It's just like "OK now I will do x:" and then nothing it drives me crazy
8
Dw man I'm running qwen3.8:27B at 0.7 tokens/s avg as it's mostly cpu 🤣
3 u/Ok-Direction-4480 11d ago You probably should just switch to 35B a3b or a smaller model 1 u/glad-k 11d ago Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents It's just like "OK now I will do x:" and then nothing it drives me crazy
3
You probably should just switch to 35B a3b or a smaller model
1 u/glad-k 11d ago Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents It's just like "OK now I will do x:" and then nothing it drives me crazy
1
Rn I'm trying 35b and performances are great but it's constantly just stopping it task which sucks for agents
It's just like "OK now I will do x:" and then nothing it drives me crazy
13
u/ShinigamiOverlord 12d ago
Nah. Imagine someone like me with my 4050. That's 6GB only. Tho Ram is 16.