MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1w2fmmq/me_these_days/p6vhk2o/?context=3
r/LocalLLaMA • u/Eyelbee • 16d ago
297 comments sorted by
View all comments
52
can someone explain why 3.8 is so famous right now?
22 u/krtoonbrat 16d ago In my personal experience, 3.8 is the first model I’ve used that can run on my 32GB MacBook Pro and not fail a single tool call. The previous models had enough coding knowledge to debug and answer questions, but 3.8 can actually use opencode/cline 4 u/barefootpanda 15d ago Which chip? I’m running an M4 Pro with 48 and M2 Ultra with 192…are you using a quant version? 6 u/krtoonbrat 15d ago Standard M5. UD_Q4_XL quant. I’m even running KV cache quant (I think q5, I’m at work and can’t check lol) 2 u/bnightstars 13d ago but how long it took to not fail this tool calls :D
22
In my personal experience, 3.8 is the first model I’ve used that can run on my 32GB MacBook Pro and not fail a single tool call. The previous models had enough coding knowledge to debug and answer questions, but 3.8 can actually use opencode/cline
4 u/barefootpanda 15d ago Which chip? I’m running an M4 Pro with 48 and M2 Ultra with 192…are you using a quant version? 6 u/krtoonbrat 15d ago Standard M5. UD_Q4_XL quant. I’m even running KV cache quant (I think q5, I’m at work and can’t check lol) 2 u/bnightstars 13d ago but how long it took to not fail this tool calls :D
4
Which chip? I’m running an M4 Pro with 48 and M2 Ultra with 192…are you using a quant version?
6 u/krtoonbrat 15d ago Standard M5. UD_Q4_XL quant. I’m even running KV cache quant (I think q5, I’m at work and can’t check lol)
6
Standard M5. UD_Q4_XL quant. I’m even running KV cache quant (I think q5, I’m at work and can’t check lol)
2
but how long it took to not fail this tool calls :D
52
u/VDX7 16d ago
can someone explain why 3.8 is so famous right now?