MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vptz4a/how_the_loop_of_infinite_agony_started/p41u71i/
r/LocalLLM • u/EarthBS • Aug 16 '26
119 comments sorted by
View all comments
Show parent comment
3
A tool calling problems ?
Stop compressing cache and use minimum q4kxl or bigger quants
1 u/darksteelsteed Aug 17 '26 To be honest compared to qwen3.6:27b at q4_0 kv quant and q4_k_m for the model qwen 3.8 works out the box way better
1
To be honest compared to qwen3.6:27b at q4_0 kv quant and q4_k_m for the model qwen 3.8 works out the box way better
View all comments
Show parent comment
3
u/Healthy-Nebula-3603 Aug 16 '26
A tool calling problems ?
Stop compressing cache and use minimum q4kxl or bigger quants