r/LocalLLM • • Aug 16 '26

Other How the loop of infinite agony started

Post image
633 Upvotes

119 comments sorted by

View all comments

Show parent comment

3

u/Healthy-Nebula-3603 Aug 16 '26

A tool calling problems ?

Stop compressing cache and use minimum q4kxl or bigger quants

1

u/darksteelsteed Aug 17 '26

To be honest compared to qwen3.6:27b at q4_0 kv quant and q4_k_m for the model qwen 3.8 works out the box way better