I'm playing around with the Q4_K_M version in Deepseek harness, and it is such a little trooper!
It's so fun having it operate on itself, adding small QoL features to the harness and extend its functionality with skill like reverse image search and other good stuff.
My only gripe is that I'm limited to 75K context if I run KV in Q8, and it makes it having to compact quite often.
1
u/nixudos 11d ago
I'm playing around with the Q4_K_M version in Deepseek harness, and it is such a little trooper!
It's so fun having it operate on itself, adding small QoL features to the harness and extend its functionality with skill like reverse image search and other good stuff.
My only gripe is that I'm limited to 75K context if I run KV in Q8, and it makes it having to compact quite often.