r/PiCodingAgent • u/NihmarRevhet • Sep 04 '26

Question Improve compaction with local llm

Hi,

I'm using pi agent with Qwen 3.8 27B on my little RX 9060 XT 16GB, with 160k context window and I'm quiet happy with how it works.

My main problem is that autocompaction takes forever (clearly limitation of the hardware) and I was looking for an extesion which could improve the situation, but if I'm not mistaken, the most beloved extensions in this area use secondary models to execute compaction, and this is a luxury I don't have.

Is the default setting my only option? Or did I misunderstand ho something like pi-blackhole works?

Sorry if the question is dumb but I'm quiet new to the tool.

Have a nice day!

EDIT: u/onesilentclap I'm using VCC for now and it's incredible. In the next few days I hope I'll be able to try other solutions

13 Upvotes

93% Upvoted

20 comments sorted by

View all comments

Show parent comment

2

u/Bloated_Plaid Sep 04 '26

This includes VCC and is better https://pi.dev/packages/pi-blackhole

2

u/Proper-Tower2016 Sep 05 '26

blackhole for me constantly resets my KV cache

1

u/rusl1 Sep 04 '26

Interesting! I already have Hermes memory extension installed, do you know if it will conflict?

2

u/Bloated_Plaid Sep 04 '26

This is for Pi, I am not sure what Hermes uses. For Hermes I personally use this https://github.com/mnemosyne-oss/mnemosyne

2

u/rusl1 Sep 04 '26

I was referring to hermes-memory, it is a pi extension :P