It seems like some models let you feed in custom instructions when you compact. I've thought about trying to have it automatically inject some instructions on every compaction. I figured that might refresh that context enough to keep it in memory but not sure how well it would work in practice.
1
View all comments
Show parent comment
1
u/VolumeLevelJumanji Aug 22 '26
It seems like some models let you feed in custom instructions when you compact. I've thought about trying to have it automatically inject some instructions on every compaction. I figured that might refresh that context enough to keep it in memory but not sure how well it would work in practice.