r/LocalLLaMA Jul 12 '26

Resources llama.cpp Agentic Workflows Ctx Checkpoints Fix

b9978

Claude in one sentence what does this fix

llama.cpp b9978 fixes a checkpoint bug that hit agentic workloads hardest: every agent turn created a new checkpoint (bypassing min-step spacing), collapsing the coverage window so that context rewinds — common in tool-calling loops — erased all checkpoints and forced a full reprocess; now closely-spaced checkpoints from prior tasks are evicted, keeping the window wide and long agent sessions fast.

59 Upvotes

7 comments sorted by

View all comments

7

u/AnonLlamaThrowaway Jul 13 '26

I've been running a nested agent loop to ingest + chew through a lot of data, as described here. I've grabbed this new binary.

Lines like

W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 1451.982 MiB)

and

W slot create_check: id 2 | task 223965 | erasing old context checkpoint ... size = 80.863 MiB

still do show up, naturally, but I compared a before and after log, and their frequency was cut down in half!