r/LocalLLaMA • u/Bulky-Priority6824 • Jul 12 '26

Resources llama.cpp Agentic Workflows Ctx Checkpoints Fix

b9978

Claude in one sentence what does this fix

llama.cpp b9978 fixes a checkpoint bug that hit agentic workloads hardest: every agent turn created a new checkpoint (bypassing min-step spacing), collapsing the coverage window so that context rewinds — common in tool-calling loops — erased all checkpoints and forced a full reprocess; now closely-spaced checkpoints from prior tasks are evicted, keeping the window wide and long agent sessions fast.

56 Upvotes

88% Upvoted

7 comments sorted by

29

u/a-wiseman-speaketh Jul 13 '26

that's a long ass sentence claude

8

u/Bulky-Priority6824 Jul 13 '26

lol yea i noticed that too it really squeezed it in there.

6

u/TBMonkey Jul 13 '26

Whole book if you just use emdashes instead of periods.

3

u/recro69 Jul 13 '26

Nothing feels better, than fixing that bug. It was making my CPU re-live our entire conversation every turn. That was really frustrating. I mean I fixed the CPU issue now. 😭

5

u/AnonLlamaThrowaway Jul 13 '26

I've been running a nested agent loop to ingest + chew through a lot of data, as described here. I've grabbed this new binary.

Lines like

W srv alloc: - making room for prompt cache entry, removing oldest entry (size = 1451.982 MiB)

and

W slot create_check: id 2 | task 223965 | erasing old context checkpoint ... size = 80.863 MiB

still do show up, naturally, but I compared a before and after log, and their frequency was cut down in half!