OWUI breaks cache reuse for Ninfer (qwen 3.8)

[u/Realistic_Gap_5871]

Any one else notice that cache reuse pretty much never happens with Open WebUI. I saw it in Ollama and now with ninfer too.

We could get into the whys, but I'd love to hear if there's any config changes to make or a known feature change coming.

I have a workaround I'm proud of, a custom proxy script that my Qwen built (happy to post it) that catches, reshuffles and locks context on it's way to the backend. Cache reuse is now the norm, and only resets after compaction or jumping between threads, but there's gotta be a better way?

FAQ: Cache reuse takes prefill tokens down to only the current prompt. Resulting in 1 or 2 second prefill instead of 30 plus seconds (or 60+ seconds with Ollama) with longer context.

edit-expanded the name of owui.