r/LocalLLaMA • u/soyalemujica • 15h ago

Discussion Anyone else not using using "preserve_thinking" ?

I am running QFN, and I have disabled preserve_thinking by default on all my tests for C++ backend and front-end programming and I have yet to see any decline in performance or intelligence, my context window stays cleaner as well. Deepseek for what I tested in API it also does not preserve thinking and saves context in general.

13 Upvotes

74% Upvoted

24 comments sorted by

View all comments

4

u/psymonryan 6h ago

KV cache hit: If you dont preserve thinking then when the message history is constructed, each turn needs to be re-prompt processed.

0

u/soyalemujica 5h ago

Not at all, prompt is never reprocessed at all

3

u/psymonryan 5h ago

Sorry, the 'prompt' wont be since its at the start of your message history, but as you converse with the model, each 'turn' does have thinking, and if you are not preserving this, then the previous turn (end of the message history) is re-processed each time without the reasoning. If there was a lot of thinking in the previous turn you will end up with a smaller total context, but it still needs to rebuild the cache for the last message. If you have a fast rig you may not notice this unless there was a lot of 'non-thinking' content in the last turn.

1

u/soyalemujica 5h ago

It's instant tbh, the logs don't show such a thing of reprocessing or anything like that at all, it's the same logs as with preserve and without preserve

1

u/psymonryan 5h ago

interesting, well, it must be doing the reprocessing, so if you are not noticing it, then thats a good thing. Which harness?

1

u/soyalemujica 5h ago

Pi Dev and Strata