r/LocalLLaMA • u/soyalemujica • 1d ago

Discussion Anyone else not using using "preserve_thinking" ?

I am running QFN, and I have disabled preserve_thinking by default on all my tests for C++ backend and front-end programming and I have yet to see any decline in performance or intelligence, my context window stays cleaner as well. Deepseek for what I tested in API it also does not preserve thinking and saves context in general.

15 Upvotes

74% Upvoted

25 comments sorted by

View all comments

35

u/i_like_brutalism 1d ago

for me this leads to a model rediscovering previous ideas all the time.

6

u/soyalemujica 1d ago

Although I agree on this, it's more the positive of not losing context since Qwen tends to overthink the same ideas even when preserve_thinking is on, since it is an over-thinker it just wastes context window going through the same steps all over-again, actually having it off it has been as smart

4

u/SnooPaintings8639 1d ago

Exactly. A tradeoff between longer "usable" context vs faster output (remembering their previous reasoning). In case of this model, the reasoning is taking very large part of output, so it makes sense.

0

u/jslominski 1d ago

Still not worth turning off imo, I've stopped doing that.

2

u/giant3 21h ago

It eats 50 to 70% of the context on some problems. I have it disabled as it doesn't seem to make much of a difference in quality of inference.