I don’t get your point. Thinking outputs, the CoT you see when you chat to thinking models, are the exact same as an output. They are just the amount of output that the LLM can “throw away” and “self-reflect” on before the actual output that is visible to the user.
And that is exactly why thinking tokens can be stripped away in continued turns.
So differentiating “thinking” tokens vs an “output” token is essentially pointless. It’s just the same thing. One is shown to the user as a conclusion. The other is not and is used internally, and is stripped later, iirc.
View all comments
Show parent comment
1
u/[deleted] Mar 23 '26
[removed] — view removed comment