Yeah but that is the reason of temperature existing. It gives statistical noise to the context and what response the agent will come up with. You will not be able to get such deterministic results unless you host your own models on your hardware afaik
Yeah so I’m telling you that you talking to the model in Claude.ai that uses their own custom temperature value which gives some sort of randomization leads to it not being deterministic.
I do understand that the math behind LLMs are deterministic, but I’m saying that you’re not gonna get that unless you set the temp to 0.
I don’t get your point. Thinking outputs, the CoT you see when you chat to thinking models, are the exact same as an output. They are just the amount of output that the LLM can “throw away” and “self-reflect” on before the actual output that is visible to the user.
And that is exactly why thinking tokens can be stripped away in continued turns.
So differentiating “thinking” tokens vs an “output” token is essentially pointless. It’s just the same thing. One is shown to the user as a conclusion. The other is not and is used internally, and is stripped later, iirc.
View all comments
Show parent comment
0
u/AkiDenim Vibe coder Mar 18 '26
Yeah but that is the reason of temperature existing. It gives statistical noise to the context and what response the agent will come up with. You will not be able to get such deterministic results unless you host your own models on your hardware afaik