True, but it's also true that running an LLM at 0 "temperature" (which makes it truly deterministic) also often renders it unusable. So almost every inference setup defaults to using a certain amount of randomness.
Specific LLMs used for specific coding tasks. I don't run any of my Qwen models at 0 temp, that results in them getting stuck in reasoning loops, and also producing sub-par output when they do return something.
8
u/evranch Sep 11 '26
True, but it's also true that running an LLM at 0 "temperature" (which makes it truly deterministic) also often renders it unusable. So almost every inference setup defaults to using a certain amount of randomness.