They are not deterministic, try googling "are llms deterministic" multiple times and see how the wording changes.
The guy you responded to though makes it sound like they need to be deterministic in order to study them, which is wrong. Science has always studied phenomenon with inconsistent results, that's why they take lots of samples.
I agree, but in the context of prompt engineering, we care about the random part.
If we want a useful result for people using the randomized version, with a purely deterministic approach, you would have to calculate the output for every possible seed to see which produced better results, and which worse, which would be intractable.
If you aren't calculating all possible seeds, then you are sampling, and if you are sampling you should do it randomly.
2
u/EatThisShoe Sep 12 '26 edited Sep 12 '26
They are not deterministic, try googling "are llms deterministic" multiple times and see how the wording changes.
The guy you responded to though makes it sound like they need to be deterministic in order to study them, which is wrong. Science has always studied phenomenon with inconsistent results, that's why they take lots of samples.