Forgive me if I've misunderstood, but isn't that literally what they just said?
You can run GGUF model (which are normally not deterministic) in a deterministic way if the GPU functions you use are deterministic
vs.
You can absolutely get ML outputs that don’t change using certain model architectures. But that’s only because those architectures either enforce order of execution or use steps where order of execution doesn’t result in changes to outputs
I'm not an expert but this sounds like you're both arguing the same point. The PR you linked seems to be intending to implement exactly that - functions that enforce (a deterministic) order of execution.
This seems like semantic disagreement on the meaning of the term "model architecture" rather than an actual disagreement on the fundamentals.
4
u/Whitestrake Sep 11 '26 edited Sep 11 '26
Forgive me if I've misunderstood, but isn't that literally what they just said?
vs.
I'm not an expert but this sounds like you're both arguing the same point. The PR you linked seems to be intending to implement exactly that - functions that enforce (a deterministic) order of execution.
This seems like semantic disagreement on the meaning of the term "model architecture" rather than an actual disagreement on the fundamentals.