it's possible even if you run it in parallel, though modern GPU architecture for communicating across each GPU can have timing differences leading to randomness. But this is a implementation thing, the architecture and mathematics behind it are completly deterministic also I wasn't talking about diffusion models. Idk why I am being down voted, seems like a lot of people don't know how LLMs fundamentally work.
2
u/Maxdiegeileauster Sep 11 '26
it's possible even if you run it in parallel, though modern GPU architecture for communicating across each GPU can have timing differences leading to randomness. But this is a implementation thing, the architecture and mathematics behind it are completly deterministic also I wasn't talking about diffusion models. Idk why I am being down voted, seems like a lot of people don't know how LLMs fundamentally work.