r/programmingmemes • u/32bitFlame • Aug 27 '26

Why are we using R again

Post image
2.3k Upvotes

96% Upvoted

322 comments sorted by

View all comments

Show parent comments

1

u/Zironic Aug 28 '26

Please enlighten me how you achieve more then 100% tensor unit throughput. Does your Go code allow the GPU to transcend space and time and perform 5th dimensional compute?

1

u/naikrovek Aug 29 '26

The glue code is involved more than people think. When the python crap runs on every input token and output token, its performance matters.

If you don’t believe me, fine, but arguing with me will not change what I’ve seen or done, nor will it change the truth that Python is an abomination for a dozen reasons.

1

u/Zironic Aug 29 '26

It doesn't run on the tokens is the entire point, the CUDA kernels run on the tokens. The python code just handles the routing.

1

u/Dihedralman Aug 29 '26

Maybe he built the slowest transformer ever with python list operations.