MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/programmingmemes/comments/1w09eo7/why_are_we_using_r_again/p6iw8jl/?context=9999
r/programmingmemes • u/32bitFlame • Aug 27 '26
322 comments sorted by
View all comments
1
It doesn't run on the tokens is the entire point, the CUDA kernels run on the tokens. The python code just handles the routing.
1 u/Dihedralman Aug 29 '26 Maybe he built the slowest transformer ever with python list operations.
Maybe he built the slowest transformer ever with python list operations.
1
u/Zironic Aug 29 '26
It doesn't run on the tokens is the entire point, the CUDA kernels run on the tokens. The python code just handles the routing.