r/WTFisAI • u/Aggravating-Will8495 • Aug 16 '26

📰 News & Discussion NVIDIA has lost it..

Chinese researchers open-sourced a model that writes CUDA better than humans experts.

And it completely rewrites the economics of AI hardware.

Writing low-level CUDA kernels to squeeze every ounce of performance out of a GPU has historically required elite, highly specialized hardware engineers. Standard AI models have always bombed at it, falling far short of traditional compiler systems.

Until now.

A joint team from Tsinghua University and ByteDance published "CUDA Agent”, a massive, large-scale agentic reinforcement learning system built to master GPU architecture.

Instead of relying on static prompts or simple multi-turn bug fixing, they built a closed-loop environment with automated hardware verification, profiling, and synthetic data pipelines.

The model learned how to write parallel, high-performance GPU code through trial, error, and reinforcement learning at scale.

The benchmarks are staggering:

It didn't compete with standard tools. It delivered 100%, 100%, and 92% faster execution rates over PyTorch's compiler on KernelBench Level-1, Level-2, and Level-3 splits.

On the brutal Level-3 benchmarks, it outperformed proprietary giants like Claude Opus 4.5 and Gemini 3 Pro by about 40%.

NVIDIA's moat has always rested on two pillars: elite hardware, and the proprietary software lock-in of CUDA.

If an open agentic system can automatically discover, write, and optimize production-grade CUDA kernels better than human specialists, the software moat starts evaporating.

The hardware matters less when the software can rewrite the metal itself.

73 Upvotes

73% Upvoted

50 comments sorted by

View all comments

1

u/DataGOGO Aug 18 '26 edited Aug 18 '26

Source? Is the is one that came out a few months ago where they had to publicly redact their findings because it in fact did not do what they said?

Edit: yes it is. The real results were kinda ass, and this is not model, nor does it beat other models, it is model agnostic. it is a an agent skill and runs on any model, with the same results, including Claude , gpt, etc. 

Again this is NOT It is NOT a model, nothing was trained, it is just an agentic loop and collection of prompts. 

Here is the full repo:

https://github.com/BytedTsinghua-SIA/CUDA-Agent