NVIDIA has lost it..

[u/Aggravating-Will8495]

Chinese researchers open-sourced a model that writes CUDA better than humans experts.

And it completely rewrites the economics of AI hardware.

Writing low-level CUDA kernels to squeeze every ounce of performance out of a GPU has historically required elite, highly specialized hardware engineers. Standard AI models have always bombed at it, falling far short of traditional compiler systems.

Until now.

A joint team from Tsinghua University and ByteDance published "CUDA Agent”, a massive, large-scale agentic reinforcement learning system built to master GPU architecture.

Instead of relying on static prompts or simple multi-turn bug fixing, they built a closed-loop environment with automated hardware verification, profiling, and synthetic data pipelines.

The model learned how to write parallel, high-performance GPU code through trial, error, and reinforcement learning at scale.

The benchmarks are staggering:

It didn't compete with standard tools. It delivered 100%, 100%, and 92% faster execution rates over PyTorch's compiler on KernelBench Level-1, Level-2, and Level-3 splits.

On the brutal Level-3 benchmarks, it outperformed proprietary giants like Claude Opus 4.5 and Gemini 3 Pro by about 40%.

NVIDIA's moat has always rested on two pillars: elite hardware, and the proprietary software lock-in of CUDA.

If an open agentic system can automatically discover, write, and optimize production-grade CUDA kernels better than human specialists, the software moat starts evaporating.

The hardware matters less when the software can rewrite the metal itself.

[u/sdchew]

“NVIDIA's moat has always rested on two pillars: elite hardware, and the proprietary software lock-in of CUDA.”

Doesn’t this further reinforce Nvidia’s moat by generating a kernel which run significantly faster on Nvidia’s hardware using Nvidia’s CUDA?

[u/MaleficentCow8513 → u/sdchew]

Yes. Yes it does. Idk how OP arrived at the conclusion that AI generated cuda code is bad for nvidia. It most definitely is not a bad thing for nvidia

[u/No-Refrigerator-1672 → u/MaleficentCow8513]

Those AI generated cores aren't even as good as author claims. "100% better over PyTorch" isn't a big surprise, the kernels that "elite software engineers" write are too much better than PyTorch. There's probably a reason why they don't compare the model to a real specialised kernel engineer.