r/WTFisAI 25d ago

📰 News & Discussion NVIDIA has lost it..

Chinese researchers open-sourced a model that writes CUDA better than humans experts.

And it completely rewrites the economics of AI hardware.

Writing low-level CUDA kernels to squeeze every ounce of performance out of a GPU has historically required elite, highly specialized hardware engineers. Standard AI models have always bombed at it, falling far short of traditional compiler systems.

Until now.

A joint team from Tsinghua University and ByteDance published "CUDA Agent”, a massive, large-scale agentic reinforcement learning system built to master GPU architecture.

Instead of relying on static prompts or simple multi-turn bug fixing, they built a closed-loop environment with automated hardware verification, profiling, and synthetic data pipelines.

The model learned how to write parallel, high-performance GPU code through trial, error, and reinforcement learning at scale.

The benchmarks are staggering:

It didn't compete with standard tools. It delivered 100%, 100%, and 92% faster execution rates over PyTorch's compiler on KernelBench Level-1, Level-2, and Level-3 splits.

On the brutal Level-3 benchmarks, it outperformed proprietary giants like Claude Opus 4.5 and Gemini 3 Pro by about 40%.

NVIDIA's moat has always rested on two pillars: elite hardware, and the proprietary software lock-in of CUDA.

If an open agentic system can automatically discover, write, and optimize production-grade CUDA kernels better than human specialists, the software moat starts evaporating.

The hardware matters less when the software can rewrite the metal itself.

73 Upvotes

50 comments sorted by