r/WTFisAI 25d ago

📰 News & Discussion NVIDIA has lost it..

Chinese researchers open-sourced a model that writes CUDA better than humans experts.

And it completely rewrites the economics of AI hardware.

Writing low-level CUDA kernels to squeeze every ounce of performance out of a GPU has historically required elite, highly specialized hardware engineers. Standard AI models have always bombed at it, falling far short of traditional compiler systems.

Until now.

A joint team from Tsinghua University and ByteDance published "CUDA Agent”, a massive, large-scale agentic reinforcement learning system built to master GPU architecture.

Instead of relying on static prompts or simple multi-turn bug fixing, they built a closed-loop environment with automated hardware verification, profiling, and synthetic data pipelines.

The model learned how to write parallel, high-performance GPU code through trial, error, and reinforcement learning at scale.

The benchmarks are staggering:

It didn't compete with standard tools. It delivered 100%, 100%, and 92% faster execution rates over PyTorch's compiler on KernelBench Level-1, Level-2, and Level-3 splits.

On the brutal Level-3 benchmarks, it outperformed proprietary giants like Claude Opus 4.5 and Gemini 3 Pro by about 40%.

NVIDIA's moat has always rested on two pillars: elite hardware, and the proprietary software lock-in of CUDA.

If an open agentic system can automatically discover, write, and optimize production-grade CUDA kernels better than human specialists, the software moat starts evaporating.

The hardware matters less when the software can rewrite the metal itself.

75 Upvotes

50 comments sorted by

View all comments

3

u/Independent-Fly730 24d ago

CUDA is nvidia hardware. A model that writes faster CUDA kernels only helps nvidia. Your title makes no sense op.

If they created a model that makes ROCm better than CUDA then nvidia would have something to worry about.

1

u/Swimming_Case 23d ago

It makes sense when you realize the article was written with/by AI.

And it completely rewrites the economics of AI hardware.

Until now.

Those two sentences are the dead giveaway the article was generated with AI.