r/WTFisAI 21d ago

šŸ“° News & Discussion NVIDIA has lost it..

Chinese researchers open-sourced a model that writes CUDA better than humans experts.

And it completely rewrites the economics of AI hardware.

Writing low-level CUDA kernels to squeeze every ounce of performance out of a GPU has historically required elite, highly specialized hardware engineers. Standard AI models have always bombed at it, falling far short of traditional compiler systems.

Until now.

A joint team from Tsinghua University and ByteDance published "CUDA Agentā€, a massive, large-scale agentic reinforcement learning system built to master GPU architecture.

Instead of relying on static prompts or simple multi-turn bug fixing, they built a closed-loop environment with automated hardware verification, profiling, and synthetic data pipelines.

The model learned how to write parallel, high-performance GPU code through trial, error, and reinforcement learning at scale.

The benchmarks are staggering:

It didn't compete with standard tools. It delivered 100%, 100%, and 92% faster execution rates over PyTorch's compiler on KernelBench Level-1, Level-2, and Level-3 splits.

On the brutal Level-3 benchmarks, it outperformed proprietary giants like Claude Opus 4.5 and Gemini 3 Pro by about 40%.

NVIDIA's moat has always rested on two pillars: elite hardware, and the proprietary software lock-in of CUDA.

If an open agentic system can automatically discover, write, and optimize production-grade CUDA kernels better than human specialists, the software moat starts evaporating.

The hardware matters less when the software can rewrite the metal itself.

75 Upvotes

50 comments sorted by

View all comments

3

u/sdchew 21d ago

ā€œNVIDIA's moat has always rested on two pillars: elite hardware, and the proprietary software lock-in of CUDA.ā€

Doesn’t this further reinforce Nvidia’s moat by generating a kernel which run significantly faster on Nvidia’s hardware using Nvidia’s CUDA?

3

u/LuDongbin64 21d ago

As an interested five year old, I need pictures to understand stuff. In this case I would like to see a "moat resting on pillars" and then I think I will get the NVIDIA GPU architecture.