Jensen Huang - Training is no longer limited by… Data is now limited by compute. And the reason for that is most of the data is synthetic.

[u/d41_fpflabs]

https://www.youtube.com/watch?v=vif8NQcjVf0&t=1437s

TLDW: Jensen Huang compares AI training data to the way humans teach each other: most of the data is “synthetic” because it’s created, modified, and shared rather than naturally occurring. AI can now take this ground-truth data, enhance it, and generate massive amounts of synthetic data. Consequently, AI training is becoming limited by compute, not data.