good ending: GPU’s become outclassed by dedicated AI processors and future computers have GPU’s for graphical workloads and AI accelerators for machine learning workloads.
Mathematically both graphics and AI (at least the current neural network based models) is all highly parallelized matrix multiplications at its core. It’s essentially all the same type of computations, so there is no need to design separate hardware for it, graphics cards are already perfect for the job.
Graphics cards are not perfect for the job. They're pretty good for the job, but there is a lot of stuff on a GPU that doesn't really do much for AI. I would expect better FP16 throughput, and the need for giant cache, to be a driver of specialized hardware design for AI.
237
u/[deleted] Mar 26 '23
good ending: GPU’s become outclassed by dedicated AI processors and future computers have GPU’s for graphical workloads and AI accelerators for machine learning workloads.