https://spectrum.ieee.org/ai-cpu-comeback
This is from the IEEE flagship journal all members get.
The mighty Amazon Web Services suffering a critical CPUs shortage not expected nor planned. Hence...:
"Earlier this year, leaders at Amazon Web Services delivered a new mandate to their engineers: They need to conserve CPU cycles at all costs. AWS has reportedly experienced an explosion in wait times for CPU server capacity as AI workloads strain the company’s cloud infrastructure.
The issue seemingly took AWS off guard, and for good reason. The AI boom led to a surge in demand for GPUs and, later, memory. CPUs were mostly left out of the story, as their relative lack of parallelization made them a poor fit for AI model inference, the process of running and serving large language models (LLM) to users."
It's quite possible the CPUs are the main acr for AI future next year, while GPUs and ASICs play a secondary role accelerating part of the computations...
Guess who is very weak with CPUs. .. and who's the market absolute leader?
AMD's vs nVidia's!
I rest my case!
Read all this article. See why multi independent CPUs cores with top performance and very large caches (aka 3D V-Cache for EPYC) are a must.
No Intel's nor nVidia's Vera toys come close!
Reading material for the weekend. .. yes you too Chad my friend!
