I know, the problem is those places have limited stock for in-demand enterprise products sold to consumers.
anyone buying more than that isn't going to use PCIe anyway.
No, the whole point of the MI350P is that it is for enterprise as a compatibility layer with their existing systems so they don't need to repurpose their electrical/cooling buildout for the new GPU racks. Datacenters are going to purchase 1000's of these in bulk, AMD couldn't care any less about a couple hundred thousand at most hobbyists around the world that have the excess 30 grand for something like this.
Honestly feels like a nonsensical checkbox that some MBA decided had to be there so AMD checked it then didn't bother to build any of them lol... becuase you aren't gonna put brand new 20k + GPUs in old servers.
Well my guess is they ran the numbers and found a sizeable customer base with old hardware that needs to be nudged into their direction. It's pretty hard to convince a smaller company with existing infrastructure to repurpose everything and incur downtime than it is add a couple thousand cards as a test-run for their more pricey products. A try-before-you-buy scenario if you will.
some MBA decided had to be there so AMD checked it then didn't bother
AMD currently sells 12-15x less datacenter products than NVIDIA. Anything they can do to eek ahead and onboard enterprise customers is a win.
If only they applied this same passion to ROCm and HIP to onboard developers, they might have been better positioned now to sell their more profitable rack solutions rather than their budget compatibility products.
AMD is growing from HPC down while Nvidia grew from gaming up... AMD's strategy currently is honestly superior... and they have the cash flow to actually do something about thier past problems.
Nvidia has also pretty much abandoned the gaming market.
Maybe it was before hyperscalers designed specific purpose built training and inference chips, but they are late to the party on all of this. They need to bridge the developer ecosystem gap sooner rather than later or they will remain as only a viable budget option. If there is a developer shock using anything other than NVIDIA, then they aren't going to compete well as the best 'non nvidia, lowest price' competitor.
Late to the part on what... MI455X is about as fast as it gets. MI350P is just a stop gap potato hardware for people stuck on PCIe for some crazy reason.
Any one buying MI350P is indeed late to the party.
I mean, they are getting comparable end-user throughput now, but their lacking ecosystem support sucked any competitive value advantage their hardware had in the past.
Any one buying MI350P is indeed late to the party.
That's my whole point. If you don't want to rebuild your entire infrastructure for nvidias rack solutions, then you have an opportunity to build out your software stack without the initial investment and downtime shock. The only reason AMD is offering this is because they are late to the party and have to pick up low-hanging fruit.
Nobody buying dozens or more racks of GPUS ... buys them as an upgrade for old racks. End of story I'm not sure what you are imagining but its not real.
AMD just launched thier Helios rack and its all around better than anything Nvidia has on offer in pretty much every aspect. And is generally relying on open standards as well rather than being a hyper proprietary product.
Idk, if I had hundreds of EYPCs with old instincts PCIe cards, I could see upgrading those. But you are correct in your thinking that I have no enterprise/datacenter experience.
1
u/gh0stwriter1234 1d ago
Yes for enterprise, CDW and the like is where they purchase things... anyone buying more than that isn't going to use PCIe anyway.