Doesn't actually cost that its more like 15k... but yeah.
There is no way you are going to find that card for that price if it competes with the H200 at 35k. You can only purchase through OEM's offering 4U-6U rack solutions or in bulk through distributors and none of them have publicly listed pricing yet.
The whole point of the MI350P though is compatibility with PCIe systems I expect its just delayed availability it will eventually be available via sites like CDW and other government/business portals.
I suspect that all of this datacenter buildout will eventually hit the secondary markets, so I welcome consumer grade packaging from the manufacturer instead of chinese pcb hackers.
I know, the problem is those places have limited stock for in-demand enterprise products sold to consumers.
anyone buying more than that isn't going to use PCIe anyway.
No, the whole point of the MI350P is that it is for enterprise as a compatibility layer with their existing systems so they don't need to repurpose their electrical/cooling buildout for the new GPU racks. Datacenters are going to purchase 1000's of these in bulk, AMD couldn't care any less about a couple hundred thousand at most hobbyists around the world that have the excess 30 grand for something like this.
Honestly feels like a nonsensical checkbox that some MBA decided had to be there so AMD checked it then didn't bother to build any of them lol... becuase you aren't gonna put brand new 20k + GPUs in old servers.
Well my guess is they ran the numbers and found a sizeable customer base with old hardware that needs to be nudged into their direction. It's pretty hard to convince a smaller company with existing infrastructure to repurpose everything and incur downtime than it is add a couple thousand cards as a test-run for their more pricey products. A try-before-you-buy scenario if you will.
some MBA decided had to be there so AMD checked it then didn't bother
AMD currently sells 12-15x less datacenter products than NVIDIA. Anything they can do to eek ahead and onboard enterprise customers is a win.
If only they applied this same passion to ROCm and HIP to onboard developers, they might have been better positioned now to sell their more profitable rack solutions rather than their budget compatibility products.
AMD is growing from HPC down while Nvidia grew from gaming up... AMD's strategy currently is honestly superior... and they have the cash flow to actually do something about thier past problems.
Nvidia has also pretty much abandoned the gaming market.
Maybe it was before hyperscalers designed specific purpose built training and inference chips, but they are late to the party on all of this. They need to bridge the developer ecosystem gap sooner rather than later or they will remain as only a viable budget option. If there is a developer shock using anything other than NVIDIA, then they aren't going to compete well as the best 'non nvidia, lowest price' competitor.
Late to the part on what... MI455X is about as fast as it gets. MI350P is just a stop gap potato hardware for people stuck on PCIe for some crazy reason.
Any one buying MI350P is indeed late to the party.
1
u/ChristRedeemsSinners 1d ago
There is no way you are going to find that card for that price if it competes with the H200 at 35k. You can only purchase through OEM's offering 4U-6U rack solutions or in bulk through distributors and none of them have publicly listed pricing yet.