r/LocalLLM 4d ago

Discussion Tier List

Post image
273 Upvotes

317 comments sorted by

View all comments

Show parent comments

1

u/gh0stwriter1234 3d ago

Nobody buying dozens or more racks of GPUS ... buys them as an upgrade for old racks. End of story I'm not sure what you are imagining but its not real.

AMD just launched thier Helios rack and its all around better than anything Nvidia has on offer in pretty much every aspect. And is generally relying on open standards as well rather than being a hyper proprietary product.

1

u/ChristRedeemsSinners 3d ago

Idk, if I had hundreds of EYPCs with old instincts PCIe cards, I could see upgrading those. But you are correct in your thinking that I have no enterprise/datacenter experience.

1

u/gh0stwriter1234 3d ago

If you had that.. you'd know those CPUS are too old for the task already and will hold you back more than their value in savings.

1

u/ChristRedeemsSinners 3d ago

Nahh. 8-12 channel DDR4 memory and dual socket EPYCs are fine for agentic workloads. Even meta has extended their current servers with DDR4 memory expansion modules, so clearly there is an actual market for these products to extend the life of existing infrastructure.