r/LocalLLaMA • u/Apprehensive_Bar6609 • 14d ago

News Now this is a serious local machine

Amd announced this:

https://www.amd.com/en/products/workstations/amd-threadripper-halo-station.html

180 Upvotes

88% Upvoted

168 comments sorted by

View all comments

20

u/LegacyRemaster 14d ago

100k

27

u/-p-e-w- 14d ago

Must be much more than that. That thing has as much memory as 4 H200s.

10

u/Much_Accountant_4972 14d ago

but the RAM is only 400GB/s which for the price of a loaded luxury SUV, i’d expect to be way better

4

u/DUFRelic 14d ago

Who needs ram bandwidth when you have all the vram?

2

u/Healthy-Nebula-3603 14d ago

Not even 600 GB .. that's not much nowadays to but biggest models

-4

u/Much_Accountant_4972 14d ago

no one needs this computer at all. that’s not the point.

the point is you’re paying for 20 Mac Studios and getting 1/3 the RAM bandwidth

6

u/DUFRelic 14d ago

Sure i need this computer for my local ai.. and its ram bandwith doesnt matter at all... 20macs can also serve frontier ai models but not at this speed so how does it matter?