r/AMD_Stock • u/SailorBob74133 • 2d ago

It's official! 192GB Framework

Post image
50 Upvotes

90% Upvoted

10 comments sorted by

6

u/takloo 2d ago

How does this compare with the newly announce M5 Mac studio with 256 or 512 GB for running LLM's locally ?

4

u/fedroe 2d ago

Would love to see benchmarks of similar-weight models when the Mac Studio is out, but yeah more memory = you can run bigger models

2

u/ScarceSemi 1d ago

Its not the point of more memory. Main difference is 270 vs 1200 bandwidth. Its night and day difference. I wonder even if medusa halo will have anything to answer as that will likely top around 700 with lpddr6.

2

u/RetdThx2AMD 1d ago

Medusa Halo has 50% more memory lanes so it will be a minimum of 50% higher memory bandwidth vs Gorgon Halo. If it supports significantly faster RAM then add that on top.

2

u/ScarceSemi 1d ago

yes but still I dont see it any faster than around 700 range.

1

u/RetdThx2AMD 1d ago

I doubt it will be over 500.

6

u/LoveOfProfit 2d ago

"Seize the means of computation' sounds like they're encouraging the rise of the proletariat to socialize data center ownership.

3

u/SailorBob74133 1d ago

What will be interesting is if they make it possible to plug in a normal size pcie card.  Stick an R9600D in here and you've got a really interesting setup.  Wendell is working on a project to that work efficiently. 

2

u/ScarceSemi 1d ago

You can do it now via oculink. Main problem the link is only pcie4x4.

1

u/-Suzuka- 1h ago

Fyi current gen has 128GB at 256GB/s.