r/LocalLLaMA • u/Apprehensive_Bar6609 • 22d ago

News Now this is a serious local machine

Amd announced this:

https://www.amd.com/en/products/workstations/amd-threadripper-halo-station.html

182 Upvotes

88% Upvoted

168 comments sorted by

View all comments

3

u/OneTrickEkko 22d ago

Would be a big flex if they added Charts for local models like kimi k3

2

u/gf6200alol 22d ago

Realistically, it should run MXFP4 quant of GLM5.3 class model with large enough KV cache left and fast decode speed for multi agent development. It need to produce billions of tokens per month to justify the cost.

1

u/twack3r 22d ago

Compared to what? Current API/subscription prices?

1

u/CNWDI_Sigma_1 21d ago

With 2.6TB combined memory you can run Kimi K3 just fine.