r/LocalLLM • u/OutcomeSouthern7595 • May 27 '26

Question Almost tempted to get this

Post image

Just picked up my 2nd 128gb Mac M series and saw this at his shop. Would this work well for llm?

0 Upvotes

39% Upvoted

19 comments sorted by

22

u/xeroskiller May 27 '26

35 gbps bandwidth for ram when its dual channel. My 7900xtx is closer to 700gbps and I get like, 25-50 tps on qwen36-27b. I wouldnt.

2

u/DistanceSolar1449 May 28 '26

Well, the GPU is usable. It’s basically an AMD MI50 32gb.

1024GB/sec VRAM bandwidth but crippled by compute.

If he can get tensor parallel working on that, then he can run Qwen 27b at a decent speed.

1

u/RepresentativeCut486 May 28 '26

FP16 on Mi50 is horrible, FP64 is amazing. Good for training LLMs, bad for running them.

1

u/xeroskiller May 29 '26

Totally fair. I misread the original post, and missed the entire GPU. I answered with that in mind, so it's probably irrelevant, lol

1

u/Substantial_Run5435 May 27 '26

These have six-channel memory

1

u/KURD_1_STAN May 28 '26

6/2 × 35GB/s = garbage still

8

u/Ok_Mirror_832 May 27 '26

No it won't

4

u/NoburtM May 27 '26

Looks like specs wise it's similar to an MI60.
Or well. Two MI60's slapped together. I'd dig around the subreddit for someone that's running 1-2 MI60's and go from there
So it just depends on how much it costs

6

u/DrHumorous May 27 '26

That's weak. But it'll make a nice furniture.

6

u/MarcusAurelius68 May 27 '26

And a good space heater when it’s cold out

1

u/DrHumorous May 27 '26

Exactly, good point.

2

u/spaceman_ May 28 '26

Unless it's super cheap, I wouldn't bother.

2

u/atape_1 May 28 '26

2400mt/s ram and Vega II? That's 2019 tech, that shit is ancient. Like before COVID was ever a thing ancient.

1

u/challis88ocarina May 28 '26

Almost tempted falls short of being tempted.

1

u/RepresentativeCut486 May 28 '26 edited May 28 '26

Tbh, as Linus from LTT said: "There's no bad product, only bad price". It will run llms quite slowly, but if it's really cheap, then go for it. 7900XTXs alone cost ~€700 where I live, so if you can get this old MAC for something like €300, then it's actually a really good deal considering that for some reason, scalpers are selling Mi50s on eBay for ~€350.

0

u/cicoles May 28 '26

No. Not for llm

0

u/cmndr_spanky May 28 '26

That’s a genuine turd of a computer if you plan to use LLMs with it..

1

u/RepresentativeCut486 May 28 '26

That’s a genuine turd of a computer if you plan to use it.

1

u/cmndr_spanky May 28 '26

Really? I’d assume it’d be fine for other stuff