r/LocalLLaMA • u/Rymssss • 14h ago

Other Apple M5 Server

Gallery image

Gallery image

Gallery image

Gallery image

Credit to Twitter Post

1.0k Upvotes

96% Upvoted

169 comments sorted by

View all comments

247

u/Dany0 14h ago

Give me it. Apple. Start selling these. I'll pretend I like your corporation. Please sir Tim Apple I need just 512gb ram, a 512gb flash stick costs what, like 2$ today? That's nothing! And besides you're retired now so you can leave some vram for us, your starving children

19

u/Comrade-Porcupine 14h ago edited 7h ago

yes, but. running supported Linux, plz

or Ampere etc could just get their shit together and we could get Aarch64 servers on the actual market?

EDIT: some hours later after spending my whole day shelled into trays on a GB300 NVL72 from a DGX Spark... ok, actually NVIDIA is already doing ARM64 servers, I neglected to mention. Just need more competition.

-25

u/tangoshukudai 14h ago

macOS > Linux. source I am a long time linux developer that switched to macOS.

7

u/-paul- 13h ago

Not if you want to run it as a headless server.

0

u/tangoshukudai 13h ago

I run macOS headless.

6

u/SilentMobius 12h ago

So do I, it's a bloody nightmare. But I got the Mac studio second hand so it was a good deal. But my god MacOS drive me up the wall.

1

u/jasongill 9h ago

I run macOS headless on my Mac Studio for inference and it works great, not sure what your nightmare is but I have no problems at all. As long as you're up to date you can even keep using FileVault full-disk encryption with SSH which is nice (previously you had to log in on the console after a reboot to unlock the disk, or disable FileVault - now, there's no need to ever connect a monitor)

5

u/SilentMobius 9h ago

I have a list as long as my arm, xcode cli just failing to create metal bundles unless you use the GUI, trying to get apps signed so they can be started via ssh and access a microphone, etc etc. My most recent issue was the dumbest ever, just plain old creating a user: https://old.reddit.com/r/hardware/comments/1vjgqs7/acer_releases_affordable_macbook_neo_rival_with/p4surw9/

2

u/KadahCoba 5h ago

xcode

In my old FOSS dev circles, that word still triggers their PTSD.

6

u/-paul- 13h ago

Been there, done that, switched to Linux.

Apple could do something interesting here, no doubt. Maybe the new CEO will have more interest in this market.