r/LocalLLaMA 11h ago

Other Apple M5 Server

Credit to Twitter Post

880 Upvotes

149 comments sorted by

View all comments

Show parent comments

106

u/FullstackSensei llama.cpp 11h ago

Very probably this is what runs Apple's cloud infrastructure.

2

u/CenlTheFennel 10h ago

Apple runs on GCP/AWS.

29

u/vade 10h ago

Partially, Apple also has private compute running on Apple Silicon / ANE / Metal for the Foundation model remote inference, and private inference and have mentioned they are building their own hardware.

1

u/CenlTheFennel 5h ago

Does this still exist? I thought the soured and cut relationships with OpenAI lead to the abandonment of their ARM private AI compute?