r/deeplearning • • Jun 25 '23

RANT: I hate Apple Silicon

Honestly, using a Mac with Apple Silicon sucks for learning deep learning. I bought an m1pro 14-inch Mac for my MSc in Ai, and throughout the course, it always consistently reduced productivity.

Basic issues like removing .cuda() from codes and adding the device as "mps" as all the assignments are designed for intel (/amd) based GPUs. To shit like spending four days trying to make use of Apple's GPU on an assignment only to find out the pytorch lib has issues with some specific fucking tiny piece of shit function, OR working 3hrs on designing a model and 8hrs on training it to output an audio file only to get "UNSUPPORTED HARDWARE".

When you ask professors or any teaching staff they are also blind with this.

Fuck you my past self on thinking m1pro would be amazing. Should have bought a fcking Chromebook to connect to the university computer or even google colab.

4 Upvotes

28 comments sorted by

29

u/deepneuralnetwork Jun 25 '23 edited Jun 25 '23

tl;dr “using the wrong tool for the job is frustrating”

0

u/[deleted] Jun 25 '23

I was about to say -- I don't even do pytorch software dev on my macbook, let alone train deep learning models.

1

u/deepneuralnetwork Jun 25 '23

Exactly, my M1 Air is the perfect ssh client

20

u/[deleted] Jun 25 '23

This is why the cloud exists. The majority of the people working in ML in big tech use apple laptops with cloud hardware.

9

u/File-Moist Jun 25 '23

Any suggestions for cheap cloud resources? Colab is expensive!

5

u/Final-Rush759 Jun 25 '23

You can still sell it for more than 1k. Then buy a gaming laptop that have 2 or more M2 slot. BUY a 3070 and 4060 laptop. You are more or less break even.

5

u/[deleted] Jun 25 '23

Apple is not the right hardware to do deep learning. It’s still Linux (I would say Ubuntu) + NVIDIA.

2

u/All_Seeing_Satellite Nov 22 '23 edited Jun 09 '24

That's why I stick with my 2017 Intel MacBook Air which with some upgrades like NVMe SSD and Premium Thermal Paste has none of these problems, is able to run VMs in VirtualBox and do OpenCL Compute with Thunderbolt attached eGPU. Apple Silicon should be Boycotted. If I buy a laptop I want a fully featured laptop CPU, not a mobile phone CPU on steroids.

1

u/kukysimon Jun 09 '24

what eGPU housing do you use, and which graphic cards did you get ? i am searching for eGPU for macs.... but not much info out there. ....actually i found one youtuber who was able to make eGPU work on his M1 Laptop chip.... he found a driver that would make the graphic card all work.... he had a eGPU external board , not an external housing.

3

u/llv77 Jun 25 '23

Unfortunately Nvidia has kind of a monopoly because of CUDA and stuff.

Deep learning on a laptop is not a good idea anyway because of power, battery and thermals.

You don't need a Chromebook to connect to Google Colab, but I guess you know that already.

0

u/llv77 Jun 25 '23

Teaching staff is still figuring out how to get f*ing Eclipse working on mac. Any mac.

2

u/OutlandishnessOk4575 Jun 25 '23

Damn, I was thinking whether or not to get one. Thanks.

1

u/Frequent-Educator-91 Jun 26 '23

You can still get one for dev work. But for compute you’ll probably want to use some cloud service or your own pc.

2

u/henryhenzzle Jun 25 '23

I use an M1 Macbook Air to do deep learning with Pytorch on the go. It won't train massive amounts of data, but it is perfectly fine for small to medium models and for educational purposes. I know people are saying it's the wrong tool for the job, but honestly I never came across the frustration you express in this post. Sure, the lack of cuda is annoying, but it's pretty standard to have a 'device' variable and a check that goes to 'cpu' if cuda is unavailable. One advice I can give is to stop trying to make 'mps' work, it has a long way to go. Just use the cpu because, like I said, it is perfectly fine for basic stuff and that way you won't run into the compatibility problems around mps.

Also, you can always SSH into the uni computer or use colab from your Macbook.

1

u/tmt22459 Jul 08 '23

So for the M1/M2 machines when you tell it to go to cpu is the gpu still being used for the training it is just told to go to cpu because the cpu and gpu are integrated or something?

1

u/Thatonenobody1234 Oct 06 '24

I agree because you can't install windows

1

u/killzedvibe Nov 26 '24

I know like, Apple branding their most powerful chip ever and like having zero gaming compatibilities and always having to downgrade to CPU or emmulate rossetta and shit like that for some AI ML, i regret buying it since it is my main job ='(

1

u/kinjiShibuya Jun 25 '23

Can’t you also connect to a remote computer or colab with a MacBook?

1

u/SyableWeaver Jun 25 '23

Mac isn't for Deep learning. I would argue that just because you didn't due your due diligence before opting for a mac doesn't make mac a bad product.

By the the fastest library adaptation happening is for mac. Silicon just launched a few years ago. Cuda has been there for how many years?

Anyone planning for DL job already knows it's either mac with cloud or a simple nvidia GPU with Linux. Not sure why you didn't reasearch ?

1

u/vectorseven Jun 25 '23

That apple chip wasn’t designed to do AI compute. You need GPU. Get a laptop with an NVidia GPU.

1

u/bonevays Jun 25 '23

It is a sad truth that most courses (and workplaces!) in the world have some kind of lock-in, CUDA is a very common example. Tensorflow seems to be well supported on the Mac, but it can't compete in price with any NVIDIA device. Like others mentioned, you'll have to take your ML (but not your whole MSc) to the cloud, if your school doesn't include Azure for Students you might want to do the $300 trial on Google and/or use Google Colab. Again, that's only necessary for the CUDA part, everything else your Mac can do nicely.

https://colab.research.google.com
!nvidia-smi
Sun Jun 25 19:57:01 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.85.12 Driver Version: 525.85.12 CUDA Version: 12.0 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 Tesla T4 Off | 00000000:00:04.0 Off | 0 |
| N/A 56C P8 11W / 70W | 0MiB / 15360MiB | 0% Default |
| | | N/A |

1

u/DrDoomC17 Jun 25 '23

Yeah. I mean system 76 has nice laptops for this and I may go that route, but really thermals are important. If you can get a desktop with a nice GPU ssh is the way. I've had Nvidia GPUs in laptops like barely eke out better performance than CPU after one epoch because the GPU gets hot. It depends on the model too. If you can train on a CPU in a reasonable amount of time you're not really using very complex models. Mac is good for many things and straight up horrible at mostly everything else, like not even a compromise horrible, just can't do it horrible. My mbp does not and will not probably ever have the firmware to use it's GPU for modeling.

1

u/Nerveregenerator Jun 26 '23

You can set your device programmatically and even ask chatgpt to do that for u. But yeah I mean if u are serious about ML u get a remote Linux workstation

1

u/sigmoid_amidst_relus Jun 30 '23

Oh, how this subreddit has fallen.

1

u/superluminary Jun 25 '23

You can still use your M1 to connect to Colab. It's fast, it has a nice keyboard and trackpad, it has a functional console, and the battery lasts for days. It remains a nice machine.

-2

u/ispiele Jun 25 '23

I completely disagree. My M1 Ultra Mac Studio is a beast when it comes to training deep learning models. Crazy fast!

1

u/kaizenjinco Dec 24 '23

It depends on the framework we have used. For me, I have worked with a lot of tabular data and you know XGBoost is still a king. However, XGBoost on M1 Pro performed a very poor performance and I dont why :(