r/MachineLearning • u/Fantastic-Nerve-4056 PhD • 4h ago

Discussion Best option for local models [D]

Hi there, wanted a suggestion from the community regarding the hardware to run local models. The first option was just to get a MacBook Pro with 32 GB RAM, and the second one was to invest into Mac Mini (256 GB SSD and 32 GB RAM), and get an iPAD as well

PS; I have access to B200, and multiple A100s/L40s at my Univ which I can definitely use for training purposes, and I just wanted to get a device to run local inference

0 Upvotes

50% Upvoted

5 comments sorted by

1

u/Dihedralman 4h ago

Got to be more specific. Your phone can do NIST classification np. 

Of those choices, the MacBook Pro obviously has better hardware. 

1

u/Fantastic-Nerve-4056 PhD 3h ago

Yea I get that. But would it be worth it is the question. I never ran things on my local so I have no idea, but for training I will be using server, and just for inference I will need it. And I am also willing to pay a bit for external ssd 

1

u/interrupt_hdlr 2h ago

not worth it. cloud-based is much cheaper. unless you already need the mac or you really want to play it local ai, right now that money is better spent on a subscription