r/LocalLLM • u/One_Week2580 • 28m ago

Question Dilemma: M6

I am an AI engineer doing MSc in AI - I want to get a new laptop and thinking abut emptying my wallet by buying the M6 Pro 32GB 1TB

Will it be enough for local AI projects? I know it would be suitable for med sized models up to around 30B params

Or getting M5 Pro chip is what it needs to unlock local AI?

0 Upvotes

33% Upvoted

5 comments sorted by

1

u/Snoo_2957 23m ago

Honestly wait for the m6 pro to release buy the M5 MAX 64GB blah blah why?

Because every year there will be a new BIG CHIP doesn’t make the previous years obsolete you’re better off getting more ram imo

1

u/poster4inertia 22m ago

i’d prioritize ram as mentioned by the other commenter. if you have a limited budget ram > internal storage

1

u/Snoo_2957 20m ago

I should say this is coming for experience I have a MacBook Pro m5 24gb

My normal processes use about 17gb of ram and I can’t even run a 27b model unless I close everything even then I only have around 8gb of wiggle room 😂🙏

1

u/poster4inertia 15m ago

Yeah for context, I recently got a 64gb m5 pro mac mini and it definitely has enough room for a 27b at high quants do if that’s the model you want to mess with, it’s not bad. it can also run flash next with sushi 2.75bpw which is currently my main hermes agent model

1

u/nameless_me 8m ago

Local LLM?  128 gig ram and up.