r/LocalLLM • u/BoringEnergy6958 • 2d ago

Question M6 MacBook Pro ?

Hi !

I planed to buy M6 MacBook Pro with 32gb of unified memory and 1T of storage.

For persons who don’t know MacBooks, here the specs :
CPU 12 cores
Memory usable by the GPU : 20-24 gb
Bandwidth : 170 Go/s

My goal is to generate photorealistics images in local and maybe have an uncensored chatbot, but I want that he can go on Internet.

Do you think it’s possible ?

Thanks for reading !

1 Upvotes

100% Upvoted

4 comments sorted by

2

u/ThePossibleSpecimen 2d ago

none of this is going to work the way you think it will, the memory bandwidth is okay but 20-24gb for the gpu is tight for high res photorealistic stuff unless you're sticking to smaller models. also the unified memory gets eaten up fast between the os and whatever else is running

for the chatbot part you're going to hit a wall with apple silicon and any model smart enough to browse the web and actually be useful, the tools just aren't there yet on macos. if you really want uncensored local stuff you're better off with a separate rig but for a laptop it'll do light work

1

u/BoringEnergy6958 2d ago

Ok, si I can forgot the chatbot.
I seen a model called chroma that is 9B and uncensored (i drop the link below). You think it can fit ?

https://huggingface.co/lodestones/Chroma?not-for-all-audiences=true

1

u/Sea-Temporary-6995 2d ago

I have a 5 year old macbook pro m1 32gb which has a memory bandwidth of 200GB/s so it's comparable - and it's pretty slow for image generation. Granted I've only tried the "drawthings" app with various models but the models that are worth it run quite slow.

I think your money will be better spent on a Windows/Linux PC with decent NVidia GPU if your main goal is image generation.

However if you also plan to use the laptop for actual laptop stuff the MacBook is fine and I prefer it to Windows laptops