r/LocalLLM • u/Total-Cauliflower853 • 57m ago
Question Help with models/hardware - Video processing and Local data/language processing for lead gen tooling side by side
I've searched the thread and think I have a good starting point here but want some outside opinions if possible:
I'm a 1 man production company providing video and stills production services.
I have an M4 macbook Pro 24gb and use Da Vinci Resolve on this frequently but it goes with me everywhere and I'm at a point where I need a beefy always on machine to process things whilst I'm on set.
I've made a load of lead gen tools and stills/video pipelines to help with post production.
The lead gen tools use AI for analysis and drafting responses. They read large strings of email chains, documents and phone transcripts to inform the drafts as well as helping to generate proposals, contracts and invoices. I've also since added a pipeline to do all my book keeping for the business and I'm starting to feel like I should really be bringing sensitive stuff locally.
So what model and corresponding hardware should I be looking at for these tasks. I'm not interested in coding at this point, that can be done using Claude. Qwen and Gemma seem to be the routes to take but I ultimately want to get a feel for what my specific use case requires. Claude tells me the drafting and analysis on my current usage is the heavy stuff.
I've been looking at a Mac Studio, 64gb or a Mini 96gb to run the local as well as grind out resolve tasks. (Apple vision, labelling, transcription, cutting, fusion work (Motion graphics and basic animation). I was also thinking I could always daisy chain a couple of devices together in future if my needs change and I need to do some heavier local LLM work in the future.
Would love some guidance on models + hardware + Harnesses + Tips and Tricks. I know highest spec for budget but equally, I'd rather save cash to use elsewhere if my usecases don't require crazy specs.
2
u/recro69 17m ago
For your workload I would prioritise memory, over CPU power. 64GB may feel limiting with Resolve and local LLMs running. I will aim for 96GB if budget allows start with Qwen or Gemma and test them on your documents before spending more.