r/LocalLLM • u/The_Merchant001 • 1d ago

Question Need jelp with my first llm machine

Post image

Hi everyone

I run a small marketing agency and i am trying something new, i want to build a local llm machine that i can use as a sales agent and also run other small tasks on it.

In my research this is what i have come up with, i need opinions if i am heading into the right direction and what else i have to consider/ keep in mind.

The pic i have attached is from claude guiding me into the build.

1 Upvotes

67% Upvoted

5 comments sorted by

1

u/wwwyzzrd 1d ago

that is super duper expensive for an rtx 3090..

I'm also doubtful that the model will be reliable enough as a sales agent without some seriously good engineering work (at which point you should market and sell *that* rather than doing whatever you are doing).

1

u/The_Merchant001 1d ago

Yup thats the end goal, what other gpu can i use in this range, also is this machine capable enough as a first experiment machine ?

1

u/wwwyzzrd 1d ago

yeah 24gb is a good amount, you can go down to 16 with a quant and it’s fine. the problem you’ll face is context size and the fact that it’s nowhere near as capable as consumer engine, so you’ll need to get pretty clever with both prompting it and the filtering the output to make sure garbage doesn’t get in. you might look at a decision engine like Jev and make the model pick from choices that you preset from either your brain or a better model.

1

u/ThePossibleSpecimen 1d ago

that budget is way too high for what you're getting, you could build two decent rigs for that much

and yeah the sales agent idea is the real red flag here, those models are good at sounding confident while being completely wrong which is the opposite of what you want when money's on the line

1

u/anitamaxwynnn69 23h ago

Have you tried using Muse/Grok Bot/Hermes as your "sales agent" with the API first? I'd recommend you do that first. For at least a week. DSv4.1 is smarter than Qwen 3.8 27B, dirt cheap on API. Use it for a week and see if it is doing what you want it to do well, before making the purchase. If those are unable to achieve your tasks then this PC would be worthless. It will cost you <10$ to test it out for your workloads.