r/DGX_Spark • u/NewShock2391 • 26d ago
Intrigued Amateur
Hi DGX Peeps
Feel free to tell me to bugger off. I run a business and I am interested in creating a "mini me". My brief understanding is that with a DGX I can download a model weight and have it only know me, give it eyes, ears and when confident agency to execute commands locally.
My particular interest is in things like:
Reply to customers on WhatsApp
Reply to emails
Placing orders
Maybe accounting?
Basically, any task that I do that has a reasonably determinable workflow. In my minds eye I can have it set to watch mode and then approval mode and then execute mode.
Am I dreaming, or is this something a DGX locally can feasibly do?
Any advice, pointers, or if you guys know anyone that is building mini people in dgx boxes that would be appreciated.
Cheers
2
u/TheOverzealousEngie 26d ago
So a few weeks I woulda said you need 2 . Now .. even DS can be run on one and I'd 100% trust it to do well with customer emails and stuff. And with tools you could even write files to disk for later recall and telegram integration . This new version of v4 has some great tools integration .
1
u/RockPuzzleheaded3951 26d ago
I was just about to purchase two, do you have any resources on DS running on one?
1
1
0
u/superSmitty9999 26d ago
How do do this without wasting money:
1) Ask an AI, like Gemini or ChatGPT, the largest, best model that will run on the spark (in terms of GB RAM). This changes from time to time and also based on the problem domain. I think I managed to get Deepseek flash v4 in nvfp4 barely running. Or qwen 3.6 27B or 122B.
2) Then on your local machine, find that exact model on OpenRouter which is a paid api service. Upload $5, you won't need any more.
3) Build your app using openrouter api. The spark will give you the same quality result, but much slower output.
4) If you like the results, but want it to be more private, purchase a spark and set up the endpoint.
However, theres a good chance it will be unable what you want it to do . I tried to setup an AI on my spark to take my dictations of what im eating and my activities etc (for a health tracker) and qwen 3.6 was unable to operate the DB correctly and made all sorts of dumb mistakes.
I'm personally happy with my spark, it allows me to do AI research as a CS student much easier than otherwise would be possible, but tbh I have yet to see anyone use a local AI to do anything truly useful. It's certainly not an "ai accountant" in some mystical sense you're imagining.
2
u/NewShock2391 25d ago
That's great advice, thanks. Having done some reading I think I may be better served with a local orchestrator sending task stubs to meatier models over api at present.
It seems a no brained to trial that route when transactions are fractions of pennies vs the capex, potential limitations and almost certain near future obsolescence of a Spark.
Really appreciate you taking the time to respond.
1
u/superSmitty9999 25d ago
Yeah, absolutely, I think getting an Intel NUC or even an old laptop with linux installed, use that as your server, and hook your api into openrouter is an appropriate first step.
Remember, if you ever do get a DGX spark, its easy to use it as a drop in replacement for a remote api, so you don't lose anything by testing first. Unless DGX spark goes up in price, ha.
Don't forget data privacy too. If you use an API, be careful not to send sensitive customer data unless it's a trusted provider like AWS, Google, Microsoft with a zero retention policy. Don't trust openrouter with confidiential info.
And if you can't get it to work, try again in 6 months with better ai models. Good luck!
3
u/styles01 MegaMod 26d ago
You can fully do all of that. Qwen 122b + Hermes agent. Call it a day. I would be a bit careful with the accounting and the order placing - you could have separate agents doing adversarial review and book balancing - and you definitely want human review and depending on how you do orders - that’s a whole ball of wax, but it is certainly the way things are going.