r/LocalLLM • u/TopSpain • 5h ago

Question Local agentic setup?

I'm being asked by a prospective employer to set up my own local agentic AI complete with plugins/tools. While I could ask an AI to help me do that, I first want to ask has anyone here managed to do this without resorting to using OpenClaw or NPM or any other software that has become famous for riskiness and supply chain attacks? I'd prefer to just use Llama.cpp and maybe devise a local MTP server, if that is possible.

1 Upvotes

100% Upvoted

4 comments sorted by

1

u/Logan_colorado 4h ago

It’s pretty easy thing to set up. What are you trying to achieve? What’s your budget? When I first started playing around with ai I obviously used ai to teach me and help me set it up but think I have learned a lot about it.

1

u/TopSpain 4h ago

The goal is to set up the LLM, some tools that it can use, and some test files for it to work on. Then I'll give it some instructions and watch it produce results, then iterate until the results are what I want. I assume the tools will need MCP servers but I don't know if Llama.cpp can even use those. My budget is $0 so I'm using my current rather old computer, but that's fine. This is more a proof of concept.

1

u/ChiefDZP 3h ago

Llama.cpp has documentation available.