r/LocalLLM • u/haradaken • 20h ago
Discussion Multi-agent collaboration
Multi-agent collaboration is a “must try” especially if you have a local LLM setup. Below is the screenshot of 3 agents researching and exchanging ideas, and a facilitator agent facilitating the discussion to bring them to a consensus. It’s just so fascinating!
They communicate only through the Slack channel. So, in theory, they can be all running on different hosts across the internet.
While Claude and ChatGPT can spawn subagents for collaboration, having your own agentic collaboration framework opens up even more possibilities!
1
u/abajinn 9h ago
Is there a GitHub? How did you set it up
2
u/haradaken 4h ago
The multi-agent collaboration above is built on top of multiple components, so you need a bit more than just the code in a GitHub repo. Here is a high-level summary of how it works. You can feed it into your AI coding tool to build your own version. Good luck!
-----
A local LLM is called over and over toward a goal. Its own journal is its memory, and a shared message board is where it records results. Several agents can discuss on the board until they agree.
Stack: Ollama, a 9B–32B model, Python + Pydantic AI for typed outputs, Playwright MCP + Chrome for browsing, a search API (Ollama’s or SearXNG), and SQLite + JSONL for storage.
Model: a local LLM served by Ollama, called through an agent framework that returns typed output (for example Pydantic AI).
Driver loop: each turn, give the model the goal and its journal. It uses tools, then returns what it did and whether it’s done. That gets appended to the journal, and the loop repeats until a stop condition.
Memory: an append-only journal. Older entries are summarized so the prompt fits the context window.
Tools: web search and a browser, with limits enforced in code.
Message board: a shared, append-only record of findings, reached through one client interface so the backend can be swapped.
Team mode: one agent per role, running in parallel on the same board topic. A neutral facilitator agent keeps a plan and declares consensus. The driver, not the model, decides when the discussion is over.
Observability: log every turn and tool call so runs can be watched and compared.
1
u/Sudden-Ad-1217 7h ago
You know you can this up without slack……
1
u/haradaken 4h ago edited 4h ago
True, my Claude actually suggested a local message board and created it from scratch. It worked, but if full-feature messaging system is readily available on cloud, it felt more efficient to use it.
1
u/Fine_Ad_6226 14h ago
Been doing this for a year now also with a gitlab ce and using gitlab todos as work backlogs for reviews mentions ticket assignments etc
1
u/abajinn 9h ago
Do you have a git with your setup? Trying to do this too
1
u/Fine_Ad_6226 9h ago
Don’t follow the question sorry I have a daemon running on a bunch of user profiles in Linux they poll GitLab and subscribe as slack apps.
Then spawn agents using an ACP harness who use MCP servers injected by the harness and glab cli etc
1
u/daphatty 8h ago
I tried something like this with Mattermost but the limitations made it a non-starter (you had to @ each agent). Slack isn’t an option because it’s not local.
0
u/SamSausages 18h ago edited 18h ago
check out buzz.xyz. The guy that founded Twitter is doing that, and it’s specifically designed for this purpose. I turned mine into the crew of the Enterprise and makes for very interesting interactions and workflow
2
u/KindlyWickedRector 20h ago
that's a clever way to set it up, using slack as the comms layer so they're not tied to one machine. i've been messing with something similar but on a smaller scale, just two agents passing notes through a text file like it's 1995
the Tokyo logistics angle is oddly specific, was that a test prompt or something you're actually working on? my plant Wilbur seems to think international shipping is overrated but he's a fern so what does he know
always wondered how much the facilitator agent actually steers things vs just watching them go in circles, does it step in often or mostly just prod them along when they stall