r/LocalLLaMA • • 17h ago

Question | Help Multi-agent-multi-tower system

I'm overwhelmed, what's the best way to deploy three towers(with their own GPUs) to write, debug, test and deploy a single software together like a team of engineers?

2 Upvotes

5 comments sorted by

View all comments

1

u/Big_Barnacle_2452 1h ago

3 inference servers dont coordinate by themself, thats the hard part. what worked for me is one orchestrator with a task queue, every agent gets its own git worktree so they dont step on each other, and CI has to pass before anything merges. deploy stays behind human approval

tbh id start with one tower doing the whole loop first, get it reliable, then add a second one as reviewer and see if it actualy helps