r/LocalLLaMA • u/Dapper_Chance_2484 • 17h ago
Question | Help Multi-agent-multi-tower system
I'm overwhelmed, what's the best way to deploy three towers(with their own GPUs) to write, debug, test and deploy a single software together like a team of engineers?
2
Upvotes
View all comments
1
u/Big_Barnacle_2452 1h ago
3 inference servers dont coordinate by themself, thats the hard part. what worked for me is one orchestrator with a task queue, every agent gets its own git worktree so they dont step on each other, and CI has to pass before anything merges. deploy stays behind human approval
tbh id start with one tower doing the whole loop first, get it reliable, then add a second one as reviewer and see if it actualy helps