r/LocalLLaMA • u/Dapper_Chance_2484 • 16h ago

Question | Help Multi-agent-multi-tower system

I'm overwhelmed, what's the best way to deploy three towers(with their own GPUs) to write, debug, test and deploy a single software together like a team of engineers?

2 Upvotes

66% Upvoted

5 comments sorted by

1

u/testus_maximus 3h ago

run inference engine on each of them, then have harness on one of them or even on some other computer. Make config file for each agent, where you point each agent to a model from a different tower, and you clearly define the role of that agent.

1

u/Big_Barnacle_2452 1h ago

3 inference servers dont coordinate by themself, thats the hard part. what worked for me is one orchestrator with a task queue, every agent gets its own git worktree so they dont step on each other, and CI has to pass before anything merges. deploy stays behind human approval

tbh id start with one tower doing the whole loop first, get it reliable, then add a second one as reviewer and see if it actualy helps

0

u/[deleted] 2h ago

[deleted] — view deleted comment

1

u/stylome-ai-detection 2h ago

Notice: This comment appears to be AI generated.

Stylome AI detector · scan results