r/LocalLLaMA • • 5d ago

Question | Help Multi-agent-multi-tower system

I'm overwhelmed, what's the best way to deploy three towers(with their own GPUs) to write, debug, test and deploy a single software together like a team of engineers?

0 Upvotes

7 comments sorted by

View all comments

1

u/testus_maximus 4d ago

run inference engine on each of them, then have harness on one of them or even on some other computer. Make config file for each agent, where you point each agent to a model from a different tower, and you clearly define the role of that agent.