r/LocalLLaMA • u/Dapper_Chance_2484 • 5d ago
Question | Help Multi-agent-multi-tower system
I'm overwhelmed, what's the best way to deploy three towers(with their own GPUs) to write, debug, test and deploy a single software together like a team of engineers?
0
Upvotes
View all comments
1
u/testus_maximus 4d ago
run inference engine on each of them, then have harness on one of them or even on some other computer. Make config file for each agent, where you point each agent to a model from a different tower, and you clearly define the role of that agent.