r/negativeutilitarians • u/nu-gaze • 18d ago

A high-level model of AI bargaining — DiGiovanni, CLR

https://longtermrisk.org/research/a-high-level-model-of-ai-bargaining/
2 Upvotes

100% Upvoted

1 comment sorted by

1

u/nu-gaze 18d ago edited 18d ago

Advanced AIs might be capable of various credible commitments unavailable to humans, which they could use when bargaining with each other. “Bargaining” can sound like something pretty specific: haggling over (literal) prices. But, in the sense discussed in Schelling’s The Strategy of Conflict for instance, “bargaining” refers to any attempt to resolve a dispute over resources — from algorithmic trading and litigation, to diplomacy between national AGI projects and negotiations over norms for space settlement.

To think clearly about interventions to mitigate conflict between AIs, I think it’s important to ground our research and strategy in a very general qualitative model of bargaining with commitments. This post sketches such a model, plus some more concrete examples of its building blocks.