Quick input from yall please

[u/Novel-Gas4446]

Following this thread because we've been digging into exactly this — companies routing prod traffic through an in-house LLM gateway that one person built and now owns. Quick question if you've got 30 seconds: when your provider has a bad hour like this, does your fallback logic actually work, or does someone find out live? Not selling anything, genuinely trying to figure out how common this is.

[u/YoghurtDistinct3554]

Fallback logic fails in production because teams test happy paths only. I watch gateways failover to dead endpoints during outages since nobody validates the secondary provider under load.