Can a fallback change where an AI prompt goes?

Test gateway failover and application retries together before enabling a new model provider.

A gateway can reject a request exactly as configured while an agent framework catches the error and sends the same conversation to another service. Reviewing the gateway alone misses the second path.

Exercise an outage without customer data

Point a staging workflow at an unavailable approved route. Give the request a unique, nonsecret trace ID. Compare outgoing application requests with the user-visible result. If a second destination appears, locate the retry owner and configure an approved destination or an explicit failure before repeating the test.

Open the TrustedRouter migration guide · How to roll out an OpenRouter replacement without sending prompts twice