HTTP status
504 api_error
Typical cause
The upstream provider did not respond within the deadline for this request.Resolution
Setgateway.routing.timeout_ms to allow more time per attempt. For fallback chains, also set gateway.routing.deadline_ms to extend the overall request budget. You can also retry with backoff, reduce prompt or output size, or try a faster model.