hard20 pts · first answer countsdistributed-systemsresilience
Outage that outlives its trigger
A 2-minute database failover caused errors. The database is healthy again, but the API stays overloaded for an hour, with most work spent on retries of requests whose clients already gave up. What is this, and what breaks the loop?
Discussion 0
Join free to post in the discussion.
Related questions
- Why add jitter to retries?Site Reliability Engineer
- Circuit breaker half-open stateSite Reliability Engineer
- Tail latency with fan-outSite Reliability Engineer
- Running a safe chaos experimentSite Reliability Engineer
- A hot cache key expiresSite Reliability Engineer
- Wasted work after timeoutsSite Reliability Engineer
- Two leaders after a GC pauseSite Reliability Engineer
- What to drop when overloadedSite Reliability Engineer