API unavailable and higher % of unknown results

Summary

API unavailable and higher % of unknown results

This incident has been fully resolved.

• Started

  Jul 27, 2023 · 1:10 AM

• Resolved

  Jul 27, 2023 · 8:50 AM

• Duration

  7h 40m

• Severity

  Major

• ◐

  Investigating

  Jul 27 · 1:10 AM Bouncer

  From 6PM UTC Bouncer's API rest endpoints returned response 503 Service Unavailable for most of the requests. Results were also affected returning higher % of unknown statuses during that time. Our team is investigating the issue.

• ◉

  Monitoring

  Jul 27 · 1:28 AM Bouncer

  Root cause has been found and eliminated. Our team will continue to monitor situation and take steps to prevent such events in the future. DNS misconfiguration caused unusually high load on our API which in turn caused it's failures. This problem has been fixed.

• ✓

  Resolved

  Jul 27 · 8:50 AM Bouncer

  This incident has been fully resolved.