Increased 500 errors

Summary

Increased 500 errors

Between Sept 3 03:40 UTC and Sept 3 08:30 UTC Loops experienced a period of elevated error rates where API requests intermittently returned 500’s due to high CPU use on our primary database. We resolved the issue and additionally made monitoring and process changes to speed responses in the future.

• Started

  Sep 3, 2025 · 8:14 AM

• Resolved

  Sep 3, 2025 · 8:44 AM

• Duration

  30m

• Severity

  Major

• ◐

  Investigating

  Sep 3 · 8:14 AM Loops

  We are currently investigating this issue.

• ◆

  Identified

  Sep 3 · 8:33 AM Loops

  The issue has been identified and a fix is being implemented.

• ◉

  Monitoring

  Sep 3 · 8:38 AM Loops

  A fix has been implemented and we are monitoring the results.

• ✓

  Resolved

  Sep 3 · 8:44 AM Loops

  This incident has been resolved.

• ✓

  Postmortem

  Sep 4 · 2:00 PM Loops

  Between Sept 3 03:40 UTC and Sept 3 08:30 UTC Loops experienced a period of elevated error rates where API requests intermittently returned 500’s due to high CPU use on our primary database. We resolved the issue and additionally made monitoring and process changes to speed responses in the future.