Outage impacting email links and Deadline Funnel appearing on websites

Summary

Outage impacting email links and Deadline Funnel appearing on websites

From 9:18am EST to 10:18am EST on 7/28/21, one of our API services experienced an outage. This caused almost all requests to fail that were related to Deadline Funnel email links or Deadline Funnel appearing on a campaign page. The root cause appears to have been a feature flag that was enabled for a user that triggered an edge case and resulted in significant load on our database. We apologize for this issue, and are continuing to work on updates to prevent this from happening again in the future.

• Started

  Jul 28, 2021 · 1:15 PM

• Resolved

  Jul 28, 2021 · 1:15 PM

• Duration

  < 1m

• Severity

  Critical

• ✓

  Resolved

  Jul 28 · 2:58 PM Deadline Funnel

  From 9:18am EST to 10:18am EST on 7/28/21, one of our API services experienced an outage. This caused almost all requests to fail that were related to Deadline Funnel email links or Deadline Funnel appearing on a campaign page. The root cause appears to have been a feature flag that was enabled for a user that triggered an edge case and resulted in significant load on our database. We apologize for this issue, and are continuing to work on updates to prevent this from happening again in the future.