Datadog Status · History · Incident #342

RESOLVED

Notifications to Pagerduty, VictorOps, Slack, Webhook, Microsoft Teams and OpsGenie are not delivered

Major · Started Apr 10, 2026 · 10:54 AM

  • Duration

    6h 5m

  • Severity

    Major

  • Detection lead

  • User reports

Summary

Notifications to Pagerduty, VictorOps, Slack, Webhook, Microsoft Teams and OpsGenie are not delivered

Between approximately 9:42 AM and 10:38 AM ET on April 10, we observed delivery failures for customers in the US1, AP1, and AP2 regions. During this window, notifications to the following integrations were delayed or temporarily undelivered: • PagerDuty • Slack • Microsoft Teams • Webhooks • Jira • ServiceNow • OpsGenie • VictorOps • BigPanda • Zendesk • Sumologic All delayed notifications have been replayed with the following exceptions: PagerDuty pages and Slack notifications queued during the outage window were not replayed, as they were no longer actionable at the time of recovery. Webhook notifications will be reprocessed and delivered at a later date. No monitoring data was lost during this incident. Monitor evaluations continued normally — only the delivery of triggered notifications was affected. Thank you for your patience.


  • Started

    Apr 10, 2026 · 10:54 AM

  • Resolved

    Apr 10, 2026 · 4:59 PM

  • Duration

    6h 5m

  • Severity

    Major

Event timeline

How this incident unfolded

  • Investigating

    Apr 10 · 10:54 AM Datadog

    We are investigating an issue to send notifications to Pagerduty, VictorOps, Slack, Webhook, Microsoft Teams and OpsGenie.

  • Identified

    Apr 10 · 11:00 AM Datadog

    The issue has been identified and a fix is being implemented.

  • Identified

    Apr 10 · 11:23 AM Datadog

    We are continuing to work on a fix for this issue.

  • Identified

    Apr 10 · 11:42 AM Datadog

    New notifications are now successfully delivered, and we are catching-up on past notifications that may have been delayed.

  • Monitoring

    Apr 10 · 11:42 AM Datadog

    New notifications are now successfully delivered, and we are catching-up on past notifications that may have been delayed

  • Monitoring

    Apr 10 · 11:59 AM Datadog

    We are still catching-up on past notifications that may have been delayed.

  • Monitoring

    Apr 10 · 12:15 PM Datadog

    We are still catching-up on past notifications that may have been delayed.

  • Monitoring

    Apr 10 · 1:12 PM Datadog

    Notifications for Opsgenie, VictorOps, BigPanda, Zendesk, and Sumologic are caught up. Webhooks, Microsoft Teams, Slack, JIRA, and ServiceNow are still catching up.

  • Monitoring

    Apr 10 · 1:37 PM Datadog

    Notifications for JIRA are now caught up.

  • Monitoring

    Apr 10 · 2:33 PM Datadog

    Notifications for ServiceNow and Microsoft Teams are now caught up. Webhooks and Slack notifications are still catching up.

  • Monitoring

    Apr 10 · 3:02 PM Datadog

    Webhooks and Slack notifications are still catching up.

  • Monitoring

    Apr 10 · 3:44 PM Datadog

    Webhooks and Slack notifications are still catching up.

  • Monitoring

    Apr 10 · 4:13 PM Datadog

    Webhooks and Slack notifications are still catching up.

  • Resolved

    Apr 10 · 4:59 PM Datadog

    Between approximately 9:42 AM and 10:38 AM ET on April 10, we observed delivery failures for customers in the US1, AP1, and AP2 regions. During this window, notifications to the following integrations were delayed or temporarily undelivered: • PagerDuty • Slack • Microsoft Teams • Webhooks • Jira • ServiceNow • OpsGenie • VictorOps • BigPanda • Zendesk • Sumologic All delayed notifications have been replayed with the following exceptions: PagerDuty pages and Slack notifications queued during the outage window were not replayed, as they were no longer actionable at the time of recovery. Webhook notifications will be reprocessed and delivered at a later date. No monitoring data was lost during this incident. Monitor evaluations continued normally — only the delivery of triggered notifications was affected. Thank you for your patience.

Get alerted before the next Datadog outage.

Pulsetic catches degradations minutes before vendors acknowledge them.

Start monitoring free
Hey there 👋  Friends from designmodo are here to help!