Ingestion and query issues for logs, spans, traces in US

Summary

Ingestion and query issues for logs, spans, traces in US

Data is now processed live and the system are fully operational.

• Started

  Jun 30, 2026 · 9:16 PM

• Resolved

  Jul 1, 2026 · 10:00 AM

• Duration

  12h 43m

• Severity

  None

• ◐

  Investigating

  Jun 30 · 9:16 PM Sentry

  We are currently investigating the issue

• ◐

  Investigating

  Jun 30 · 9:42 PM Sentry

  We continue to investigate the issue. Ingestion delays are around 40 minutes now.

• ◐

  Investigating

  Jun 30 · 10:50 PM Sentry

  We continue to investigate the issue

• ◐

  Investigating

  Jun 30 · 11:31 PM Sentry

  We continue to investigate the issue.

• ◐

  Investigating

  Jul 1 · 12:27 AM Sentry

  Our database is stabilized. We are attempting a fix to increase the ingestion rate.

• ◐

  Investigating

  Jul 1 · 1:29 AM Sentry

  Our ingestion fix was not successful. We are continuing to investigate possible solutions

• ◐

  Investigating

  Jul 1 · 2:25 AM Sentry

  We are attempting additional mitigations to restore ingestion for logs, spans, and traces in the US

• ◉

  Monitoring

  Jul 1 · 3:30 AM Sentry

  We are currently burning down the ingestion backlog, and estimate that it will be complete by 2AM PT 2026-07-01.

• ◉

  Monitoring

  Jul 1 · 4:26 AM Sentry

  We continue to monitor the situation

• ◉

  Monitoring

  Jul 1 · 5:22 AM Sentry

  We continue to monitor the situation

• ◉

  Monitoring

  Jul 1 · 6:14 AM Sentry

  We continue to monitor the fix. Ingestion is around 45 minutes behind and improving. APIs and dashboards are functioning normally (outside of data waiting to be ingested).

• ✓

  Resolved

  Jul 1 · 10:00 AM Sentry

  Data is now processed live and the system are fully operational.