Incident with GraphQL API Requests

Summary

Incident with GraphQL API Requests

On August 11, 2026, between 14:00 UTC and 16:00 UTC the GraphQL API service was degraded and customers in saw higher than normal timeouts. On average, the timeout rate was 0.06% and peaked at 0.14% of requests routing to the service. <br /><br />This was due to increased utilization at one of our sites which caused resource contention across our dependencies, leading to an increase in timeouts for GraphQL requests. We mitigated the incident by increasing capacity to alleviate the capacity bottleneck. <br /><br />We are working to improve our monitoring so that we can proactively reduce the impact of high consumption requests in addition to scaling up; Additionally, we will improve our time to detection and mitigation of issues like this one in the future.

• Started

  Aug 11, 2026 · 2:50 PM

• Resolved

  Aug 11, 2026 · 8:06 PM

• Duration

  5h 16m

• Severity

  Minor

• ◐

  Investigating

  Aug 11 · 2:50 PM GitHub

  We are investigating reports of degraded performance for API Requests

• ◐

  Investigating

  Aug 11 · 3:28 PM GitHub

  We are investigating reports of a small increase in error rates affecting GraphQL API requests. We are working on increasing capacity and continue to investigate the increased errors. We will provide another update when we have more information

• ◐

  Investigating

  Aug 11 · 4:49 PM GitHub

  We have returned to a healthy baseline on GraphQL API requests. We will continue to work on investigations into the errors seen during this incident.

• ◉

  Monitoring

  Aug 11 · 4:49 PM GitHub

  The degradation affecting API Requests has been mitigated. We are monitoring to ensure stability.

• ◉

  Monitoring

  Aug 11 · 8:06 PM GitHub

  We have identified and mitigated increased error rates affecting GraphQL API requests. A fix to increase service capacity has been deployed and error rates have returned to normal levels. We are resolving this incident.

• ✓

  Resolved

  Aug 11 · 8:06 PM GitHub

  On August 11, 2026, between 14:00 UTC and 16:00 UTC the GraphQL API service was degraded and customers in saw higher than normal timeouts. On average, the timeout rate was 0.06% and peaked at 0.14% of requests routing to the service. <br /><br />This was due to increased utilization at one of our sites which caused resource contention across our dependencies, leading to an increase in timeouts for GraphQL requests. We mitigated the incident by increasing capacity to alleviate the capacity bottleneck. <br /><br />We are working to improve our monitoring so that we can proactively reduce the impact of high consumption requests in addition to scaling up; Additionally, we will improve our time to detection and mitigation of issues like this one in the future.