Astro Status · History · Incident #144981

RESOLVED

Capacity constraints in GCP us-central1 may delay or fail some task executions

Minor · Started Oct 6, 2026 · 3:33 AM

  • Duration

    7d 21h

  • Severity

    Minor

  • Detection lead

    —

  • User reports

    —

Summary

Capacity constraints in GCP us-central1 may delay or fail some task executions

We have seen improved capacity in the GCP us-central1 region across additional machine types, and error rates for worker node and pod scale-up have dropped. If any tasks failed during this incident, you can clear and rerun them. To recover automatically from future capacity constraints, we recommend setting `retries` and `retry_delay` on your tasks or in `default_args`. If you’re still seeing issues, please contact Astronomer Support.


  • Started

    Oct 6, 2026 · 3:33 AM

  • Resolved

    Oct 14, 2026 · 12:34 AM

  • Duration

    7d 21h

  • Severity

    Minor

Event timeline

How this incident unfolded

  • ◐

    Investigating

    Oct 6 · 3:33 AM Astro

    We are currently seeing a capacity shortage in the Google Cloud (GCP) `us-central1` region. As a result, some Deployments running in this region may experience delays when scaling up worker nodes and pods. Some tasks may remain in a queued state for longer than usual while waiting for compute capacity. In some cases, tasks that stay queued beyond their configured timeout may fail. **Recommended workaround:** Configuring automated task retries (for example, setting `retries` and a `retry_delay` on your tasks or in your DAG's `default_args`) will help tasks recover automatically once capacity becomes available. <https://www.astronomer.io/docs/learn/rerunning-dags#automatically-retry-tasks> We are working to address the issue and keep this page posted as we have more updates.

  • ✓

    Resolved

    Oct 14 · 12:34 AM Astro

    We have seen improved capacity in the GCP us-central1 region across additional machine types, and error rates for worker node and pod scale-up have dropped. If any tasks failed during this incident, you can clear and rerun them. To recover automatically from future capacity constraints, we recommend setting `retries` and `retry_delay` on your tasks or in `default_args`. If you’re still seeing issues, please contact Astronomer Support.

Get an email when Astro opens, updates or resolves an incident.

Add it as a dependency monitor. The Free plan includes one.