Provider
AstronomerIncident detail
Capacity constraints in GCP us-central1 may delay or fail some task executions
Active incidentMinor1 affected service
Timeline window
Started
Get alerted the next time Astronomer breaks
Free email alerts for the handful of vendors you cannot afford to miss. No card, live in about a minute. Paid plans add Slack, Teams, Discord, and webhook delivery across your whole stack, plus higher API quotas.
Timeline
Incident updates
Every update on the official status source, oldest to newest, exactly as it appeared there.
Investigating
We are currently seeing a capacity shortage in the Google Cloud (GCP) `us-central1` region. As a result, some Deployments running in this region may experience delays when scaling up worker nodes and pods.
Some tasks may remain in a queued state for longer than usual while waiting for compute capacity. In some cases, tasks that stay queued beyond their configured timeout may fail.
Recommended workaround: Configuring automated task retries (for example, setting `retries` and a `retry_delay` on your tasks or in your DAG's `default_args`) will help tasks recover automatically once capacity becomes available. <https://www.astronomer.io/docs/learn/rerunning-dags#automatically-retry-tasks>
We are working to address the issue and keep this page posted as we have more updates.
Keep exploring
More from Astronomer
Neighboring incidents on Astronomer's timeline and the rest of their record on OutageDeck.