Skip to content

Incident detail

CDC ClickPipes stuck in maintenance state

Resolved incidentMajor

Timeline window

to

Outage alerts

Get alerted the next time ClickHouse Cloud breaks

Free email alerts for up to 5 providers — no card, live in about a minute. Paid plans add Slack, Discord, and webhook delivery across your whole stack, plus higher API quotas.

Timeline

Incident updates

Updates are normalized from the official source chronology so timeline changes remain easy to scan.

  1. Investigating

    As part of our weekly upgrade process, CDC ClickPipes in `eu-central-1` became stuck in maintenance state. The team is working on a mitigation.

  2. Identified

    Services in `eu-central-1` have recovered. We're in the process of manually recovering ~20 services in other regions.

  3. Identified

    Most services have fully recovered. Continuing to roll out the fix to remaining 4 services (all in `eu-central-1`, `us-east-2`).

  4. Monitoring

    All services have recovered; we will continue monitoring the affected nodes and consolidating our findings. Please reach out to our support team to request access to the RCA, when available.

  5. Resolved

    The CDC ClickPipes upgrade rollout remains on hold while we confirm we can safely proceed without triggering the underlying pod networking failure mode that triggered the incident.