Skip to content

Incident detail

Issues with webhook deliveries

Webhook delivery failures have subsided in logs, and customer reports indicate no further errors. This incident is considered resolved.

Resolved incidentMinor1 affected service

Timeline window

to

Get alerted the next time GitLab breaks

Free email alerts for the handful of vendors you cannot afford to miss. No card, live in about a minute. Paid plans add Slack, Teams, Discord, and webhook delivery across your whole stack, plus higher API quotas.

Timeline

Incident updates

Every update on the official status source, oldest to newest, exactly as it appeared there.

  1. Investigating

    We are investigating reports of webhook deliveries from GitLab.com originating from IP addresses outside our documented ranges. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22637.

  2. Investigating

    We are investigating reports of webhook deliveries from GitLab.com originating from IP addresses outside our documented ranges. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22637.

  3. Investigating

    Our investigation is ongoing. We will provide another update by 21:00 UTC.

  4. Investigating

    Our investigation is ongoing. We will provide another update by 21:00 UTC.

  5. Identified

    We've traced the issue to a recent network change and are preparing a fix. Another update will be provided by 23:00 UTC.

  6. Identified

    We've traced the issue to a recent network change and are preparing a fix. Another update will be provided by 23:00 UTC.

  7. Identified

    Deployment of the fix is progressing steadily. Another update will be provided once deployed. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22637.

  8. Identified

    Deployment of the fix is progressing steadily. Another update will be provided once deployed. Details in https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/22637.

  9. Monitoring

    A fix has been deployed and checks have confirmed that unexpected IP addresses are no longer being used.

  10. Monitoring

    A fix has been deployed and checks have confirmed that unexpected IP addresses are no longer being used.

  11. Resolved

    Webhook delivery failures have subsided in logs, and customer reports indicate no further errors. This incident is considered resolved.

Keep exploring

More from GitLab

Neighboring incidents on GitLab's timeline and the rest of their record on OutageDeck.