Skip to content

Incident detail

Vault login errors - resolved

Resolved incidentCritical1 affected service

Timeline window

to

Get alerted the next time Keeper Security breaks

Free email alerts for the handful of vendors you cannot afford to miss. No card, live in about a minute. Paid plans add Slack, Teams, Discord, and webhook delivery across your whole stack, plus higher API quotas.

Timeline

Incident updates

Every update on the official status source, oldest to newest, exactly as it appeared there.

  1. Investigating

    We are investigating vault login errors

  2. Investigating

    We are continuing to investigate this issue.

  3. Resolved

    The issue has been resolved. The outage was caused by a high volume of database locks related to a large BreachWatch data update. The engineering team is tracking down the root cause and will be addressing a preventative solution today.

  4. Resolved

    At 8:15 AM PST, our DevOps team was alerted to elevated API error rates in production. Upon investigation, we identified the following:

    • The production database was experiencing high table lock contention.
    • This was triggered by several large-scale BreachWatch data updates.
    • A recent backend migration had unintentionally doubled the number of parallel update operations, which exacerbated the issue.
    • A database failover was performed to restore service stability.

    The issue was fully resolved by 8:40 AM PST. The engineering team has addressed the underlying problem in the update processes and is implementing safeguards to prevent recurrence, including query optimization and improved job orchestration.

    We apologize for the disruption.

Keep exploring

More from Keeper Security

Neighboring incidents on Keeper Security's timeline and the rest of their record on OutageDeck.