Skip to content

Incident detail

Keeper API website load time and API errors in US region

Resolved incidentCritical1 affected service

Timeline window

to

Get alerted the next time Keeper Security breaks

Free email alerts for the handful of vendors you cannot afford to miss. No card, live in about a minute. Paid plans add Slack, Teams, Discord, and webhook delivery across your whole stack, plus higher API quotas.

Timeline

Incident updates

Every update on the official status source, oldest to newest, exactly as it appeared there.

  1. Investigating

    We are currently investigating reports of slow server response times and request timeouts

  2. Identified

    Root cause has been identified and we are actively working on a resolution.

  3. Monitoring

    A resolution has been rolled out - the team is monitoring system performance.

  4. Monitoring

    We are continuing to monitor for any further issues.

  5. Resolved

    This incident has been resolved.

  6. Resolved

    On Tues, Sept 24 at 6:06AM PDT, the DevOps Engineering team started receiving notifications regarding API slowness and HTTP 504 errors coming from the Keeper AWS infrastructure. After an investigation, it was determined that our NGINX instances were throwing the errors due to an overload of network traffic. It was then determined that the network traffic increase was caused by an update to the Keeper Desktop application which was published on Monday, the day before. The DevOps team scaled the AWS infrastructure several times over the period of 60 minutes to address the issue. The issue was fully stabilized and resolved by 7:20AM PDT.

    After a full analysis of the product update process, the engineering team has decided to change the update mechanism of the Keeper Desktop application to utilize a new distributed content delivery network which does not impact the other Keeper AWS infrastructure. This change will be implemented over the next 2 weeks and in preparation of the next Keeper Desktop application update.

Keep exploring

More from Keeper Security

Neighboring incidents on Keeper Security's timeline and the rest of their record on OutageDeck.