Skip to content

Incident detail

Resolved: KeeperPAM Connection Errors in US Data Center

Resolved incidentMajor

Timeline window

to

Outage alerts

Get alerted the next time Keeper Security breaks

Free email alerts for up to 5 providers — no card, live in about a minute. Paid plans add Slack, Discord, and webhook delivery across your whole stack, plus higher API quotas.

Timeline

Incident updates

Updates are normalized from the official source chronology so timeline changes remain easy to scan.

  1. Identified

    We have identified an issue causing KeeperPAM connection errors in the US Data Center. It will be resolved shortly.

  2. Resolved

    The issue has been resolved. We will update the ticket with additional details shortly.

  3. Resolved

    At 11:08 AM PST, DevOps and customers reported sporadic error messages occurring after login for KeeperPAM customers with connections and tunnels enabled. While vault login itself was not affected, the errors were triggered asynchronously after login due to a communication issue with the KeeperPAM router endpoint.

    Further investigation determined that a "scheduler" database within the AWS RDS environment - used for certain PAM scheduling operations - was encountering an unexpected error. The operations team resolved the underlying database issue and restarted the affected services.

    This scheduler service was inadvertently impacting connection establishment. To prevent similar issues in the future, we will be implementing software changes to ensure that scheduling-related errors cannot affect connection functionality.

    Additional monitoring and alerting have also been implemented for the scheduler databases to help detect and prevent similar issues going forward.

    Full service for connection and tunneling capabilities was restored by 11:40 AM PST.