[INC-1145] Service degradation of multiple PoPs

We have identified an issue affecting the XSP (Singapore) PoP. Customers may experience increased latency, Error 20 responses, and connectivity impacts related to GRE tunnels.

Our teams are actively investigating the issue and working to determine the scope, impact, and root cause. We will provide further updates as soon as additional information becomes available.

The next update will not be later than 08:10am UTC

We have implemented corrective actions and service has returned to normal operation. The affected GRE tunnels have been successfully re-established, and traffic is flowing as expected across the previously impacted locations.

Customers should no longer experience the increased latency or Error 20 responses previously observed. We are continuing to monitor the environment closely to ensure stability.

We have identified an issue affecting multiple network locations (PoPs). Customers may experience increased latency, encounter Error 20 responses, and may be impacted by GRE tunnel connectivity issues.

Our engineering teams are actively investigating the issue to determine the full scope, impact, and underlying cause. We are working to restore normal service as quickly as possible and will provide updates as more information becomes available.

We have restored traffic flow across all previously affected PoPs, and GRE tunnel connectivity has been re-established. Traffic is currently routing as expected.

While service has stabilized, our engineering teams remain actively engaged in investigating the underlying cause of the issue and monitoring the environment closely. Customers may have experienced increased latency, Error 20 responses, or GRE tunnel connectivity issues during the period of impact.

We will continue to provide updates as our investigation progresses - the next update will be no later than 09:09 UTC

We continue to observe stable operations across the previously affected PoPs, with no further signs of impact at this time.

Engineering teams remain engaged and are closely monitoring the environment while the investigation into the underlying cause continues. We will provide a final update once monitoring activities have been completed.

The issue affecting multiple PoPs has been resolved. Services have recovered, and GRE tunnel connectivity has been restored across the impacted locations. Customers should no longer experience elevated latency or Error 20 responses related to this event.

Our teams have validated service recovery and continue to monitor the environment to ensure ongoing stability.