{
  "meta": {
    "version": "v1",
    "pricing": {
      "public": {
        "label": "Public",
        "description": "Read-only API access for lightweight status checks and public integrations."
      },
      "premium": {
        "label": "Premium",
        "description": "API keys with higher hourly quotas, plus Slack, Teams, Discord, webhook, and email outage alerts across your vendor stack."
      }
    },
    "generatedAt": "2026-10-21T16:35:08.074Z"
  },
  "data": {
    "id": "incident_statuspage_harness_4dvdj496y422",
    "slug": "harness-intermittent-slowness-while-running-pipelines-2026-04-27",
    "title": "Intermittent slowness while running pipelines",
    "summary": "Intermittent slowness while running pipelines",
    "status": "resolved",
    "stale": false,
    "severity": "minor",
    "startedAt": "2026-04-27T22:27:11.221+00:00",
    "updatedAt": "2026-04-29T19:58:42.276+00:00",
    "resolvedAt": "2026-04-27T20:00:00+00:00",
    "provider": {
      "slug": "harness",
      "name": "Harness"
    },
    "affectedServices": [],
    "links": {
      "html": "/incidents/harness-intermittent-slowness-while-running-pipelines-2026-04-27",
      "api": "/api/v1/incidents/harness-intermittent-slowness-while-running-pipelines-2026-04-27",
      "providerHtml": "/providers/harness",
      "alerts": "https://outagedeck.com/account?stack=harness&utm_source=api&utm_medium=response&utm_campaign=api_alerts&utm_content=incident"
    },
    "impactSummary": "Harness reported this event with no impact level.",
    "source": {
      "id": "source_harness_status",
      "kind": "official_api",
      "name": "Harness Status",
      "checkedAt": "2026-10-21T16:30:12.084+00:00",
      "stale": false,
      "officialUrl": "https://status.harness.io",
      "statusPageUrl": "https://status.harness.io"
    },
    "updates": [
      {
        "id": "update_statuspage_harness_4dvdj496y422_zs9h9qlpv97h",
        "status": "resolved",
        "body": "We were seeing slowness while executing pipelines",
        "createdAt": "2026-04-27T22:27:11.282+00:00"
      },
      {
        "id": "update_statuspage_harness_4dvdj496y422_dky6t0lns7n0",
        "status": "resolved",
        "body": "## **Summary**\n\nOn April 27, 2026, customers running pipelines in the Prod3 environment experienced intermittent slowness in pipeline execution and delays in execution status updates in the UI.\n\nIt was caused by a unexpected spike causing contention on a backend database supporting pipeline orchestration. The issue was mitigated and fully resolved.\n\n## **Impact**\n\n**Incident window:** April 27, 2026, 1:00 PM – 3:12 PM PDT\n\n* Pipeline executions ran slower than normal; some executions took longer than expected to complete. For pipelines with stricter timeouts, there could be failures.\n* No widespread pipeline failures were observed\n* Execution view in the UI lagged behind real-time pipeline progress\n\nThere was no data loss. The majority of pipelines continued to execute successfully, with the primary impact being increased latency and delayed UI updates.\n\n## **Root Cause**\n\nPipeline orchestration relies on a backend database to track execution state and power the execution view in the UI.\n\nDuring the incident, we had a spike of  load, leading to increased query latency across the orchestration layer.This resulted in a backlog, causing UI updates to lag behind actual pipeline execution until the system was scaled.\n\n## **Remediation**\n\n**Immediate Mitigation**\n\n* Scaled up the affected database instance to increase CPU capacity\n* Reduced query latency and eliminated lock contention\n* Cleared the execution-view update backlog within ~30 minutes\n\nThese actions restored normal pipeline performance and UI responsiveness.\n\n## **Action Items**\n\nTo prevent such issues from happening again. \n\n* **Capacity Improvements:**Updated Prod3 capacity baseline to prevent similar resource constraints \n* **Proactive Detection:** Enhancing monitoring and alerting for backend resource utilization, lock contention, and critical query latency",
        "createdAt": "2026-04-29T19:53:55.898+00:00"
      }
    ],
    "access": {
      "plan": "public",
      "keyed": false
    }
  }
}