{
  "meta": {
    "version": "v1",
    "pricing": {
      "public": {
        "label": "Public",
        "description": "Read-only API access for lightweight status checks and public integrations."
      },
      "premium": {
        "label": "Premium",
        "description": "API keys with higher hourly quotas, plus Slack, Discord, webhook, and email outage alerts across your vendor stack."
      }
    },
    "generatedAt": "2026-07-13T12:17:39.041Z"
  },
  "data": {
    "id": "incident_statuspage_upstash_45rxy9q1zzc2",
    "slug": "upstash-qstash-eu-region-degraded-performance-2026-06-23",
    "title": "QStash EU Region — Degraded Performance",
    "summary": "QStash EU Region — Degraded Performance",
    "status": "resolved",
    "severity": "minor",
    "startedAt": "2026-06-23T16:22:25.848+00:00",
    "updatedAt": "2026-06-24T12:30:46.041+00:00",
    "resolvedAt": "2026-06-23T17:14:46.066+00:00",
    "provider": {
      "slug": "upstash",
      "name": "Upstash"
    },
    "affectedServices": [],
    "links": {
      "html": "/incidents/upstash-qstash-eu-region-degraded-performance-2026-06-23",
      "api": "/api/v1/incidents/upstash-qstash-eu-region-degraded-performance-2026-06-23",
      "providerHtml": "/providers/upstash"
    },
    "impactSummary": "Upstash reported a minor event for the affected tracked services.",
    "source": {
      "id": "source_upstash_status",
      "kind": "official_api",
      "name": "Upstash Status",
      "checkedAt": "2026-07-13T12:15:02.81+00:00",
      "officialUrl": "https://status.upstash.com",
      "statusPageUrl": "https://status.upstash.com"
    },
    "updates": [
      {
        "id": "update_statuspage_upstash_45rxy9q1zzc2_4bzdvcnp9hwj",
        "status": "investigating",
        "body": "We are currently investigating this issue.",
        "createdAt": "2026-06-23T16:22:25.945+00:00"
      },
      {
        "id": "update_statuspage_upstash_45rxy9q1zzc2_r5c4b1q9ctzs",
        "status": "monitoring",
        "body": "A fix has been implemented and we are monitoring the results.",
        "createdAt": "2026-06-23T16:32:26.385+00:00"
      },
      {
        "id": "update_statuspage_upstash_45rxy9q1zzc2_q6bc0sh7ck1g",
        "status": "resolved",
        "body": "This incident has been resolved.",
        "createdAt": "2026-06-23T17:14:46.066+00:00"
      },
      {
        "id": "update_statuspage_upstash_45rxy9q1zzc2_mvt74vrrtglw",
        "status": "resolved",
        "body": "### **Summary**\n\nOn June 23, 2026, QStash users in the EU-CENTRAL-1 region experienced elevated latency and degraded performance. The issue was caused by a regression introduced in a recent enhancement to Flow Control scheduling logic. The change increased resource consumption under load, leading to reduced performance on affected shards. The incident was resolved by rolling back to the previous stable version.\n\n### **Impact**\n\n* Service: QStash \\(EU-CENTRAL-1\\)\n* Start: 2026-06-23 16:22 UTC\n* Resolved: 2026-06-23 17:14 UTC\n* Duration: ~52 minutes\n* Impact: Increased latency and degraded performance for workloads routed to the affected instance in the EU. Multiple customers in the region experienced slower request processing during the incident window.\n\n### **Root Cause**\n\nWe recently deployed an enhancement to our Flow Control feature, designed to improve fairness between independent flow controls when unused global parallelism capacity was available.\n\nUnder production load, the new behavior introduced a regression that significantly increased resource utilization. The elevated resource consumption caused performance degradation on the affected QStash instamce, impacting all workloads sharing that instance.\n\n### **Resolution**\n\nAfter identifying the regression as the source of the slowdown, we rolled back the deployment to the last known stable version.\n\n* Rollback completed: 2026-06-23 19:18:46.84 UTC\n\nFollowing the rollback, system performance returned to normal levels and service stability was restored.\n\n### **Preventive Actions**\n\nTo reduce the likelihood of similar incidents in the future, we are taking the following actions:\n\n* Expand performance and load testing coverage for Flow Control changes.\n* Add resource utilization regression checks to the deployment pipeline.\n* Improve monitoring and alerting for abnormal CPU and memory consumption patterns.\n* Introduce additional canary validation before wider production rollout of scheduler-related changes.\n\nWe apologize for the disruption and appreciate our customers’ patience while we resolved the issue.",
        "createdAt": "2026-06-24T12:28:36.538+00:00"
      }
    ],
    "access": {
      "plan": "public",
      "keyed": false
    }
  }
}