{ "meta": { "version": "v1", "pricing": { "public": { "label": "Public", "description": "Read-only API access for lightweight status checks and public integrations." }, "premium": { "label": "Premium", "description": "API keys with higher hourly quotas, plus Slack, Teams, Discord, webhook, and email outage alerts across your vendor stack." } }, "generatedAt": "2026-11-04T04:31:53.138Z" }, "data": { "id": "incident_statuspage_neo4j_kjx6l7442j2v", "slug": "neo4j-potential-unexpected-query-failures-2026-08-05", "title": "Potential unexpected query failures.", "summary": "Potential unexpected query failures.", "status": "resolved", "stale": false, "severity": "minor", "startedAt": "2026-08-05T17:31:11.689+00:00", "updatedAt": "2026-11-03T17:11:46.301+00:00", "resolvedAt": "2026-08-07T15:34:37.846+00:00", "provider": { "slug": "neo4j", "name": "Neo4j Aura" }, "affectedServices": [ { "slug": "neo4j-auradb", "name": "AuraDB" }, { "slug": "neo4j-aurads", "name": "Graph Data Science" } ], "links": { "html": "/incidents/neo4j-potential-unexpected-query-failures-2026-08-05", "api": "/api/v1/incidents/neo4j-potential-unexpected-query-failures-2026-08-05", "providerHtml": "/providers/neo4j", "alerts": "https://outagedeck.com/account?stack=neo4j&utm_source=api&utm_medium=response&utm_campaign=api_alerts&utm_content=incident" }, "impactSummary": "Neo4j Aura reported a minor event for the affected tracked services.", "source": { "id": "source_neo4j_status", "kind": "official_api", "name": "Neo4j Aura Status", "checkedAt": "2026-11-04T04:30:11.557+00:00", "stale": false, "officialUrl": "https://status.neo4j.io", "statusPageUrl": "https://status.neo4j.io" }, "updates": [ { "id": "update_statuspage_neo4j_kjx6l7442j2v_4klqyf7m4jr7", "status": "investigating", "body": "We have identified an issue currently that could result in unexpected query failures when using the trim() Cypher function. Investigations into the cause are in progress.", "createdAt": "2026-08-05T17:31:11.999+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_ryt50cwrh4q3", "status": "identified", "body": "We have found the issue and are working on a fix. A small percentatge of queries using trim may still err. \n\nVDC customers with databases set to highest are not impacted at all unless they pause and start their instances.", "createdAt": "2026-08-05T19:27:35.607+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_327z82h24wx4", "status": "identified", "body": "We are testing the fix for the trim() Cypher function issue. We will update before we begin our deployment into the Aura environment.", "createdAt": "2026-08-06T00:58:33.125+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_k00036tjgt99", "status": "identified", "body": "We are actively validating the fix for the trim() Cypher function. Further updates will be provided before we begin deploying to Aura instances", "createdAt": "2026-08-06T07:13:49.272+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_2qx3tm7mksc4", "status": "identified", "body": "We continue to validate the fix for the trim() Cypher function.\nFurther updates will be provided before we begin deploying it to Aura instances.", "createdAt": "2026-08-06T07:39:38.615+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_1b512zv6tmsg", "status": "identified", "body": "We continue to validate the fix for the trim() Cypher function.\nFurther updates will be provided before we begin deploying it to Aura instances.", "createdAt": "2026-08-06T11:17:37.568+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_n3p3593n708y", "status": "identified", "body": "The fix for the trim() Cypher function is undergoing testing and validation before deployment.\nFurther updates will be provided before we begin deploying it to Aura instances.", "createdAt": "2026-08-06T14:54:51.25+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_gxbsktvq88pz", "status": "identified", "body": "Development has completed on the hot-fix for this issue, and we are finalizing the rollout plan for Aura.", "createdAt": "2026-08-07T01:15:22.551+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_k96dn2yj4psl", "status": "identified", "body": "We are actively working on addressing the issue. The fix for the trim() Cypher function is undergoing testing and validation currently before deployment. Further updates will be provided before we begin deploying it to Aura instances.", "createdAt": "2026-08-07T01:16:59.775+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_5p2qr68kg3dy", "status": "identified", "body": "The fix to the trim() Cypher function has passed testing and validation and is now being deployed.", "createdAt": "2026-08-07T09:44:28.158+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_smx73hq2ctfh", "status": "monitoring", "body": "The fix to resolve the issue has now completed deployment to the Aura service and we are monitoring the situation.", "createdAt": "2026-08-07T13:49:26.301+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_73xx3qt7p4vk", "status": "resolved", "body": "We have monitored the fix and found the service to be stable. This incident is now considered resolved.", "createdAt": "2026-08-07T15:34:37.846+00:00" }, { "id": "update_statuspage_neo4j_kjx6l7442j2v_fmb9thyx8g1s", "status": "resolved", "body": "# What happened\n\nOn Wed, 05 Aug 2026 02:10:00 UTC, the latest version of Neo4j core product was rolled out to the Aura Environment. This release contained a bug in the Cypher `trim()` family of functions \\(`trim`, `ltrim`, `rtrim`, `btrim`\\) that incorrectly handled string length encoding during write operations.\n\nThe defect could produce two outcomes when a query using these functions modified stored string data:\n\n* **Query failure** — the operation would error and no data was written.\n* **Silent data issue** — the operation would succeed, but the stored string's length metadata could be recorded incorrectly, potentially resulting in trailing whitespace padding.\n\nThe issue was identified on Wed, 05 Aug 2026 17:51:51 UTC after alerting surfaced read-back failures on a single free-tier database. Our engineering team immediately reverted the introducing code change and began preparing a hot-fixed release. The patched version was rolled out across the affected tiers by Fri, 07 Aug 2026 16:02:49 UTC, and an on-premises patch was also published. A customer-facing status page was maintained throughout at [https://status.neo4j.io/incidents/kjx6l7442j2v](https://status.neo4j.io/incidents/kjx6l7442j2v).\n\n# How the service was affected\n\nThe impact was limited to Aura databases running Neo4j version 2026.07.0-8 that executed write queries using `trim()`-family Cypher functions during the exposure window.\n\n* **Query failures**: A small but measurable increase in query errors was observed for transactions involving `trim()`. These failed queries did not persist any data changes.\n* **Trailing whitespace**: In some cases, successful writes stored string values with incorrect trailing whitespace. Through systematic scanning, our team identified a number database instances that showed evidence of this issue.\n* **Unreadable properties**: In one case, a property on a free-tier database instance became unreadable. The systematic scan established that this only occurred once across the whole platform.\n\nLog analysis determined that a small number of database instances across several organizations may have executed potentially affected write queries.\n\nOur engineering team proactively contacted administrators and owners of affected organizations, provided per-database instance diagnostic reports offering guidance on identifying and remediating impacted data. No widespread unreadable-data corruption was found during the fleet-wide consistency and whitespace scans conducted after the fix was deployed.\n\n# What we are doing now\n\nWe take data integrity seriously and have undertaken a thorough response to ensure affected customers are supported and to reduce the likelihood of similar issues in the future. Our efforts fall into the following areas:\n\n* **Immediate fix** — The code change responsible for the defect was reverted and a patched release was deployed across all affected Aura tiers. An on-premises patch was also published for self-managed users.\n* **Proactive customer outreach** — We identified potentially affected databases through log analysis and ran two rounds of offline scans: consistency checks for unreadable-data corruption, and a purpose-built scanner for trailing-whitespace issues. Per-database diagnostic reports were generated and made available, and affected customers were directly notified with guidance.\n* **Detection improvements** — We are evaluating enhanced monitoring for per-function error rates in query processing, which could help surface similar issues earlier during staged rollouts.\n* **Rollout process review** — We are examining our rollout procedures, including whether to introduce additional triage windows between rollout phases and how to prevent databases from inadvertently advancing to newer versions during operations like pause/resume.\n* **Ongoing follow-ups** — Unrelated storage inconsistencies discovered during scans have been tracked and are being addressed by our engineering team through separate work streams.", "createdAt": "2026-11-03T17:11:30.333+00:00" } ], "access": { "plan": "public", "keyed": false } } }