Skip to content
OutageDeck

Incident detail

Issue with Experiment Results in case of Flag Variation edits

Issue with Experiment Results in case of Flag Variation edits

Resolved incidentMinor0 affected services

Timeline window

to

Timeline

Incident updates

Updates are normalized from the official source chronology so timeline changes remain easy to scan.

  1. Investigating

    We are aware of an issue affecting some customers that may result in sample ratio mismatches (SRMs) or empty experiment results if flag variations are edited between experiment iterations.

  2. Identified

    We've identified the issue and are implementing a fix for this behavior.

  3. Monitoring

    We've released a fix to prevent this issue in new experiments and iterations. We're working to resolve this issue for experiment data recently processed.

  4. Resolved

    We have validated a fix to resolve all remaining experiments with inaccurate sample ratio mismatches (SRMs) or empty experiment results. The vast majority of experiments and experimentation customers were not impacted.