Resolved incident

Issue with Experiment Results in case of Flag Variation edits

LaunchDarkly · Minor · Started

Duration
27h 50m
Severity
Minor
Status
Resolved

Summary

Minor · Resolved

We have validated a fix to resolve all remaining experiments with inaccurate sample ratio mismatches (SRMs) or empty experiment results. The vast majority of experiments and experimentation customers were not impacted.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Investigating

    LaunchDarkly

    We are aware of an issue affecting some customers that may result in sample ratio mismatches (SRMs) or empty experiment results if flag variations are edited between experiment iterations.

  2. Identified

    LaunchDarkly

    We've identified the issue and are implementing a fix for this behavior.

  3. Monitoring

    LaunchDarkly

    We've released a fix to prevent this issue in new experiments and iterations. We're working to resolve this issue for experiment data recently processed.

  4. Resolved

    LaunchDarkly

    We have validated a fix to resolve all remaining experiments with inaccurate sample ratio mismatches (SRMs) or empty experiment results. The vast majority of experiments and experimentation customers were not impacted.