Resolved incident

Elevated listener latency and error rate impacting Studio loading

Sanity · Critical · Started

Duration
4h 34m
Severity
Critical
Status
Resolved

Summary

Critical · Resolved

This incident has been resolved.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Investigating

    Sanity

    We are currently investigating an issue where elevated listener latency may result in slower performance and lag within Sanity Studio for a subset of customers. Our team is actively working to identify the root cause and mitigate the impact. Issue starting around 9:10 UTC.

  2. Investigating

    Sanity

    We are continuing to investigate this issue.

  3. Investigating

    Sanity

    We are currently continuing to investigate the issue, while also rolling out mitigations.

  4. Investigating

    Sanity

    We are continuing to investigate the issue. Additionally, there might be a slight delay in document publishes for "scheduled publishing" functionality.

  5. Investigating

    Sanity

    We are currently continuing to investigate the issue, while also preparing to roll a set of mitigations.

  6. Investigating

    Sanity

    We are continuing to investigate this issue.

  7. Investigating

    Sanity

    We are continuing to investigate this issue.

  8. Investigating

    Sanity

    We're continuing to investigate this issue. In the meantime, we've begun rolling out preliminary measures to mitigate its impact.

  9. Investigating

    Sanity

    We're continuing to investigate this issue. And we are continuing rolling out preliminary measures to mitigate its impact.

  10. Investigating

    Sanity

    We're continuing to investigate this issue. And we are continuing rolling out measures to mitigate its impact. "scheduled publishing" functionality confirmed unaffected by this incident.

  11. Investigating

    Sanity

    We're continuing to investigate this issue. And we are continuing rolling out measures to mitigate its impact.

  12. Investigating

    Sanity

    We're continuing to investigate this issue. And we are continuing to apply measures to mitigate its impact.

  13. Identified

    Sanity

    The issue has been identified. We are continuing to apply fixes to mitigate its impact.

  14. Identified

    Sanity

    We are continuing to apply fixes to mitigate the impact.

  15. Identified

    Sanity

    We are continuing to apply fixes to mitigate the impact. No errors have been observed from the changes rolled out so far.

  16. Monitoring

    Sanity

    A fix has been fully implemented and we are monitoring the results.

  17. Monitoring

    Sanity

    We are continuing to monitor for any further issues.

  18. Resolved

    Sanity

    This incident has been resolved.