Elevated listener latency and error rate impacting Studio loading

Resolved

Critical impact

Started

Lasted 4h 34m

View official incident ↗

Updates

  1. Resolved

    This incident has been resolved.

  2. Monitoring

    We are continuing to monitor for any further issues.

  3. Monitoring

    A fix has been fully implemented and we are monitoring the results.

  4. Identified

    We are continuing to apply fixes to mitigate the impact. No errors have been observed from the changes rolled out so far.

  5. Identified

    We are continuing to apply fixes to mitigate the impact.

  6. Identified

    The issue has been identified. We are continuing to apply fixes to mitigate its impact.

  7. Investigating

    We're continuing to investigate this issue. And we are continuing to apply measures to mitigate its impact.

  8. Investigating

    We're continuing to investigate this issue. And we are continuing rolling out measures to mitigate its impact.

  9. Investigating

    We're continuing to investigate this issue. And we are continuing rolling out measures to mitigate its impact. "scheduled publishing" functionality confirmed unaffected by this incident.

  10. Investigating

    We're continuing to investigate this issue. And we are continuing rolling out preliminary measures to mitigate its impact.

  11. Investigating

    We're continuing to investigate this issue. In the meantime, we've begun rolling out preliminary measures to mitigate its impact.

  12. Investigating

    We are continuing to investigate this issue.

  13. Investigating

    We are continuing to investigate this issue.

  14. Investigating

    We are currently continuing to investigate the issue, while also preparing to roll a set of mitigations.

  15. Investigating

    We are continuing to investigate the issue. Additionally, there might be a slight delay in document publishes for "scheduled publishing" functionality.

  16. Investigating

    We are currently continuing to investigate the issue, while also rolling out mitigations.

  17. Investigating

    We are continuing to investigate this issue.

  18. Investigating

    We are currently investigating an issue where elevated listener latency may result in slower performance and lag within Sanity Studio for a subset of customers. Our team is actively working to identify the root cause and mitigate the impact. Issue starting around 9:10 UTC.