Elevated errors connecting to rooms and accessing Storage

Resolved

Major impact

Started

Lasted 1h 12m

View official incident ↗

Updates

  1. Resolved

    This incident has been resolved.

  2. Monitoring

    Errors have dropped to normal levels. We're continuing to monitor while our infrastructure provider confirms their fix.

  3. Identified

    We're still seeing elevated errors when connecting to rooms and accessing Storage. The cause is an ongoing incident at our infrastructure provider affecting Durable Objects, and we're waiting on their fix. We're monitoring closely and will post another update once things change.

  4. Identified

    We're seeing elevated error rates affecting a subset of rooms since earlier today. Some users may fail to connect to rooms (WebSocket connection timeouts), and some Storage reads and writes via the REST API may fail. This appears to be related to an ongoing incident at our infrastructure provider affecting Durable Objects: https://www.cloudflarestatus.com/incidents/r4mz367vddi7. We're monitoring closely and will post an update as soon as we know more.