Some Grafana Instances Unavailable

Resolved

Critical impact

Started

Lasted 6h 21m

View official incident ↗

Updates

  1. Resolved

    We are observing a continued period of stability and at this point, we are marking the incident resolved.

  2. Monitoring

    We have rolled out a change to the affected regions to restore services.

  3. Investigating

    We have identified the cause: our cloud provider has exhausted compute capacity in the affected region. We are working directly with them and are moving affected workloads to alternative capacity to restore service.

  4. Investigating

    We are continuing to investigate this issue.

  5. Investigating

    We are currently investigating an issue that causing some Grafana deployments in prod-us-central-0 and prod-us-central-3 to become unavailable.