Mimir query unexpected response with status code 500

Resolved

Minor impact

Started

Lasted 8h 32m

View official incident ↗

Updates

  1. Resolved

    From approximately 03:20 UTC on 10 November, some Grafana Cloud Metrics customers in AWS US East (OH) and GCP US Central saw errors, or failed queries, when reading older data. Service has fully recovered and this incident is now resolved.

  2. Monitoring

    Our mitigation remains in place and query behavior in AWS US East (OH) and GCP US Central continues to improve. Some customers may still see occasional, brief query errors in the meantime.

  3. Monitoring

    Our mitigation remains in place and query behavior in AWS US East (OH) and GCP US Central continues to improve. Some customers may still see occasional, brief query errors in the meantime.

  4. Monitoring

    A fix has been implemented and we are monitoring the results.

  5. Identified

    We’ve identified an issue querying older data, and are already seeing recovery.

  6. Identified

    We’ve identified an issue querying older data, and are already seeing recovery