Errors when querying Prometheus datasource

Resolved

Minor impact

Started

Lasted 51m

View official incident ↗

Updates

  1. Resolved

    This incident has been resolved. Thank you for your patience.

  2. Monitoring

    We have put some mitigations in place which seem to have helped with the errors. We continue to monitor the results.

  3. Investigating

    We are continuing to investigate this issue.

  4. Investigating

    A small number of customers with stacks in prod-us-central-4 are receiving "forbidden" errors when querying Prometheus data sources. We are investigating and will provide an update soon.