Time Series Database Issue

Resolved

Critical impact

Started

Lasted 3h 9m

View official incident ↗

Updates

  1. Resolved

    Metric ingestion has caught back up.

  2. Monitoring

    Our systems are replaying buffered data collected during the outage and ingesting these into our database.

  3. Monitoring

    The time-series database is restarting and should be operational in a few minutes. After which buffered data from the downtime will be played into it.

  4. Investigating

    The backend time-series database appears to be having issues. All incoming data is being buffered and will be ingested into the system, but the site is currently inaccessible.