Resolved incident

Ingestion Lag

Scout APM · Major · Started

Duration
14h 29m
Severity
Major
Status
Resolved

Summary

Major · Resolved

Metric ingestion was paused at 20:13, restarted at 22:30 UTC and all apps metrics are caught up and stable as of 2019-09-18 0:00UTC. Operations are back to normal.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Monitoring

    Scout APM

    We are experiencing some ingestion lag. We have identified the issue and we are working on processing the backlog. Your charts will continue to catch up as we process the backlog.

  2. Monitoring

    Scout APM

    We are recreating some databases indexes which has forced us to fully pause ingestion. Once the indexes are rebuilt metrics will fill in to current while we continue to fix the root cause of the ingestion lag.

  3. Resolved

    Scout APM

    Metric ingestion was paused at 20:13, restarted at 22:30 UTC and all apps metrics are caught up and stable as of 2019-09-18 0:00UTC. Operations are back to normal.