Agent payloads being rejected, missing dashboard data

Resolved

Critical impact

Started

Lasted 7h 14m

View official incident ↗

Updates

  1. Resolved

    This incident has been resolved.

  2. Monitoring

    We have implemented the fix and the kafka cluster is operating normally. Agent checkin payloads are being ingested and processed again as of 3:41PM MT. Data from 2:40-3:30PM MT will not backfill to charts.

  3. Identified

    We have encountered an issue with our Kafka cluster preventing agent payloads from being recorded into kafka for storage and processing. You will not see current data in your dashboards until the issue is resolved. We are working on deploying the fix now.