Ingestion and query issues for logs, spans, traces in US

Resolved

None impact

Started

Lasted 12h 44m

View official incident ↗

Updates

  1. Resolved

    Data is now processed live and the system are fully operational.

  2. Monitoring

    We continue to monitor the fix. Ingestion is around 45 minutes behind and improving. APIs and dashboards are functioning normally (outside of data waiting to be ingested).

  3. Monitoring

    We continue to monitor the situation

  4. Monitoring

    We continue to monitor the situation

  5. Monitoring

    We are currently burning down the ingestion backlog, and estimate that it will be complete by 2AM PT 2026-07-01.

  6. Investigating

    We are attempting additional mitigations to restore ingestion for logs, spans, and traces in the US

  7. Investigating

    Our ingestion fix was not successful. We are continuing to investigate possible solutions

  8. Investigating

    Our database is stabilized. We are attempting a fix to increase the ingestion rate.

  9. Investigating

    We continue to investigate the issue.

  10. Investigating

    We continue to investigate the issue

  11. Investigating

    We continue to investigate the issue. Ingestion delays are around 40 minutes now.

  12. Investigating

    We are currently investigating the issue