Resolved incident

Ingestion and query issues for logs, spans, traces in US

Sentry · None · Started

Duration
12h 44m
Severity
None
Status
Resolved

Summary

None · Resolved

Data is now processed live and the system are fully operational.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Investigating

    Sentry

    We are currently investigating the issue

  2. Investigating

    Sentry

    We continue to investigate the issue. Ingestion delays are around 40 minutes now.

  3. Investigating

    Sentry

    We continue to investigate the issue

  4. Investigating

    Sentry

    We continue to investigate the issue.

  5. Investigating

    Sentry

    Our database is stabilized. We are attempting a fix to increase the ingestion rate.

  6. Investigating

    Sentry

    Our ingestion fix was not successful. We are continuing to investigate possible solutions

  7. Investigating

    Sentry

    We are attempting additional mitigations to restore ingestion for logs, spans, and traces in the US

  8. Monitoring

    Sentry

    We are currently burning down the ingestion backlog, and estimate that it will be complete by 2AM PT 2026-07-01.

  9. Monitoring

    Sentry

    We continue to monitor the situation

  10. Monitoring

    Sentry

    We continue to monitor the situation

  11. Monitoring

    Sentry

    We continue to monitor the fix. Ingestion is around 45 minutes behind and improving. APIs and dashboards are functioning normally (outside of data waiting to be ingested).

  12. Resolved

    Sentry

    Data is now processed live and the system are fully operational.