Degraded querying and delayed records sent to Activity Log

Event timeline

How this incident unfolded, from the official status page.

1. Identified

   10 months ago

   Honeycomb

   We are seeing a spike in querying errors and the Activity Log has delayed ingest of new activity. We have identified the issue and are working to resolve

2. Identified

   10 months ago

   Honeycomb

   We have resolved the issue which impacted querying but are still working to get Activity Log up to date

3. Identified

   10 months ago

   Honeycomb

   We are currently expecting to lose the last three hours of data for the beta activity log feature as part of remediation of this issue.

4. Identified

   10 months ago

   Honeycomb

   We have restored basic activity log functionality, though some delays remain, and we will analyze further tomorrow during business hours.

5. Identified

   10 months ago

   Honeycomb

   We have stabilized activity log. We have confirmed activity log entries lost from 4:54pm-7:04pm ET in the US and 9:43pm-11:55pm GMT in the EU. Event ingest was unimpacted. All systems are currently operating normally

6. Resolved

   10 months ago

   Honeycomb

   This incident has been resolved.