Resolved incident

Performance issues with primary search database

LogRocket · Major · Started

Duration
46h 18m
Severity
Major
Status
Resolved

Summary

Major · Resolved

We've seen no additional performance degradation after our mitigation work.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Resolved

    LogRocket

    We've seen no additional performance degradation after our mitigation work.

  2. Monitoring

    LogRocket

    We have completed processing of our primary indexing backlog, session filtering and metrics will be mostly up-to-date. Our secondary processing system is currently processing and includes some metrics, issues and alerting.

  3. Monitoring

    LogRocket

    We have identified the cause of the issue, applied a fix and have begun processing the backlog of events.

  4. Identified

    LogRocket

    We have restored some indexing to the database but are continuing to fully resolve the situation.

  5. Identified

    LogRocket

    We are continuing to work with our vendor to remedy the situation. Session data collection continues to be unaffected, but secondary indexing that powers search and metrics continues to be delayed.

  6. Identified

    LogRocket

    We are continuing to work with our vendor to resolve the issue.

  7. Identified

    LogRocket

    We are continuing to work with our vendor to resolve the issue with ingesting new data.

  8. Identified

    LogRocket

    We have identified the issue with our database vendor and are working with them to remedy the situation.

  9. Investigating

    LogRocket

    We are currently investigating an issue impacting our primary search database. Searching for sessions, loading metric charts, issues and alerting are all impacted. Session data collection has not been impacted.