Event ingestion: processing delays

Resolved

Started

Lasted 3h 23m

View official incident ↗

Updates

  1. Resolved

    We're now caught up and events are being processed normally.

  2. Monitoring

    Our estimates for full recovery in both environments are ~2 hours.

  3. Monitoring

    For EU, you may see duplicate events for a short time while we recover.

  4. Monitoring

    We’ve mitigated the problem in both environments and are watching lag recovery currently.

  5. Identified

    We’ve identified the impacting migration and looking to get a fix rolled out asap.

  6. Investigating

    We’ve identified processing delays in the event ingestion pipeline. Events may take longer than usual to appear in the product. Data is not lost but may not show in PostHog apps and queries until the processing delay is resolved.