Degraded search and Assistant performance

Resolved

Started

Lasted 1634h 38m

View official incident ↗

Updates

  1. Resolved

    The fix has been deployed and the assistant should now work as expected.

  2. Resolved

    The fix has been deployed and the assistant should now work as expected.

  3. Resolved

    The fix has been deployed and the assistant should now work as expected.

  4. Resolved

    The fix has been deployed and the assistant should now work as expected.

  5. Resolved

    Github has resolved their incident with increased 401 errors on github

  6. Resolved

    The ingestion queue is flushed. Search indexes will be updated at the usual pace

  7. Resolved

    Search pipeline is no longer backed up. Updates will resume to be at their usual cadence.

  8. Monitoring

    Updates to search indexes have been paused. This has lead to searches to succeed, however site indexes may not be slightly out of date. Impact - Out of date search indexes

  9. Identified

    Our team has identified the issue of search functionality intermittently being degraded due to search engine failures. Impact - Degraded Assistant Performance - Higher latency search - Degraded MCP