QStash: Degraded performance

Postmortem

Minor impact

Started

Lasted 42m

View official incident ↗

Updates

  1. Postmortem

    An internal cleanup task for QStash events, coinciding with disc layer compaction task has caused performance degradation to some users. ‌ Mitigation: Team has mitigated the event by pausing some of these tasks and monitored the status for a while. ‌ Fixes: Improvements are being applied to these tasks to use resources more gracefully. Disk resources are increased to be able to handle a bigger burst of load.

  2. Resolved

    This incident has been resolved.

  3. Monitoring

    A fix has been implemented and we are monitoring the results.

  4. Investigating

    We are continuing to investigate this issue.

  5. Investigating

    We are currently investigating this issue.