Resolved incident

QStash: Degraded performance

Upstash · Minor · Started

Duration
42m
Severity
Minor
Status
Postmortem

Summary

Minor · Postmortem

An internal cleanup task for QStash events, coinciding with disc layer compaction task has caused performance degradation to some users. ‌ Mitigation: Team has mitigated the event by pausing some of these tasks and monitored the status for a while. ‌ Fixes: Improvements are being applied to these tasks to use resources more gracefully. Disk resources are increased to be able to handle a bigger burst of load.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Investigating

    Upstash

    We are currently investigating this issue.

  2. Investigating

    Upstash

    We are continuing to investigate this issue.

  3. Monitoring

    Upstash

    A fix has been implemented and we are monitoring the results.

  4. Resolved

    Upstash

    This incident has been resolved.

  5. Postmortem

    Upstash

    An internal cleanup task for QStash events, coinciding with disc layer compaction task has caused performance degradation to some users. ‌ Mitigation: Team has mitigated the event by pausing some of these tasks and monitored the status for a while. ‌ Fixes: Improvements are being applied to these tasks to use resources more gracefully. Disk resources are increased to be able to handle a bigger burst of load.