Storage users in US-West-2 experiencing increased latency on storage requests

Resolved

Started

Lasted 8h 40m

View official incident ↗

Updates

  1. Resolved

    All residual jobs have drained. Storage performance and job activity is normal.

  2. Monitoring

    Job queues continue to drain. We will actively monitor until they are complete.

  3. Monitoring

    Backlog is being effectively processed and operations have returned to normal. We continue to monitor the performance in us-west-2.

  4. Identified

    We are seeing improvement in the performance of us-west-2 after implementation of our mitigation strategies. Storage operation is returning to normal. We will continue to monitor performance in this region.

  5. Identified

    We have implemented further mitigations and are tracking their progress. We continue to actively work this issue.

  6. Identified

    The team is still working on a solution, and mitigation work is underway.

  7. Identified

    We are implementing load mitigation strategies to improve the performance of storage requests in US-West-2.

  8. Identified

    Users in US-West-2 are seeing increased latency on storage requests. The team has identified the issue and is working on a solution.