Management API Performance Degradation

Resolved

Started

Lasted 97h 23m

View official incident ↗

Updates

  1. Resolved

    After monitoring, we have confirmed that issues affecting Management API performance have been resolved.

  2. Monitoring

    We are continuing to monitor the the Management API to ensure no further intermittent occurrences appear. We will provide another update within 24 hours.

  3. Monitoring

    We have identified the root cause and deployed a fix. We will continue to monitor the behavior through the weekend to ensure no further occurrences appear.

  4. Identified

    We are continuing mitigation efforts for the intermittent issues with the Management API.

  5. Identified

    Cause isolation is continuing. We are doing work to ensure the accuracy of the understood cause in order to have confidence in the mitigation method under consideration.

  6. Identified

    We've isolated the cause of the network issues with the Management API and we are working on a fix.

  7. Identified

    We have been alerted that our Management API is experiencing performance degradation due to intermittent network issues. Users who experience the problem are encouraged to log out and log back in to the dashboard as that has cleared the issue in many cases. Additionally, users can retry failed actions as needed. We are actively investigating a persistent fix.