Elevated API Latencies

Resolved

Minor impact

Started

Lasted 9h 41m

View official incident ↗

Updates

  1. Resolved

    This incident has been resolved.

  2. Identified

    We are continuing to work on a fix for this issue.

  3. Identified

    We have not seen any impact outside of two brief periods within 13:29 - 13:42 UTC today. On-call Radar engineers are continuing to work on isolating our infrastructure from these ongoing AWS network connectivity incidents between the us-east-1 and us-east-2 regions.

  4. Identified

    The cause of this issue is a reoccurrence of the same AWS incident from last week: https://health.aws.amazon.com/health/status?eventID=arn:aws:health:us-east-2::event/INTERNETCONNECTIVITY/AWS_INTERNETCONNECTIVITY_OPERATIONAL_ISSUE/AWS_INTERNETCONNECTIVITY_OPERATIONAL_ISSUE_D8A2C_D55BF2D0F04 We are immediately taking steps to prevent this ongoing AWS issue from affecting our infrastructure.

  5. Identified

    The issue has been identified and a fix is being implemented.

  6. Investigating

    We're experiencing an elevated level of API latencies and are currently looking into the issue.