Elevated API Errors

Postmortem

Major impact

Started

Lasted 27m

View official incident ↗

Updates

  1. Postmortem

    On October 1, a distributed denial-of-service \(DDoS\) attack caused elevated token-request errors across all Ably Realtime regions for approximately six minutes and intermittent unavailability of [ably.com](http://ably.com). We restored token-request service by increasing capacity and added targeted traffic-blocking and rate-limiting rules to mitigate the attack. We are strengthening endpoint protection and reviewing our firewall controls to reduce the risk of recurrence.

  2. Resolved

    Between 15:30 UTC to 15:36 UTC there were elevated errors affecting token requests in all regions resulting in 503 error responses.

  3. Investigating

    We're experiencing an elevated level of API errors and are currently looking into the issue.