We've identified a problem and are working on a fix

Resolved

Major impact

Started

Lasted 2h 18m

View official incident ↗

Updates

  1. Resolved

    This incident has now been resolved.

  2. Monitoring

    We've rolled out a fix and are seeing errors and generation throughput normalize. We are working through a backlog of generations so queue wait times are still likely to be elevated for some time. We will post another update when wait times have normalized.

  3. Identified

    We're starting to see improved queue wait times, especially for Runway Dev API platform generations. We're still working through a large backlog of generations.

  4. Investigating

    We're observing longer than normal queue wait times. Our engineering team is investigating a problem affecting users. We're aware of the problem and are working towards a solution. We will provide an update soon.