Live outage feed

Outages and recoveries from the services you depend on.

Earlier incidents

40 incidents

Back to latest

Oct 21, 2024

Oct 17, 2024

Oct 16, 2024

  1. AsanaMajor outage

    Our engineers have fixed the issue and Asana which cause global downtime for ~10 minutes and connectivity issues for a small subset of users for around an hour after that. Asana is now running normally for all our customers.

    Resolved

Oct 15, 2024

Oct 14, 2024

Oct 11, 2024

  1. AsanaErrors loading Asana

    **Incident:** On 2024-10-10, between 01:23 and 02:31 UTC a software change caused overload to a shared resource, leading to application errors. The change was rolled back, with recovery for most users around 02:31 and full recovery by 02:39 UTC. **Impact:** Users were unable to start new sessions on the web and desktop apps, though mobile and existing sessions were unaffected. No data was lost. **Next Steps:** We will conduct a retrospective using the 5 Whys method to improve monitoring, tooling, and playbooks. We will also update our software to manage load more efficiently and reduce reliance on globally shared resources to prevent similar issues in the future. Our metric considers a weighted average of uptime experienced by users at each data center. The number of minutes of downtime shown reflects this weighted average.

    Resolved

Oct 10, 2024

Oct 9, 2024

Oct 8, 2024

  1. SambaNovaBrief Service Outage

    SambaNova Cloud endpoints (https://cloud.sambanova.ai/ and https://api.sambanova.ai/) experienced a brief service disruption and are now operational. This disruption took place starting at 3:30 PM PST and ended at 3:42 PM PST on Monday, October 1st, 2024. During this disruption, users were unable to generate queries.

    Resolved

  2. TypeformTypeform Results/Summary Report - Unavailable

    We are glad to inform you that the fix has been implemented and the incident resolved. Users will be able to see responses under the Responses tab and the response counter has been restored. We will run a problem investigation to understand what happened and how to prevent it from happening again. Thanks for your understanding & sorry for any inconvenience this has caused.

    Resolved

Oct 7, 2024

Oct 4, 2024

  1. Datadog EU1[SSO] Login Errors

    This incident has been resolved. If you continue to see issues, please contact Datadog technical support.

    Resolved

Oct 3, 2024

Oct 2, 2024

  1. AblySome SSE connections disconnected and reconnected every 30s

    For most of the production cluster, between 13:05 and 14:02 UTC on 2024-10-01, a small proportion of SSE connections were disconnected 30 seconds after establishing a connection. For the duration of that 30s they still worked fine, and connection resumption was working correctly, so this should not have caused any missed messages. The net effect would have been a small increase in subscribe latency about once every 30s. Only the SSE endpoint was affected; websocket traffic (including anyone using an Ably SDK) was not. For customers connected to ap-southeast-2 (Sydney), the duration of the effect was much longer, between 10:06 on 2024-09-30 to 14:02 on 2024-10-01.

    Resolved

Oct 1, 2024

Sep 30, 2024

Older incidents