Resolved incident

Investigating connectivity issues across accounts and devices due to an AWS outage

monday.com · Critical · Started

Duration
14h 6m
Severity
Critical
Status
Postmortem

Summary

Critical · Postmortem

**What Happened:** On October 20th, starting around 03:00 AM EST, our US server customers experienced approximately 250 minutes of disruption, including about 165 minutes of full system downtime followed by 522 minutes of degraded performance that affected automations and integrations.  The issue was caused by an outage of our third-party provider, AWS, which primarily impacted the US region, but also created downstream effects globally. As a result, some customers in our EU and AU regions experienced related degraded performance issues with API, automations, and integrations, lasting up to 150 minutes. ‌ **What caused it:** This incident was caused by a major outage at our third-party provider, AWS \(Amazon Web Services\), in one of their U.S. data center regions. This outage led to widespread disruptions across many platforms, including [monday.com](http://monday.com). This issue began with errors and delays within AWS’s core systems, which affected how our servers handled data and automations. As AWS implemented mitigation efforts to restore functionality, our team actively worked to maintain stability and recovery as services gradually returned to normal. ‌ **How we responded:** Our engineering and developers teams acted immediately to stabilize the platform once the issue was detected. To protect performance and further disruption, we temporarily paused automations and API activity connected to the affected region while we worked on restoring service. We kept customers informed through regular updates on our Status Page and made configuration changes to reduce the impact on other parts of the platform. As AWS began to recover, we restored platform functionality in stages to ensure everything remained stable.  Full functionality, including automations, integrations, and API was restored once reliability was confirmed in all regions.  ‌ We sincerely apologize for any disruption this caused to your workflow. Thank you for your patience and understanding as we continue strengthening our systems to ensure greater resilience and reliability.  Your team at [monday.com](http://monday.com)

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Investigating

    monday.com

    We are currently investigating reports of connectivity issues across the platform, which are caused by an AWS outage per https://health.aws.amazon.com/health/status. Our team is working to resolve this promptly.

  2. Investigating

    monday.com

    We are continuing to investigate this issue.

  3. Investigating

    monday.com

    Our API is also experiencing connectivity issues in our EU and AU servers. We're working to investigate the issue.

  4. Identified

    monday.com

    Our team has identified that the root cause of the issue is with our third party, and they are working to resume regular service usage. Additionally, API is partially working in the EU and AU servers. We will continue to provide updates on their progress

  5. Identified

    monday.com

    Our automations and integrations are also experiencing issues in the EU and AU servers. We are working to fix the issue.

  6. Identified

    monday.com

    We are continuing to work on a fix for this issue.

  7. Identified

    monday.com

    Automations and integrations working again in the EU server, but may experience delays

  8. Identified

    monday.com

    Automations and integrations working again in the AU server, but may experience delays

  9. Identified

    monday.com

    The platform is starting to recover, we will update again soon.

  10. Monitoring

    monday.com

    The EU and AU servers are fully functional, and the platform is partly functional in the US server. We're working to fully resolve the issue as soon as possible

  11. Monitoring

    monday.com

    We're still working to fully resolve the issue as soon as possible!

  12. Monitoring

    monday.com

    Automations and integrations are experiencing degraded performance on the US server. We will continue to provide updates until the issue is fully resolved!

  13. Monitoring

    monday.com

    Automations are experiencing degraded performance on the US server. We're working to fully resolve the issue as soon as possible!

  14. Monitoring

    monday.com

    We are still monitoring the incident.

  15. Monitoring

    monday.com

    We are currently experiencing issues connecting customers with our Customer Support Team. We are continuing to monitor for any platform-related issues.

  16. Monitoring

    monday.com

    Automations are experiencing degraded performance on the US server. We will continue to provide updates until the issue is fully resolved!

  17. Monitoring

    monday.com

    Automations are experiencing degraded performance on the US server. We are still experiencing issues connecting customers with our Customer Support Team. We will continue to provide updates until the issue is fully resolved!

  18. Monitoring

    monday.com

    We are monitoring results to restore full system stability on the platform, including automations on the US server and issues connecting customers with our Customer Support Team. We will continue to provide updates until the issue is fully resolved!

  19. Monitoring

    monday.com

    A fix has been implemented, all system is working and being monitored beside automations in US which are still being affected.

  20. Monitoring

    monday.com

    All system is working and being monitored beside automations and API in US which are still being affected.

  21. Monitoring

    monday.com

    All platform components availability and latency have returned to normal. We are no longer observing issues coming from AWS infrastructure. Our teams will continue to monitor platform availability; Automations is back to work but we do expect delays in automation completion.

  22. Monitoring

    monday.com

    We are continuing to monitor for any further issues.

  23. Resolved

    monday.com

    The platform is now back to regular service. Please refresh your browser to access the platform. Thank you for your patience

  24. Postmortem

    monday.com

    **What Happened:** On October 20th, starting around 03:00 AM EST, our US server customers experienced approximately 250 minutes of disruption, including about 165 minutes of full system downtime followed by 522 minutes of degraded performance that affected automations and integrations.  The issue was caused by an outage of our third-party provider, AWS, which primarily impacted the US region, but also created downstream effects globally. As a result, some customers in our EU and AU regions experienced related degraded performance issues with API, automations, and integrations, lasting up to 150 minutes. ‌ **What caused it:** This incident was caused by a major outage at our third-party provider, AWS \(Amazon Web Services\), in one of their U.S. data center regions. This outage led to widespread disruptions across many platforms, including [monday.com](http://monday.com). This issue began with errors and delays within AWS’s core systems, which affected how our servers handled data and automations. As AWS implemented mitigation efforts to restore functionality, our team actively worked to maintain stability and recovery as services gradually returned to normal. ‌ **How we responded:** Our engineering and developers teams acted immediately to stabilize the platform once the issue was detected. To protect performance and further disruption, we temporarily paused automations and API activity connected to the affected region while we worked on restoring service. We kept customers informed through regular updates on our Status Page and made configuration changes to reduce the impact on other parts of the platform. As AWS began to recover, we restored platform functionality in stages to ensure everything remained stable.  Full functionality, including automations, integrations, and API was restored once reliability was confirmed in all regions.  ‌ We sincerely apologize for any disruption this caused to your workflow. Thank you for your patience and understanding as we continue strengthening our systems to ensure greater resilience and reliability.  Your team at [monday.com](http://monday.com)