Live outage feed

Outages and recoveries from the services you depend on.

Earlier incidents

40 incidents

Back to latest

Mar 11, 2026

  1. LaunchDarklyEvent processing delays

    The issue with Event processing has been resolved. Impacted services have returned to normal operation. Flag Delivery was not impacted. There was no data loss experienced.

    Resolved

  2. Atlassian StatuspageStatuspage API Access Issues

    On 2 February 2026 between 08:52 and 16:40 UTC, some Statuspage customers’ API-based integrations started failing with authorization errors when a planned cleanup of old API keys unintentionally disabled new keys as well. Statuspage UI and core product functions remained available. We provided a workaround by creating new API keys and then fully restored affected keys from a point‑in‑time database backup. We are implementing safeguards around bulk key operations, improved detection of abnormal API error rates, and stronger operational checks for similar maintenance activities to reduce the likelihood and duration of similar incidents in the future.

    Resolved

Mar 10, 2026

  1. CartesiaTTS API Elevated TTFA

    Overview On March 4, 2026, our platform experienced a period of degraded performance and a brief service interruption, primarily impacting users in the APAC region. The incident was triggered by an update to our Load Balancing layer that inadvertently extended to the cache synchronization workers across several global regions. This synchronization initiated a high-volume data retrieval process from our primary database. The resulting resource contention coincided with peak organic traffic, leading to increased latency and, eventually, a necessary database restart to restore system stability. Incident Timeline \(PST\) - March 4th, 2026 • 15:50 – 16:50: A new version deployment triggered a phased restart of cache synchronization workers across global regions. • 18:30: Coinciding with peak regional demand, the primary database experienced elevated CPU utilization. Users began noticing increased Time to First Audio \(TTFA\). • 19:45: Database resources reached a critical threshold, leading to broader performance degradation. • 20:18: Engineering teams initiated an investigation into database health. • 21:00: To clear queued transactions and stabilize the environment, a manual reset of the primary database was performed, resulting in a brief total service interruption. • 21:04: Database services were successfully restored. • 21:08: Latency metrics returned to normal levels. • 21:12: All background cache synchronization tasks successfully completed. Root Cause Analysis Resource Contention and Buffer Saturation The primary driver of this incident was the simultaneous "cold start" of cache workers across multiple regions. By design, these workers attempt to populate the rapid-access cache by performing a comprehensive data fetch from the primary database. Because several regions initiated this process concurrently, the database was subjected to multiple long-running read operations. This created a high demand for the database’s buffer pool. When peak organic traffic arrived, the database struggled to balance these synchronization read requests with the high-frequency write operations required by active user sessions. Latent Dependency A recent configuration update introduced an unexpected synchronous database look-up during the request resolution path. While typically negligible, this added DB query time became significant when the DB was under heavy load. This dependency meant that as database performance slowed, user-facing latency increased proportionally, eventually leading to a backlog of requests. Lessons Learned and Resolution Architectural Optimization • Decoupled Synchronization: We are re-evaluating our cache synchronization process to make it future proof as our load grows. • Improving our global database architecture: We are implementing a global database architectural change to make our system more resilient. Enhanced Monitoring We are deploying a unified health dashboard to provide real-time visibility into: • Granular resolution request hot path latency. • More aggressive alerting on DB / Cache health.

    Resolved

  2. Webflow[RESOLVED] Reports of issues with form submission notification emails

    This incident is now resolved. Between 17:55 and 20:35 UTC (10:55 AM–1:35 PM PT), form submission notification emails were not sent as expected. During this time, form submissions were successfully collected and remain available in the Forms tab within Site settings. However, notification emails that were not sent during this window will not be delivered retroactively. A fix was deployed, and email delivery has been fully restored. We are no longer seeing customer impact related to this issue. We appreciate your patience while we worked to resolve this.

    Resolved

  3. HashiCorpUI experiencing intermittent issues

    Our Engineering team has resolved the issue. These systems should now be operating normally. If you continue to experience any problems, please open a ticket with our support team.

    Resolved

  4. GitHubIncident with Codespaces

    On March 9, 2026, between 01:23 UTC and 03:25 UTC, users attempting to create or resume codespaces in the Australia East region experienced elevated failures, peaking at a 100% failure rate for this region. Codespaces in other regions were not affected.<br /><br />The create and resume failures were caused by degraded network connectivity between our control plane services and the VMs hosting the codespaces. This was resolved by redirecting traffic to an alternate site within the region. While we are addressing the core network infrastructure issue, we have also improved our observability of components in this area to improve detection. This will also enable our existing automated failovers to cover this failure mode. These changes will prevent or significantly reduce the time any similar incident causes user impact.

    Resolved

  5. Box[Critical] Issues with Multiple Box Services

    _Notice and disclaimer: Box is providing this preliminary information subject to further review and analysis. To the best of our knowledge, this is the current state and we may update as more information is confirmed._ ‌ On February 24th, 2026 between 6:11 AM PST and 6:40 AM PST, some users may have experienced difficulties while while attempting to log into Box. Users already logged into Box were not impacted by this issue. The issue occurred due to a recent configuration change related to device security that prevented users from logging in to Box. We were able to resolve the issue by quickly reverting the change. We are also working to improve our release strategy and testing processes to prevent similar issues from occurring in the future. ‌ We are conducting a full engineering postmortem and our overview is subject to change with further analysis and findings. In the event our continuing investigation yields further substantive findings, we may publish additional analysis after the conclusion of the full engineering postmortem. We are continuously working to improve Box and want to make sure we are delivering the best product and user experience we can. We hope we have provided some clarity here and we would be happy to answer any questions you may still have regarding this matter.  Sincerely, The Box Team

    Resolved

  6. Intercom - AUErrors when accessing some articles

    Between 16:50 - 17:01 UTC approx 25% of articles were failing to load and an error page was displayed on all help-centres. We rolled back a change which resolved the issue. Apologies for the disruption.

    Resolved

  7. Intercom - EUErrors when accessing some articles

    Between 16:50 - 17:01 UTC approx 25% of articles were failing to load and an error page was displayed on all help-centres. We rolled back a change which resolved the issue. Apologies for the disruption.

    Resolved

  8. Intercom - USErrors when accessing some articles

    Between 16:50 - 17:01 UTC approx 25% of articles were failing to load and an error page was displayed on all help-centres. We rolled back a change which resolved the issue. Apologies for the disruption.

    Resolved

  9. GranolaGranola Chat down

    We've fixed the earlier outage - apologies for the disruption. Get in touch via help.granola.ai "help.granola.ai": http://help.granola.ai if you're still having issues!

    Resolved

  10. CartesiaLog ingestion disruption for Line agent calls

    Duration: March 10, 2026, 9:00 AM PST - 9:14 PM PST Impact: Runtime logs for Line agent calls made during this time period were not available via the dashboard or API. Call processing was not affected. Resolution: Our engineering team identified the root cause as an upstream breaking change from an infrastructure provider that disrupted our log ingestion pipeline. A hotfix was deployed and log collection has been fully restored. All logs from the affected window have also now been recovered and backfilled. Next Steps: We are conducting a postmortem to improve reliability and detection speed moving forward.

    Resolved

  11. GranolaClaude unable to connect to Granola MCP

    Apologies for the disruption to MCP with Claude, we've worked through these with the Claude team and it looks like we're back up and running. If you're having issues, please follow the troubleshooting steps here: https://docs.granola.ai/help-center/sharing/integrations/mcp#granola-mcp

    Resolved

  12. Liquid WebWordPress: W3 Total Cache Vulnerability CVE-2026-27384

    Update Our team has completed patching the W3 Total Cache plugin across all managed systems where the update was possible based on the current WordPress and PHP version requirements. In cases where the patch could not be applied due to compatibility constraints or other configuration limitations, the affected clients have been contacted directly with the relevant details and recommended next steps. In most instances, this involves upgrading the underlying WordPress and/or PHP versions before updating the plugin. At this time, the planned remediation work has been completed and this matter is considered resolved. Recommended Action Clients with sites running W3 Total Cache version 2.9.1 or earlier are encouraged to update to the patched version 2.9.2 as soon as possible. Where the update is not currently possible due to WordPress or PHP version constraints, please upgrade those components first and then proceed with the plugin update. If you require assistance with completing the update, please contact our support team. Thank you for your patience and understanding while we worked to address this matter.

    Resolved

  13. InngestReduced throughput on function execution

    The networking fix has been applied and all systems are operational. We have identified the root cause. Function execution has returned to normal. Any backlogs incurred during the incident will be executed.

    Resolved

  14. ConfluenceAutomation events delayed for some customers in the APAC region

    On 9 March UTC, Automation users in the APAC region may have experienced performance degradation within Jira, Jira Product Discovery, Jira Service Management, Jira Work Management, Confluence. The issue has now been resolved, and the service is operating normally for all affected customers.

    Resolved

  15. JiraAutomation events delayed for some customers in the APAC region

    On 9 March UTC, Automation users in the APAC region may have experienced performance degradation within Jira, Jira Product Discovery, Jira Service Management, Jira Work Management, Confluence. The issue has now been resolved, and the service is operating normally for all affected customers.

    Resolved

Mar 9, 2026

  1. LinearErrors in creating workspaces

    This incident has been resolved and system performance has returned to normal. Thank you for your patience while we worked to resolve the issue.

    Resolved

Older incidents