Live outage feed

Outages and recoveries from the services you depend on.

Earlier incidents

40 incidents

Back to latest

Jun 3, 2024

  1. HotjarAsk responses briefly rejected

    From approximately 7:26 to 7:42 UTC, an internal change caused Ask product responses to be rejected instead of saved. Our monitoring system alerted us to this issue and we reverted the change immediately and everything is working as expected again.

    Resolved

May 31, 2024

May 30, 2024

  1. AppsFlyerDashboards availability

    The issue is resolved and all dashboards are available. If you're still experiencing any related issues, please contact our customer support.

    Resolved

  2. NeonConnectivity issues in us-east-2

    The incident has been successfully resolved, and normal operations have been restored to all affected systems and services.

    Resolved

  3. NeonEndpoint startup failures for some projects (~100) in ap-southeast-1 for up to 20 minutes

    The incident has been successfully resolved, and normal operations have been restored to all affected systems and services. The root cause of the incident was a release of new cloud control plane version, which didn't have any issues itself, but triggered pulling new compute images from the registry on all k8s nodes. In some cases it took unexpectedly long -- up to 15 minutes.

    Resolved

May 29, 2024

May 28, 2024

  1. HotjarSome upgrades not billed correctly

    The delayed invoices for upgrades from an Observe Business Plan to an Observe Scale Plan will be processed by the end of today, 28 May 2024

    Resolved

May 27, 2024

  1. NeonCompute issues in ap-southeast-1

    The incident has been successfully resolved, and normal operations have been restored to all affected systems and services. Our team conducted a thorough investigation, implemented necessary actions, and analyzed the underlying cause to prevent similar incidents in the future.

    Resolved

May 25, 2024

May 24, 2024

  1. imgixElevated rendering errors

    # **Postmortem** # **What happened?** On May 23, 2024, at 19:23 UTC, an increased load on the rendering infrastructure was detected. Actions were taken to scale out our system to handle the additional traffic. This incident was resolved at 19:36.  # **How were customers impacted?** During the incident, customers experienced increased error rates for recent renders, intermediate errors increased in our system, and response times for requests increased.  # **What went wrong during the incident?** During the incident, our team implemented a service change that led to assets being dropped. This led to an increase in requests to our system. The increased requests to our system led to `429` and `5XX` errors. # **What will imgix do to prevent this in the future?** To prevent similar incidents, we will: * Improve procedures for pre-scaling instances during critical updates. * Conduct impact assessments before issuing significant changes. * Enhance monitoring and alerting systems to predict and manage load increases better.

    Resolved

  2. NeonIssues with computes in ap-se-1

    The incident has been successfully resolved, and normal operations have been restored to all affected systems and services.

    Resolved

May 23, 2024

  1. TrelloCard Repeater Power-Up failing to repeat

    Our engineering team has resolved this issue, and the Card Repeater Power-Up is working again. Cards that missed their scheduled repeat will run at their next scheduled time.

    Resolved

May 22, 2024

  1. MapboxStatic Images API degradation

    The issue with 3D Terrain distortion has been mitigated and fixes have been shipped to all Static Image and Tile endpoints.

    Resolved

May 21, 2024

May 20, 2024

May 19, 2024

  1. AppsFlyerDashboards availability

    The issue is now resolved, and our teams continue to monitor the dashboard's performance. If you encounter any further issues, please report them to our technical support team.

    Resolved

May 18, 2024

May 17, 2024

  1. KeeperOkta SSO Logins

    The issue has been resolved. The issue was caused by a backend software update which had the effect of throwing an error during some Okta SSO login transactions. Our DevOps team quickly reverted the change and our engineers will be addressing the bug in a follow-up release.

    Resolved

  2. ApigeeNetworking Disruption for GCP Customers

    This issue has been resolved for all affected projects as of Thursday, 2024-05-16 18:10 US/Pacific. We thank you for your patience while we worked on resolving the issue.

    Resolved

  3. Cockroach LabsGCP Networking Outage

    The Google Cloud Platform networking issue has been resolved. If you have any questions or concerns please submit a ticket to our support portal.

    Resolved

May 16, 2024

  1. KeeperVault login errors

    From 2:45PM to 3:00PM PST, several of the Keeper application API instances in the US region were responding with HTTP 500 errors due to an internal application error. The Keeper DevOps team identified the error and restarted those affected instances. The software engineering team has been investigating the root cause and will be addressing in an upcoming backend release.

    Resolved

  2. PandaDocDocument can not be downloaded as PDF files

    We're all set! PandaDoc is working properly and the incident has been fully resolved. If you continue to experience any issues with this, please reach out to us at support@pandadoc.com.

    Resolved

May 14, 2024

Older incidents