Live outage feed

Outages and recoveries from the services you depend on.

Earlier incidents

40 incidents

Back to latest

Sep 18, 2024

Sep 17, 2024

  1. PandaDocApplication is loading slowly

    We're all set! PandaDoc is working properly and the incident has been fully resolved. If you continue to experience any issues with this, please reach out to us at support@pandadoc.com.

    Resolved

Sep 16, 2024

  1. LoopsPrimary database outage

    A misconfiguration by our database vendor prevented our database from restarting successfully. The misconfiguration was identified and remedied. Campaigns scheduled to send during the outage are now sent. Loop emails scheduled to send during the outage are now sent. Transactional emails or API calls made during the outage window need to be retried.

    Resolved

  2. PusherIncreased latency on MT1

    This incident has been resolved. The team saw similarities with a previous incident that affected the US2 cluster and acted swiftly to mitigate and prevent further impact. Overall the impact was very small: a few connections saw small delays receiving messages for a very short time.

    Resolved

Sep 13, 2024

  1. BitbucketUnable to connect to Bitbucket Cloud via SSH

    ### **SUMMARY** On September 10, 2024, between 6:34 PM UTC and 7:19 PM UTC, some Atlassian customers experienced an issue preventing users from connecting to Bitbucket Cloud via SSH. The issue arose from a change in how we determined IP allow lists, which inadvertently blocked access for customers with these controls enabled. The incident was promptly identified through our monitoring systems, and our teams initiated response protocols to mitigate the issue. ### **IMPACT** The incident only affected customers who had IP whitelisting enabled on their Bitbucket Cloud accounts. These customers experienced difficulties connecting via SSH due to the unintended blocking caused by a change in the IP allow list computation. The service interruption lasted approximately 45 minutes, during which time affected users were unable to access their repositories through SSH. ### **ROOT CAUSE** A change to IP allow list evaluation was incompatible with a new Bitbucket Cloud networking configuration. This inadvertently blocked SSH access for customers with specific allow lists restrictions enabled. ### **REMEDIAL ACTIONS PLAN & NEXT STEPS** To restore the SSH service, the team quickly rolled back the release responsible for the IP allow list issue. We know that outages impact your productivity. We are prioritizing the following improvement actions to avoid repeating this type of incident: * Improve monitoring coverage of IP allowlisting; * Add additional tests and deployment validation checks for changes to IP allowlist configurations. We apologize to customers whose services were impacted during this incident; we are taking immediate steps to improve the platform’s performance and availability. Atlassian Customer Support

    Resolved

Sep 12, 2024

Sep 10, 2024

Sep 9, 2024

  1. UdemySite is degraded

    We have resolved the stability issue on our site, and performance is back to normal. We appreciate your patience.

    Resolved

Sep 8, 2024

Sep 6, 2024

Sep 5, 2024

Sep 4, 2024

Sep 3, 2024

  1. AirtableIssues loading bases

    Some customers might have encountered issues loading the data or automations tab. This issue has been resolved now. We’re sorry for the inconvenience to our customers’ operations.

    Resolved

Sep 2, 2024

  1. PusherInaccurate Account Usage Warnings Reported

    We have resolved the statistics computation issue. Connection counts should be correct again and remain accurate going forward. Daily message volume counters will still show inflated usage until the end of the day; customers that are concerned about potential throttling due to breaching daily limits can reach out to customer support to ensure access remains uninterrupted.

    Resolved

Sep 1, 2024

Aug 31, 2024

Aug 30, 2024

  1. AirtableIncreased Error Rates

    We have mitigated this issue, and Airtable's service is now operating normally. We apologize for the inconvenience.

    Resolved

Older incidents