Resolved incident

Infrastructure Instability

DNSimple · Major · Started

Duration
6h 12m
Severity
Major
Status
Resolved

Summary

Major · Resolved

This incident has been resolved.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Investigating

    DNSimple

    We are currently investigating an issue affecting our infrastructure that is causing some applications to restart unexpectedly. As a result, customers may experience intermittent disruptions or degraded performance across our systems. Our team is actively working to stabilize the situation and restore normal operation as quickly as possible. We’ll continue to share updates here as we learn more. Thank you for your patience.

  2. Investigating

    DNSimple

    We are running restores to bring back services online

  3. Identified

    DNSimple

    The issue has been identified and a fix is being implemented.

  4. Identified

    DNSimple

    Our initial attempts to restore our cluster has failed. We are working on bringing the services up in a fresh cluster. Thank you for your patience

  5. Identified

    DNSimple

    We are still working diligently to restore service in our new production orchestration cluster. We will continue to provide updates as the status changes.

  6. Identified

    DNSimple

    We've started restoring backend services. We expect to have services restored shortly!!

  7. Identified

    DNSimple

    Restores are completing and we will be bringing DNS services back online soon.

  8. Identified

    DNSimple

    Nameservers are currently recovering, and we are bringing other services online.

  9. Identified

    DNSimple

    We've restored half of our infrastructure, and are presently restoring services for the other half.

  10. Identified

    DNSimple

    We've restored most customer facing services. We are still actively restoring the Sandbox API and other internal services. Thanks.

  11. Identified

    DNSimple

    Production services are back online. We are monitoring their state and continuing to work on the Sandbox API and other services.

  12. Monitoring

    DNSimple

    All systems are currently operational and the team is continuing to monitor while we investigate.

  13. Resolved

    DNSimple

    This incident has been resolved.