Secrets service outage

Updates

1. Resolved

   3 months ago

   This incident has been resolved.

2. Monitoring

   3 months ago

   We have failed over the secrets database to a replica, and the Machines API appears healthy now. We are monitoring for any further issues.

3. Identified

   3 months ago

   We are working to recover our secrets service after a failed deployment. Apps continue to run, but it is not possible to create new apps or update secrets at this time.