Resolved incident

Cloud Latency, Delays, Connection Issues

Cockroach Labs · Major · Started

Duration
4h 9m
Severity
Major
Status
Resolved

Summary

Major · Resolved

Google impacts are now reported as fully resolved. Internal teams have confirmed this report. All services are restored. Should you need further help, please reach out and file a ticket with Support.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Investigating

    Cockroach Labs

    Google Cloud is experiencing networking outages which is affecting Cockroach Cloud customers. Cockroach Cloud customers may experience heightened latency, delays, or connection issues. Our teams are aware and fully engaged on this incident. Known current Impacts: us-central-1, asia-east-1

  2. Investigating

    Cockroach Labs

    Google Cloud is experiencing networking outages which is affecting Cockroach Cloud customers. Cockroach Cloud customers may experience heightened latency, delays, or connection issues. Our teams are aware and fully engaged on this incident. Known current Impacts: us-central-1, asia-east-1

  3. Investigating

    Cockroach Labs

    We are still monitoring the situation, seeing some improvement over the last 15 minutes, but not fully resolved. Known current Impacts: us-central1, asia-east1, europe-west4-b

  4. Monitoring

    Cockroach Labs

    Google is now reporting that us-central1 and asia-east1 are both resolved, however europe-west4-b is still actively impacted. Our internal teams are confirming no further errors in the last 15 minutes for us-central1 and asia-east1 regions. Known current Impacts: europe-west4-b

  5. Monitoring

    Cockroach Labs

    We are learning that Google is reporting us-central1-b is also impacted and experiencing degradation. Following network-level mitigation efforts, the underlying network infrastructure has fully recovered. Google Product engineering teams across Cloud are currently validating the recovery status of individual services.

  6. Resolved

    Cockroach Labs

    Google impacts are now reported as fully resolved. Internal teams have confirmed this report. All services are restored. Should you need further help, please reach out and file a ticket with Support.