Resolved incident

Retroactive Incident: Datastore issue in US-East causing intermittent errors

Apigee · None · Started

Duration
< 1m
Severity
None
Status
Resolved

Summary

None · Resolved

This is a retroactive post on an incident that occurred this morning between 05:39-06:18 PST. We detected elevated errors with our Cassandra service in the US-East region related to a single node event. During this time, customer API calls in this region would have seen intermittent API 5XX errors for approximately 5-10% of their calls for approx. 40 mins. Services in all other regions were not impacted by this incident. The node in question was removed from service to mitigate impact pending further analysis. We're investigating the root cause of this incident and will make the necessary changes to prevent a recurrence of this issue. We apologize for the inconvenience this may have caused you and your business -- and we don't take that lightly. If you have any further questions or may be seeing impacts related to this, please file a case with Support.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Resolved

    Apigee

    This is a retroactive post on an incident that occurred this morning between 05:39-06:18 PST. We detected elevated errors with our Cassandra service in the US-East region related to a single node event. During this time, customer API calls in this region would have seen intermittent API 5XX errors for approximately 5-10% of their calls for approx. 40 mins. Services in all other regions were not impacted by this incident. The node in question was removed from service to mitigate impact pending further analysis. We're investigating the root cause of this incident and will make the necessary changes to prevent a recurrence of this issue. We apologize for the inconvenience this may have caused you and your business -- and we don't take that lightly. If you have any further questions or may be seeing impacts related to this, please file a case with Support.