Resolved incident
elevated latency for a small subset of convex deployments
Convex · None · Started
- Duration
- 3h 20m
- Severity
- None
- Status
- Postmortem
Summary
None · Postmortem
We had elevated latencies on a single database that required us to temporarily shed load while resizing and reparenting the db. This lead to a period of elevated latencies for all instances on that database followed by downtime for a smaller subset of instances while we performed the maintenance operation. This issue should not occur under normal circumstances and was due an underlying database problem that required manual intervention to resolve. We apologize for the impact to those impacted!
Event timeline
How this incident unfolded, from the official status page.
Postmortem
Convex
We had elevated latencies on a single database that required us to temporarily shed load while resizing and reparenting the db. This lead to a period of elevated latencies for all instances on that database followed by downtime for a smaller subset of instances while we performed the maintenance operation. This issue should not occur under normal circumstances and was due an underlying database problem that required manual intervention to resolve. We apologize for the impact to those impacted!
Resolved
Convex
This incident has been resolved.
Identified
Convex
A small subset of free instances are experiencing availability issues while we restore service.
Investigating
Convex
We're investigating elevated latency for functions on a subset of Convex deployments