Resolved incident
Metric ingestion delayed
Weights & Biases · Minor · Started
- Duration
- 7h 21m
- Severity
- Minor
- Status
- Resolved
Summary
Minor · Resolved
This incident has been resolved.
Event timeline
How this incident unfolded, from the official status page.
Identified
Weights & Biases
We are currently responding to delay of up to 5 hours for metrics written into wandb. We have identified the issue and are working to process metrics as quickly as possible. There is no data loss and all data will be complete once the backlog has drained. We're very sorry for the disruption.
Monitoring
Weights & Biases
We identified an infrastructure issue as the root cause and have resolved it. We are rapidly working through the backlog of ingested metrics and should fully catch up soon.
Resolved
Weights & Biases
This incident has been resolved.