Resolved incident

Metric ingestion delayed

Weights & Biases · Minor · Started

Duration
7h 21m
Severity
Minor
Status
Resolved

Summary

Minor · Resolved

This incident has been resolved.

View official incident ↗

Event timeline

How this incident unfolded, from the official status page.

  1. Identified

    Weights & Biases

    We are currently responding to delay of up to 5 hours for metrics written into wandb. We have identified the issue and are working to process metrics as quickly as possible. There is no data loss and all data will be complete once the backlog has drained. We're very sorry for the disruption.

  2. Monitoring

    Weights & Biases

    We identified an infrastructure issue as the root cause and have resolved it. We are rapidly working through the backlog of ingested metrics and should fully catch up soon.

  3. Resolved

    Weights & Biases

    This incident has been resolved.