Resolved incident
Run logs are being dropped
Trigger.dev · Unknown · Started
- Duration
- 30m
- Severity
- Unknown
- Status
- Resolved
Summary
Resolved
Logs are being fully ingested again. The issue was with the internal workers in our shared OpenTelemetry service. They became unhealthy but weren't rolled. We're looking into why and how to prevent this from happening again.
Event timeline
How this incident unfolded, from the official status page.
Resolved
Trigger.dev
Logs are being fully ingested again. The issue was with the internal workers in our shared OpenTelemetry service. They became unhealthy but weren't rolled. We're looking into why and how to prevent this from happening again.
Unknown
Trigger.dev
We're investigating run logs being dropped (from your run when you do console.log/logger.log). This doesn't impact run operation but does impact observability. This isn't due to a code or configuration change. More information soon.