Intermittent disruption with Copilot completions and inline suggestions

Resolved

Minor impact

Started

Lasted 2h 43m

View official incident ↗

Updates

  1. Resolved

    Between February 11th 21:30 UTC and February 12th 15:40 UTC, users in Western Europe experienced degraded quality for all Next Edit Suggestions requests. Additionally, on February 12th, between 18:40 UTC and 20:30 UTC, users in Australia and South America experienced degraded quality and increased latency of up to 500ms for all Next Edit Suggestions requests. The root cause was a newly introduced regression in an upstream service dependency.<br /><br />The incident was mitigated by failing over Next Edit Suggestions traffic to unaffected regions, which caused the increased latency. Once the regression was identified and rolled back, we restored the impacted capacity. We have improved our quality analysis tooling and are working on more robust quality impact alerting to accelerate detection of these issues in the future.

  2. Investigating

    We are experiencing degraded availability in Western Europe for Copilot completions and suggestions. We are working to resolve the issue.<br />

  3. Investigating

    We are experiencing degraded availability in some regions for Copilot completions and suggestions. We are working to resolve the issue.

  4. Investigating

    We are investigating reports of impacted performance for some GitHub services.