ARCHIVED OFFICIAL INCIDENT

Incident with Webhooks

GitHub · Last saved provider status: resolved

Current service report →
This is historical evidence.

The last saved event status is not the current service status. Source lists can be incomplete, and disappearance from a source does not confirm recovery. Open the current report or the official source for newer evidence.

Saved event details

Provider status
resolved
Provider impact
minor
Provider record created
13 Aug 2026, 14:45:40 UTC
Provider record updated
31 Aug 2026, 20:37:37 UTC
Explicit provider start
13 Aug 2026, 14:45:40 UTC
Explicit provider end
13 Aug 2026, 15:36:34 UTC

Affected components reported by the provider

  • Webhooks 4230lsnqdsld
  • Git Operations 8l4ygp009s5s
  • Pull Requests hhtssxt0f5v2
  • Issues kr09ddfgbfsf
  • Packages st3j38cctv9l

These associations describe this event’s reported scope. They do not establish current component availability or verified dependencies.

A record creation time is not necessarily an outage start. Unreported times remain unavailable. We do not calculate downtime from collection times.

Provider updates in saved revisions

Latest first. We show up to 100 distinct updates from the latest 20 saved content revisions. Revised wording at the same provider time is retained separately.

  1. resolved

    Between 14:24 and 14:53 UTC on 13 August 2026, a routine background job to delete an organization overwhelmed a key shared database, causing multiple GitHub services to briefly return elevated errors and slower responses. Most affected was the webhook management API, with smaller impact to Git operations, pull requests, issues, packages, sign-in, and Copilot. Impact cleared on its own at about 14:53 UTC once the job finished; we resolved the incident at 15:36 UTC. <br /><br />Affected users may have experienced a brief increase in errors and slower responses, primarily when creating, listing, or updating webhooks, with smaller impacts to pull requests, issues, packages, and Git operations. Failures peaked at about 1% for several minutes around 14:37 UTC. <br /><br />To prevent future incidents, we've already shipped an update that turns on the safer deletion path for organizations, along with caps on deletion holds on databases. Building on these changes, we're auditing all bulk deletion and cleanup jobs that write to shared databases to prevent similar issues in future.

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC
  2. monitoring

    We have temporarily disabled a background job which caused the impact. At this time the impact is fully mitigated.

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC
  3. monitoring

    The degradation affecting Git Operations, Issues, Packages, Pull Requests and Webhooks has been mitigated. We are monitoring to ensure stability.

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC
  4. investigating

    We are currently investigating a brief degradation of service for Git operations (specifically pushes), issues, pull requests, package registry, and webhooks between 14:32 and 14:46 UTC. We have identified the source of the degradation and are investigating mitigation strategies to prevent recurrence.

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC
  5. investigating

    Packages is experiencing degraded performance. We are continuing to investigate.

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC
  6. investigating

    Git Operations is experiencing degraded performance. We are continuing to investigate.

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC
  7. investigating

    Issues is experiencing degraded performance. We are continuing to investigate.

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC
  8. investigating

    Pull Requests is experiencing degraded performance. We are continuing to investigate.

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC
  9. investigating

    We are investigating reports of degraded performance for Webhooks

    Seen in a saved revision at 06 Oct 2026, 13:58:39 UTC