CC's - Elevated delays in Actions workflow runs and Pull Request status updates – Incident details

All systems operational

Elevated delays in Actions workflow runs and Pull Request status updates

Resolved
Degraded performance
Started about 2 months agoLasted 23 minutes

Affected

第三方

Operational from 1:02 PM to 1:02 PM, Partial outage from 1:02 PM to 1:20 PM, Operational from 1:20 PM to 1:25 PM

GitHub → Actions

Operational from 1:02 PM to 1:02 PM, Partial outage from 1:02 PM to 1:20 PM, Operational from 1:20 PM to 1:25 PM

Updates
  • Resolved
    Resolved

    On March 30, 2026, between 10:11 UTC and 13:25 UTC, GitHub Actions experienced degraded performance. During this time, approximately 2.65% of workflow jobs triggered by pull request events experienced start delays exceeding 5 minutes. The issue was caused by replication lag on an internal database cluster used by Actions, which triggered write throttling in our database protection layer and slowed job queue processing.

    The replication lag originated from planned maintenance to scale the internal database. Newly added database hosts triggered guardrails in the throttling layer, restricting write throughput. The incident was mitigated by excluding the new hosts from replication delay calculations.

    To prevent recurrence, we have updated our maintenance procedures to ensure new hosts are excluded from throttling assessments during scaling operations. Additionally, we are investing in automation to streamline this type of maintenance activity.

  • Update
    Update

    The degradation has been mitigated. We are monitoring to ensure stability.

  • Monitoring
    Monitoring

    The degradation affecting Actions and Pull Requests has been mitigated. We are monitoring to ensure stability.

  • Investigating
    Investigating

    We are investigating reports of degraded performance for Actions and Pull Requests