Incident with Codespaces

Incident Report for GitHub

Resolved

On July 17th, 2024 between 17:56 and 18:13 UTC the Codespaces service was degraded and 5% of codespaces were failing to start after creation. After analyzing the failing codespaces, we realized that all of them had reached the 1 hour timeout allocated for starting. Further, we realized that the root cause of the timeouts was the larger incident earlier in the day due to updating github’s network hardware.
We realized this incident was already mitigated by the mitigation of the earlier incident.
We are working to see if we can improve our incident response process to better understand the connection between incidents in the future and avoid unnecessary incident noise for customers.

Posted Jul 17, 2024 - 18:13 UTC

Investigating

We are investigating reports of degraded performance for Codespaces

Posted Jul 17, 2024 - 17:56 UTC

This incident affected: Codespaces.

Product

Platform

Support

Company