Previous incidents

May 2022
May 17, 2022
1 incident

Occasional API timeouts

Degraded

Resolved May 17 at 03:00pm PDT

We have scaled services to address the issue.

1 previous update

May 10, 2022
1 incident

Database issues

Downtime

Resolved May 10 at 01:30pm PDT

We will be providing a post mortem by the end of the week.

2 previous updates

May 06, 2022
1 incident

New test runs are not scheduling

Degraded

Resolved May 06 at 10:25am PDT

Test runs are scheduling again, we are still actively monitoring to make sure there are not additional issues.

2 previous updates

April 2022
No incidents reported
March 2022
Mar 09, 2022
1 incident

Test runs are slow to start or stalled

Degraded

Resolved Mar 09 at 11:20am PST

We identified the cause and runs are happening normally now

1 previous update

Mar 02, 2022
1 incident

Test runs slow to start or canceled

Degraded

Resolved Mar 02 at 01:33pm PST

This partial run outage is now resolved. For approximately 2 hours, some test runner nodes were unable to pull images from DockerHub, leading to scheduled runs failing to start. We took several steps to mitigate the issue but we believe it to be a temporarily issue with the DockerHub API that is resolved. At this point, all runs seem to be succeeding normally.

1 previous update