Sync actions failing to complete

Resolved
Resolved
After 6 hours and 11 minutes

The underlying problem has been resolved and the background task runner has been reactivated.

All tasks which were queued during the period have been cancelled in order to prevent them from making changes to your projects unsupervised. Please feel free to retry them now.

Avatar for
{:closed=>"Closed", :complete=>"Complete", :false_alarm=>"False Alarm", :identified=>"Identified", :investigating=>"Investigating", :open=>"Open", :recovering=>"Recovering", :resolved=>"Resolved", :scheduled=>"Scheduled", :underway=>"Underway"}
After 42 minutes

We've temporarily disabled the task runner to prevent lots of failing jobs from getting stuck in a backlog. We'll re-enable once the problem is cleared up. Until then tasks will remain in a pending state.

Avatar for
Identified
After 34 minutes

The underlying issue is with the API used to communicate with our compute resources and can be tracked here:

https://status.digitalocean.com/incidents/3y4pzklzvmls?u=8v986m00nxhy

Avatar for
Investigating

Sync actions to deploy or update project components are currently failing to complete. There's no service interruption to user-facing traffic. Currently investigating the root cause.

Avatar for
Began at:

Affected components
  • Task Runner