Issues with deployments

Resolved
Resolved

The incident has been resolved and the task runner backlog has been worked through.

Sorry for the interruption!

Avatar for
Updated

The root cause was tracked down to a CloudFlare outage which was preventing us from uploading/downloading bundles in the background. This is currently being rectified by the CloudFlare team: https://www.cloudflarestatus.com/

Avatar for
Recovering

Deployments are beginning to recover. Once confirmed we'll begin work on reducing the current task runner backlog.

Avatar for
Updated

We've paused all background tasks for the time being in an attempt to clear up some of those that are stuck due to deployment issues.

Avatar for
Investigating

We're currently experiencing issues with deployments failing for newly created bundles.

We believe this might be down to a problem with an external storage provider and are investigating.

Avatar for
Began at:

Affected components
  • Task Runner
  • Clusters
    • EU-WEST-1
    • EU-WEST-2
    • EU-WEST-3
    • EU-WEST-5
    • EU-WEST-4
    • UK-LONDON-2
    • UK-LONDON-4
    • UK-LONDON-5
    • US-EAST-1
    • US-EAST-2
    • US-EAST-3
    • US-EAST-5
    • US-EAST-6
    • US-EAST-4