Networking issue causing timeouts and 50x errors
The incident has now been resolved. Two individual problems were discovered and mitigated:
- DNS lookup failures in our London based clusters. This was caused by a configuration error with an upstream DNS resolver causing it to reject any dnssec-enabled queries.
- Packet loss in us-east-3/4/5 clusters. This was caused by a hardware issue with a hypervisor which caused degraded networking performance with a subset of worker nodes. The fault has been resolved.
A degradation of network connectivity in two data centres is causing timeouts and other connection errors with traffic between project components and out to the public internet. We're liaising with our server provider to identify and rectify the root cause.
-
Clusters
-
UK-LONDON-2
-
UK-LONDON-4
-
UK-LONDON-5
-
US-EAST-3
-
US-EAST-5
-
Find Your Subscription
We’ll find your subscription and send you a link to login to manage your preferences.
Check Your Inbox
We've sent you an email — please check your inbox and click the link to continue.
Subscribe to Status Updates
We’ll use your email to save your preferences so you can update them later.
-
Email{{ value }}
-
Slack
Subscribe to other services using the bell icon on the subscribe button on the status page.
Unsubscribe Completely?
You’ll no long receive any status updates from Servd, are you sure?
{{ error }}
You’re Unsubscribed!
We’ll no longer send you any status updates about Servd.
Subscription Confirmed
Your email has been verified — you'll now receive status updates from Servd.