OVHcloud Public Cloud Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
storage.bhs1.cloud.ovh.net
Scheduled Maintenance Report for Public Cloud
Completed
Latencies are unusually high, we are investigating

Update(s):

Date: 2018-01-22 05:21:42 UTC
Latencies and bandwidth are back to normal values

Date: 2018-01-19 20:42:46 UTC
we managed to improve bandwidth on this cluster, the situation is not yet satisfying but is no more critical

Date: 2018-01-19 16:57:29 UTC
the new batch of servers are now in production

Date: 2018-01-19 15:17:59 UTC
We managed to stabilize the latencies, but they are still high. We are ordering a new batch of servers

Date: 2018-01-19 13:28:26 UTC
the 4 additional nodes are now in production

Date: 2018-01-19 10:52:34 UTC
4 more nodes have been delivered, we are installing and preparing them for production

Date: 2018-01-19 10:27:55 UTC
We added an additional node, bandwidth is better but latencies increased, we are ordering more hardware

Date: 2018-01-19 09:46:47 UTC
With the newly added capacity on swift side load balancers are now overloaded

Date: 2018-01-19 09:25:09 UTC
2 more nodes are now handling requests

Date: 2018-01-19 08:48:23 UTC
We are deploying proxy service on account/container servers and adding a spare host as an additional proxy server

Date: 2018-01-19 08:41:45 UTC
There is still an issue on bandwidth, we are adding resources in the cluster

Date: 2018-01-19 08:35:02 UTC
The upgraded proxy is back in production and behaves normally

Date: 2018-01-19 08:30:32 UTC
This fault proxy server missed a kernel patch which fixes a bug in TCP stack, resulting in high load (lots of soft IRQs) : https://github.com/torvalds/linux/commit/627f3abeeac1354a4b15eaf0f22b8ffb901029cb
We upgraded its kernel and are rebooting it

Date: 2018-01-19 08:26:01 UTC
Latencies are back to normal values

Date: 2018-01-19 08:17:56 UTC
We identified and are isolating a suspicious swift-proxy server
Posted Jan 19, 2018 - 08:08 UTC