Nous rencontrons un problème sur notre infrastructure à P19. Les PrivateSQL hébergés sur ce datacentre sont impactés.
---
We have an issue on our infrastructure on P19. The PrivateSQL hosted on this datacentre are impacted.
Update(s):
Date: 2019-08-23 21:52:03 UTC Completed. The platform is stable.
Date: 2019-08-23 20:00:19 UTC 50% done
Date: 2019-08-23 19:14:06 UTC Servers impacted by this issue have a high probability of crashing until they have been rebooted in a specific way: the services and the OS have to restart softly, but the \"shell\" of the VM (qemu process...) has to be rebuilt.
So we will reboot the PrivateSQL of P19. A 1 to 5 minutes downtime is expected.
Date: 2019-08-23 10:30:45 UTC Almost all server are back online.
Date: 2019-08-23 10:10:25 UTC Ceph cluster is back online, servers are recovering.
Date: 2019-08-23 08:21:06 UTC Ceph cluster is still being recovered (about 94%)
Date: 2019-08-23 06:46:44 UTC Ceph cluster is still being recovered (about 82%).
Date: 2019-08-23 06:17:32 UTC Ceph cluster is still being recovered (about 70%).
Ceph cluster is being recovered (2 instances of data is needed at least for the Ceph cluster to accept Ios).
When the Ceph cluster will be UP, we will restart the PCI infrastructure.
When the PCI infrastructure will be UP, we will restart the services.
Posted Aug 23, 2019 - 05:23 UTC
This incident affected: Web Hosting || Datacenter GRA (Cluster002, Cluster003, Cluster006, Cluster007, Cluster011, Cluster012, Cluster013, Cluster014, Cluster015, Cluster017, Cluster020, Cluster021, Cluster023, Cluster024, Cluster025, Cluster026, Cluster027, Cluster028, Cluster029, Cluster030, Cluster031).