Start time: Wednesday Feb 10 2021 09:00:00 CEST Europe/Paris
Severity level : Major
User impact : Slowness on some hosted websites
Technical impact (DC/geographical area) : GRA2
Scope of impact : All offers on GRA2 (especially cluster005, cluster007, cluster013 and cluster017)
Thank you for your understanding
OVHcloud Technical team
Update(s):
Date: 2021-02-10 16:59:20 UTC Service is now fully functionnal.
Date: 2021-02-10 16:09:59 UTC All mail queues are now empty, emails were transmitted and were not lost.
Date: 2021-02-10 15:56:17 UTC Periodic tasks (cron) on cluster 017 are now working
Date: 2021-02-10 15:55:33 UTC ssh services on clusters 5 and 17 are now available
Date: 2021-02-10 14:48:40 UTC Periodic tasks (cron) on cluster 017 are still not working
Date: 2021-02-10 14:41:58 UTC All clusters are now up and running, service is fully functionnal. A delay can be observed when sending email because of important amount of emails kept in queue during incident.
Date: 2021-02-10 13:52:47 UTC All the clusters are now stabilised, the websites are accessible despite some services still not functional such as the mails on cluster013 and cluster017. Access to third party services from the websites as well as the creation of new databases is currently not possible on cluster017.
Date: 2021-02-10 10:52:45 UTC Website can now contact third party web services except for cluster017.
We working on it.
Date: 2021-02-10 10:12:57 UTC The incident is still ongoing.
All our teams are on deck to deliver the service as quickly as possible.
Date: 2021-02-10 09:33:32 UTC Websites are always accessible but they cannot contact third party web services.
Date: 2021-02-10 09:24:53 UTC SSH and FTP access to the cluster005 and cluster017 is currently impossible.
Date: 2021-02-10 09:13:40 UTC cluster007 and cluster013 suffer a stronger impact.
We are doing everything we can to restore the situation on theses two clusters.
Date: 2021-02-10 08:45:13 UTC Cluster013's mail servers are impacted. The mails coming from this cluster cannot be sent at the moment.
Once the servers are back, the mails sent during this period will be transmitted.
Posted Feb 10, 2021 - 08:37 UTC
This incident affected: Web Hosting || Datacenter GRA (Cluster002, Cluster003, Cluster006, Cluster007, Cluster011, Cluster012, Cluster013, Cluster014, Cluster015, Cluster017, Cluster020, Cluster021, Cluster023, Cluster024, Cluster025, Cluster026, Cluster027, Cluster028, Cluster029, Cluster030, Cluster031).