OVHcloud Web Hosting Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
WebHosting Cluster003 migration
Scheduled Maintenance Report for Web Cloud
Completed
------ FR -----

Dans le cadre de la migration Web Hosting depuis le datacentre localisé à Paris vers notre datacentre de Gravelines, nous débutons la migration du cluster003.

Les Migrations vont avoir lieu de nuit entre le 10 et le 19 septembre

Vous pourrez suivre l'avancement de la migration sur cette tâche.

------ EN -----

In the context of Web Hosting platform migration from datacenter located in Paris to Gravelines, we start migration of cluster003.

Migrations will begin during the night between 10th and 19th September

If you want to follow theses operations, we will update this task.

Update(s):

Date: 2019-09-19 12:51:14 UTC
Logs written during the migration is currently send to the new cluster on Gravelines datacenter.

Estimated ETA : 7 days

Date: 2019-09-18 23:04:37 UTC
Tests are now done. 99,20% of tests are the same results.
The difference is based on website that runned differently with the new hardware.

So, the migration is done! All our customers are now on Gravelines datacenter.

Date: 2019-09-18 22:55:21 UTC
During the test phase, we also reactivate all our robots. Now, databases creations will works again, but only in Gravelines!

Date: 2019-09-18 22:53:27 UTC
We also check that all databases linked are well migrated. All databases are good.

Date: 2019-09-18 22:42:23 UTC
All websites are now reopened.

We will pass on the last step of the migration. Launch tests to ensure the migration went well!
We will load the same tests we run at the beginning of the migration.

Date: 2019-09-18 22:31:51 UTC
And after, we \"just need\" to reopen all the websites!

The reopening takes 10 minutes to be effective on all webservers.
We have just launch the robot to reopen it.

Date: 2019-09-18 22:14:22 UTC
100% of our databases are now migrated!

Date: 2019-09-18 21:28:15 UTC
Now, when our internal databases are well updated, we have a last step before reopening websites.

We regenerate the cluster configuration : on which server will be redirected each websites. Including, PHP versions, folder to use to generate the website, crontab to execute...
This step take 50 minutes to be sure the website will running well.




Date: 2019-09-18 20:44:11 UTC
filerz516, filerz617, filerz647, filerz307, filerz416, filerz487, filerz483, filerz57, filerz2324, filerz2333 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration

Date: 2019-09-18 20:43:28 UTC
For databases, we migrate each databases one by one.

First step, we put the database in read only. That have no effect because the website is currently in maintenance mode.
After, we replicate the data into our new database in Gravelines.

When the new database is ready, we change the dns name of the database to redirect to the new one.
And we reopen the database.

The robot manage all the migration and we can migrate up to 700 databases in the same time.
So, by night, we migrate 18 000 databases!

Date: 2019-09-18 20:36:44 UTC
When all data are migrated in Gravelines, we are sure all went well, and we can launch the databases migration.

On web servers, we mount the new filerz on Gravelines and setup alls the machines.
To do it well on all our infrastructures, it will take 45 minutes.

We also change all the accounts configuration inside our databases. We migrate data into our internal databases, but also the servers configurations.
We also create the good configuration for the logs system.

Our robot take each webhosting account and do theses operations one by one. It will take 15 minutes. But we are doing in the same time of mounting filerz on webservers.

Date: 2019-09-18 20:26:12 UTC
10 minutes later, filesystem are unmount on all filerz. We will send data from Paris to Gravelines.
To be sure the operation is not so long, we begins to send data one month ago.

During all the month, we send \"incrementals\". It means we sent only the differences written on filesystem from the last synchronisation.
One incremental maximum per day.

This morning, we \"accelerate\" it with one incremental per hour. So, tonight, the duration of migration will take only few minutes.

Date: 2019-09-18 20:14:26 UTC
When the migration is ready, we launch operations.

First step of the migration: we put websites in maintenance mode. By this way, we are sure their is no changement on filesystem or databases recorded in Paris but not migrated.

After, we block all access to the filesystem. On our infrastructures, files are stored on specific servers called \"filerz\".
To do it, we are updating our configuration via puppet and launch a command accross all our servers to umount the remote filerz from web servers.

Filerz use ZFS technology to store the data. To be sure nobody will write any new informations on the filesystem, we umount the filesystem too.
This step takes few minutes: the system is waiting their is no more access to the filesystem to close all connections.

Date: 2019-09-18 20:01:55 UTC
filerz516, filerz617, filerz647, filerz307, filerz416, filerz487, filerz483, filerz57, filerz2324, filerz2333 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données
EN : All the websites are now unavailable, we are doing the last data transfer.

Date: 2019-09-18 20:01:30 UTC
First, we need to prepare the night.

To operate the migration in a good way, we cut all our \"robots\" and operations linked to our infrastructure.
For instance, we avoid to create new databases in Paris with the hosting in migration to Gravelines. That's why, each night, our operations are stopped.

After, we test 10% of the websites we will migrate during the night. We record, HTTP status code, page size and generation time. At the end of the migration, we will restest it in the new datacenter and compare the results. To ensure all the websites runs well after the migration. For instance, tonight, we have tested 6200 websites.

Date: 2019-09-18 19:53:08 UTC
Hi,

Today is a very special day. It's the last night of this migration.
After this night, all websites will be migrated and our historical datacenter will be empty.

So, all members of the team are behind their screen tonight.
And we will explain how works our migration during the night.

Date: 2019-09-18 19:41:45 UTC
filerz516, filerz617, filerz647, filerz307, filerz416, filerz487, filerz483, filerz57, filerz2324, filerz2333 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.

Date: 2019-09-17 23:46:28 UTC
filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.

Date: 2019-09-17 23:35:54 UTC
FR : Toutes les tâches sont de nouveau actives.
EN : All job tasks are active again.

Date: 2019-09-17 22:54:25 UTC
filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity.

Date: 2019-09-17 20:52:39 UTC
filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.

Date: 2019-09-17 20:07:11 UTC
filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.

Date: 2019-09-17 19:38:07 UTC
filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.

Date: 2019-09-17 00:37:11 UTC
filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.

Date: 2019-09-17 00:25:00 UTC
FR : Toutes les tâches sont de nouveau actives.
EN : All job tasks are active again.

Date: 2019-09-16 23:38:22 UTC
filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity

Date: 2019-09-16 21:29:32 UTC
filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.

Date: 2019-09-16 20:37:41 UTC
filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.

Date: 2019-09-16 20:13:02 UTC
filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.

Date: 2019-09-13 03:00:15 UTC
filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.

Date: 2019-09-13 00:58:21 UTC
FR : Toutes les tâches sont de nouveau actives.
EN : All job tasks are active again.

Date: 2019-09-13 00:41:07 UTC
filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity.

Date: 2019-09-12 23:41:17 UTC
FR : Application des configurations : 75% effectué / Migration des bases de données : 99% effectué
EN : Hosting configuration : 75% done / Databases migration : 99% done

Date: 2019-09-12 21:55:51 UTC
filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.

Date: 2019-09-12 20:53:13 UTC
filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.

Date: 2019-09-12 19:52:51 UTC
filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.

Date: 2019-09-12 00:45:29 UTC
filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.

Date: 2019-09-12 00:06:06 UTC
filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity.

Date: 2019-09-11 21:17:20 UTC
filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.

Date: 2019-09-11 20:27:05 UTC
filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.

Date: 2019-09-11 19:54:32 UTC
filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.

Date: 2019-09-11 00:43:53 UTC
filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2305 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.

Date: 2019-09-11 00:18:08 UTC
FR : Toutes les tâches sont de nouveau actives.
EN : All job tasks are active again.

Date: 2019-09-10 23:57:05 UTC
filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2305 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity.

Date: 2019-09-10 21:50:40 UTC
filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2305 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.

Date: 2019-09-10 21:16:50 UTC
filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2305 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.

Date: 2019-09-10 21:00:52 UTC
FR : Le transfert des données prenant trop de retard par rapport aux autres filers, la migration de filerz2332 est reportée. La migration se poursuit normalement pour les autres.

En : Data transfer becoming too long, the migration of filerz2332 is rescheduled to another night. The migration keeps going normally for the others.

Date: 2019-09-10 20:03:08 UTC
filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2332, filerz2305 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.

Date: 2019-09-03 21:41:52 UTC
------ EN ------

IP migration done.

Next step on thurday 10th September with accounts migrations


------ FR ------

Les IP ont correctement été migrées.

La prochaine étape est le mardi 10 septembre avec la première nuit de migration de comptes.

Date: 2019-09-03 19:10:19 UTC
------ FR ------

Aujourd'hui, nous allons switcher le trafic de nos loadbalancers de Paris vers ceux de Gravelines.

Tous les détails sont ici : http://travaux.ovh.net/?do=details&id=40358

------ EN ------

Today, we will move the traffic from our Paris loadbalancer to Gravelines datacenters

All details here: http://travaux.ovh.net/?do=details&id=40358
Posted Aug 27, 2019 - 09:32 UTC
This scheduled maintenance affected: Web Hosting || Datacenter GRA (Cluster002, Cluster003, Cluster006, Cluster007, Cluster011, Cluster012, Cluster013, Cluster014, Cluster015, Cluster017, Cluster020, Cluster021, Cluster023, Cluster024, Cluster025, Cluster026, Cluster027, Cluster028, Cluster029, Cluster030, Cluster031).