rssLink RSS for all categories
 
icon_red
icon_green
icon_green
icon_blue
icon_red
icon_green
icon_green
icon_red
icon_red
icon_red
icon_green
icon_green
icon_green
icon_orange
icon_green
icon_blue
icon_green
icon_green
icon_red
icon_red
icon_green
icon_red
icon_green
icon_red
icon_orange
icon_green
icon_green
icon_blue
icon_green
icon_green
icon_green
icon_blue
 

FS#40248 — WebHosting Cluster003 migration

Attached to Project— Web Hosting / CloudDB
Amélioration
Cluster003 (240plan)
CLOSED
100%
------ FR -----

Dans le cadre de la migration Web Hosting depuis le datacentre localisé à Paris vers notre datacentre de Gravelines, nous débutons la migration du cluster003.

Les Migrations vont avoir lieu de nuit entre le 10 et le 19 septembre

Vous pourrez suivre l'avancement de la migration sur cette tâche.

------ EN -----

In the context of Web Hosting platform migration from datacenter located in Paris to Gravelines, we start migration of cluster003.

Migrations will begin during the night between 10th and 19th September

If you want to follow theses operations, we will update this task.
Date:  Monday, 23 September 2019, 10:06AM
Reason for closing:  Done
Comment by OVH - Tuesday, 03 September 2019, 21:10PM

------ FR ------

Aujourd'hui, nous allons switcher le trafic de nos loadbalancers de Paris vers ceux de Gravelines.

Tous les détails sont ici : http://travaux.ovh.net/?do=details&id=40358

------ EN ------

Today, we will move the traffic from our Paris loadbalancer to Gravelines datacenters

All details here: http://travaux.ovh.net/?do=details&id=40358


Comment by OVH - Tuesday, 03 September 2019, 23:41PM

------ EN ------

IP migration done.

Next step on thurday 10th September with accounts migrations


------ FR ------

Les IP ont correctement été migrées.

La prochaine étape est le mardi 10 septembre avec la première nuit de migration de comptes.


Comment by OVH - Tuesday, 10 September 2019, 22:03PM

filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2332, filerz2305 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.


Comment by OVH - Tuesday, 10 September 2019, 23:00PM

FR : Le transfert des données prenant trop de retard par rapport aux autres filers, la migration de filerz2332 est reportée. La migration se poursuit normalement pour les autres.

En : Data transfer becoming too long, the migration of filerz2332 is rescheduled to another night. The migration keeps going normally for the others.


Comment by OVH - Tuesday, 10 September 2019, 23:16PM

filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2305 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.


Comment by OVH - Tuesday, 10 September 2019, 23:50PM

filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2305 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.


Comment by OVH - Wednesday, 11 September 2019, 01:57AM

filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2305 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity.


Comment by OVH - Wednesday, 11 September 2019, 02:18AM

FR : Toutes les tâches sont de nouveau actives.
EN : All job tasks are active again.


Comment by OVH - Wednesday, 11 September 2019, 02:43AM

filerz56, filerz718, filerz514, filerz398, filerz557, filerz333, filerz671, filerz183, filerz318, filerz2305 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.


Comment by OVH - Wednesday, 11 September 2019, 21:54PM

filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.


Comment by OVH - Wednesday, 11 September 2019, 22:27PM

filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.


Comment by OVH - Wednesday, 11 September 2019, 23:17PM

filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.


Comment by OVH - Thursday, 12 September 2019, 02:06AM

filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity.


Comment by OVH - Thursday, 12 September 2019, 02:45AM

filerz618, filerz623, filerz649, filerz648, filerz668, filerz504, filerz354, filerz50, filerz133, filerz2138, filerz2352, filerz2332 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.


Comment by OVH - Thursday, 12 September 2019, 21:52PM

filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.


Comment by OVH - Thursday, 12 September 2019, 22:53PM

filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.


Comment by OVH - Thursday, 12 September 2019, 23:55PM

filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.


Comment by OVH - Friday, 13 September 2019, 01:41AM

FR : Application des configurations : 75% effectué / Migration des bases de données : 99% effectué
EN : Hosting configuration : 75% done / Databases migration : 99% done


Comment by OVH - Friday, 13 September 2019, 02:41AM

filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity.


Comment by OVH - Friday, 13 September 2019, 02:58AM

FR : Toutes les tâches sont de nouveau actives.
EN : All job tasks are active again.


Comment by OVH - Friday, 13 September 2019, 05:00AM

filerz376, filerz513, filerz710, filerz522, filerz654, filerz506, filerz760, filerz51, filerz521, filerz2221, filerz2328 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.


Comment by OVH - Monday, 16 September 2019, 22:13PM

filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.


Comment by OVH - Monday, 16 September 2019, 22:37PM

filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.


Comment by OVH - Monday, 16 September 2019, 23:29PM

filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.


Comment by OVH - Tuesday, 17 September 2019, 01:38AM

filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity


Comment by OVH - Tuesday, 17 September 2019, 02:25AM

FR : Toutes les tâches sont de nouveau actives.
EN : All job tasks are active again.


Comment by OVH - Tuesday, 17 September 2019, 02:37AM

filerz378, filerz753, filerz380, filerz93, filerz313, filerz342, filerz53, filerz2349, filerz218, filerz2216, filerz2334 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.


Comment by OVH - Tuesday, 17 September 2019, 21:38PM

filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.


Comment by OVH - Tuesday, 17 September 2019, 22:07PM

filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données.
EN : All the websites are now unavailable, we are doing the last data transfer.


Comment by OVH - Tuesday, 17 September 2019, 22:52PM

filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration.


Comment by OVH - Wednesday, 18 September 2019, 00:54AM

filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : Les configurations sont terminées, tous les sites web sont de nouveau accessibles. Nous vérifions l'intégrité de la migration.
EN : Configurations are done, all the websites are now available again. We are checking the migration integrity.


Comment by OVH - Wednesday, 18 September 2019, 01:35AM

FR : Toutes les tâches sont de nouveau actives.
EN : All job tasks are active again.


Comment by OVH - Wednesday, 18 September 2019, 01:46AM

filerz2343, filerz509, filerz721, filerz656, filerz353, filerz335, filerz687, filerz68, filerz52, filerz594 :

FR : La migration est terminée. Tous les sites web et leurs bases de données sont maintenant hébergés à Gravelines et fonctionnels.
EN : The migration is done. All the websites and their databases are now hosted in Gravelines, up and running.


Comment by OVH - Wednesday, 18 September 2019, 21:41PM

filerz516, filerz617, filerz647, filerz307, filerz416, filerz487, filerz483, filerz57, filerz2324, filerz2333 :

FR : Nous démarrons la migration des hébergements situés sur ces filers. Toutes les tâches sont inactives.
EN : We are starting migrating the hostings located on these filers. All job tasks are inactive.


Comment by OVH - Wednesday, 18 September 2019, 21:53PM

Hi,

Today is a very special day. It's the last night of this migration.
After this night, all websites will be migrated and our historical datacenter will be empty.

So, all members of the team are behind their screen tonight.
And we will explain how works our migration during the night.


Comment by OVH - Wednesday, 18 September 2019, 22:01PM

First, we need to prepare the night.

To operate the migration in a good way, we cut all our "robots" and operations linked to our infrastructure.
For instance, we avoid to create new databases in Paris with the hosting in migration to Gravelines. That's why, each night, our operations are stopped.

After, we test 10% of the websites we will migrate during the night. We record, HTTP status code, page size and generation time. At the end of the migration, we will restest it in the new datacenter and compare the results. To ensure all the websites runs well after the migration. For instance, tonight, we have tested 6200 websites.


Comment by OVH - Wednesday, 18 September 2019, 22:01PM

filerz516, filerz617, filerz647, filerz307, filerz416, filerz487, filerz483, filerz57, filerz2324, filerz2333 :

FR : Tous les sites web sont maintenant indisponibles, nous effectuons le dernier transfert de données
EN : All the websites are now unavailable, we are doing the last data transfer.


Comment by OVH - Wednesday, 18 September 2019, 22:14PM

When the migration is ready, we launch operations.

First step of the migration: we put websites in maintenance mode. By this way, we are sure their is no changement on filesystem or databases recorded in Paris but not migrated.

After, we block all access to the filesystem. On our infrastructures, files are stored on specific servers called "filerz".
To do it, we are updating our configuration via puppet and launch a command accross all our servers to umount the remote filerz from web servers.

Filerz use ZFS technology to store the data. To be sure nobody will write any new informations on the filesystem, we umount the filesystem too.
This step takes few minutes: the system is waiting their is no more access to the filesystem to close all connections.


Comment by OVH - Wednesday, 18 September 2019, 22:26PM

10 minutes later, filesystem are unmount on all filerz. We will send data from Paris to Gravelines.
To be sure the operation is not so long, we begins to send data one month ago.

During all the month, we send "incrementals". It means we sent only the differences written on filesystem from the last synchronisation.
One incremental maximum per day.

This morning, we "accelerate" it with one incremental per hour. So, tonight, the duration of migration will take only few minutes.


Comment by OVH - Wednesday, 18 September 2019, 22:36PM

When all data are migrated in Gravelines, we are sure all went well, and we can launch the databases migration.

On web servers, we mount the new filerz on Gravelines and setup alls the machines.
To do it well on all our infrastructures, it will take 45 minutes.

We also change all the accounts configuration inside our databases. We migrate data into our internal databases, but also the servers configurations.
We also create the good configuration for the logs system.

Our robot take each webhosting account and do theses operations one by one. It will take 15 minutes. But we are doing in the same time of mounting filerz on webservers.


Comment by OVH - Wednesday, 18 September 2019, 22:43PM

For databases, we migrate each databases one by one.

First step, we put the database in read only. That have no effect because the website is currently in maintenance mode.
After, we replicate the data into our new database in Gravelines.

When the new database is ready, we change the dns name of the database to redirect to the new one.
And we reopen the database.

The robot manage all the migration and we can migrate up to 700 databases in the same time.
So, by night, we migrate 18 000 databases!


Comment by OVH - Wednesday, 18 September 2019, 22:44PM

filerz516, filerz617, filerz647, filerz307, filerz416, filerz487, filerz483, filerz57, filerz2324, filerz2333 :

FR : Le dernier transfert de données est effectué, nous appliquons les configurations à Gravelines et démarrons la migration des bases de données.
EN : The last data transfer is finished, we are now applying the configurations into Gravelines and starting the databases migration


Comment by OVH - Wednesday, 18 September 2019, 23:28PM

Now, when our internal databases are well updated, we have a last step before reopening websites.

We regenerate the cluster configuration : on which server will be redirected each websites. Including, PHP versions, folder to use to generate the website, crontab to execute...
This step take 50 minutes to be sure the website will running well.



Comment by OVH - Thursday, 19 September 2019, 00:14AM

100% of our databases are now migrated!


Comment by OVH - Thursday, 19 September 2019, 00:31AM

And after, we "just need" to reopen all the websites!

The reopening takes 10 minutes to be effective on all webservers.
We have just launch the robot to reopen it.


Comment by OVH - Thursday, 19 September 2019, 00:42AM

All websites are now reopened.

We will pass on the last step of the migration. Launch tests to ensure the migration went well!
We will load the same tests we run at the beginning of the migration.


Comment by OVH - Thursday, 19 September 2019, 00:53AM

We also check that all databases linked are well migrated. All databases are good.


Comment by OVH - Thursday, 19 September 2019, 00:55AM

During the test phase, we also reactivate all our robots. Now, databases creations will works again, but only in Gravelines!


Comment by OVH - Thursday, 19 September 2019, 01:04AM

Tests are now done. 99,20% of tests are the same results.
The difference is based on website that runned differently with the new hardware.

So, the migration is done! All our customers are now on Gravelines datacenter.


Comment by OVH - Thursday, 19 September 2019, 14:51PM

Logs written during the migration is currently send to the new cluster on Gravelines datacenter.

Estimated ETA : 7 days