OVHcloud Web Hosting Status
Current status
Legend
- Operational
- Degraded performance
- Partial Outage
- Major Outage
- Under maintenance
Exchange 2010
Incident
Report for Web Cloud
Resolved
Suite à l'incident \"FS#15332 — tete-469\", plusieurs serveurs de l'offre Exchange 2010 ne sont plus disponibles.
Les équipes investiguent.
Serveurs impactés:
xc34.mail.ovh.net
xc75.mail.ovh.net
xc97.mail.ovh.net
xc116.mail.ovh.net
xc136.mail.ovh.net
exchange-ae5914-001
exchange-as5598-001
exchange-bf71841-001
exchange-cc69351-001
exchange-cj4838-001
exchange-cr45271-001
exchange-fb14091-001
exchange-ha29966-001
exchange-lm75700-001
exchange-me32741-001
exchange-ms101996-001
exchange-oe3641-002
exchange-pf8450-001
exchange-pv16220-001
exchange-rs11916-001
exchange-te3667-001
Update(s):
Date: 2015-11-13 14:06:15 UTC
Nous vous présentons nos excuses pour cet incident qui est à caractère exceptionnel, le service Exchange utilise des serveurs avec des disques redondants mais les deux ont été irrécupérables.
Nous avons donc dû nous servir de nos sauvegardes et c’est ce qui a pris du temps pour remettre le service en état fonctionnel.
Nous avons communiqué étape par étape pour indiquer les services qui étaient en cours de restauration.
Nous réiterons nos excuses auprès des clients impactés.
Date: 2015-11-10 22:28:50 UTC
xc116.mail.ovh.net
last backup time : 2015-11-05 02:20:16
restore progress status: 100%
up : 2015-11-10 23:30
Date: 2015-11-10 20:23:59 UTC
xc116.mail.ovh.net
last backup time : 2015-11-05 02:20:16
restore progress status: 81%
Date: 2015-11-10 20:14:14 UTC
xc136.mail.ovh.net
last backup time : 2015-11-08 07:20:14
restore progress status: 100%
up : 2015-11-10 21:15
Date: 2015-11-10 16:12:52 UTC
xc116.mail.ovh.net
last backup time : 2015-11-05 02:20:16
restore progress status: 44%
xc136.mail.ovh.net
last backup time : 2015-11-08 07:20:14
restore progress status: 45%
Date: 2015-11-10 13:44:46 UTC
exchange-cj4838-001
last backup time: 2015-11-08 01:20AM
restore progress status: 100%
up: 2015-11-10 14:45
Date: 2015-11-10 12:15:13 UTC
xc116.mail.ovh.net
last backup time : 2015-11-05 02:20:16
restore progress status: 10%
xc136.mail.ovh.net
last backup time : 2015-11-08 07:20:14
restore progress status: 11%
Date: 2015-11-10 11:56:02 UTC
exchange-rs11916-001
last backup time: 2015-11-08 01:20:
restore progress status: 100%
up: 2015-11-09 13:48
Date: 2015-11-10 11:54:38 UTC
exchange-ms101996-001
last backup time: 2015-11-08 10:20
restore progress status: 100%
up: 2015-11-09 13:46
Date: 2015-11-10 11:53:34 UTC
exchange-lm75700-001
last backup time: 2015-11-08 13:17
restore progress status: 100%
up: 2015-11-10 01:00
Date: 2015-11-10 11:49:37 UTC
exchange-cr45271-001
last backup time: 2015-11-08 01:22
restore progress status: 100%
up: 2015-11-10 00:45
Date: 2015-11-10 11:45:20 UTC
exchange-ae5914-001
last backup time: 2015-11-08 08:24
restore progress status: 100%
up: 2015-11-10 09:45
Date: 2015-11-10 10:55:32 UTC
exchange-cj4838-001
last backup time: 2015-11-08 01:20AM
restore progress status: 0%
Date: 2015-11-10 10:44:49 UTC
exchange-fb14091-001
last backup time: 2015-11-07 05:13PM
restore progress status: 100%
up: 2015-11-10 11:30AM
Date: 2015-11-10 09:40:12 UTC
exchange-bf71841-001
last backup time: 2015-11-06 06:25PM
restore progress status: 100%
up: 2015-11-10 08:00AM
Date: 2015-11-10 08:19:19 UTC
xc136.mail.ovh.net
last backup time : 2015-11-08 06:54
restore progress status: 25%
xc116.mail.ovh.net
last backup time : 2015-11-05 01:45
restore progress status: 27%
Date: 2015-11-10 04:43:34 UTC
xc97.mail.ovh.net
last backup time : 2015-11-09 05:40:20 AM
restore progress status: 100%
up : 11/10/2015-5h30
xc75.mail.ovh.net
last backup time : 2015-11-09 05:50:20
restore progress status: 100%
up : 11/10/2015-5h30
Date: 2015-11-09 22:43:42 UTC
exchange-cr45271-001
backup date => 11/08/2015-01:22
up =>
status => doing
restore progress status: 15%
exchange-fb14091-001
backup date => 11/07/2015-17:13
up =>
status => doing
restore progress status: 10%
Date: 2015-11-09 22:14:59 UTC
restore-exchange-me32741-001
backup date => 11/08/2015-00:45
up => 2015-11-09 21:05:00
status => done
restore-exchange-cc69351-001
backup date => 11/08/2015-09:48
up => 2015-11-09 22:30:00
status => done
Date: 2015-11-09 17:04:36 UTC
xc97.mail.ovh.net
last backup time : 2015-11-09 05:40:20 AM
restore progress status: 46%
Date: 2015-11-09 16:45:14 UTC
xc34.mail.ovh.net
last backup time: 2015-11-08 05:40:14
restore progress status: Terminé.
Les services Exchange sont relancés et accessibles.
xc75.mail.ovh.net
last backup time : 2015-11-09 05:50:20
restore progress status: 46%
Date: 2015-11-09 16:27:15 UTC
exchange-ha29966-001
Date du dernier Backup : 09/11/2015 03:10:17
Progression de la restauration: Terminée
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 16:19:06 UTC
exchange-lm75700-001
date du dernier backup: 11/08/2015 13:17:00
progression de la restauration : 9%
Date: 2015-11-09 16:12:30 UTC
exchange-pf8450-001
date du dernier backup: 2015-11-08 09:05:00
progression de la restauration : terminée
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 15:35:11 UTC
exchange-pf8450-001
last backup time: 2015-11-08 09:05:00
restore progress status: 5%
xc34.mail.ovh.net
last backup time: 2015-11-08 05:40:14
restore progress status: 50%
Date: 2015-11-09 15:03:35 UTC
exchange-te3667-001
date du dernier backup: 2015-11-08 02:16:54
progression de la restauration: done
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 14:52:49 UTC
exchange-ha29966-001
date du dernier backup: 2015-11-08 22:50:16
progression de la restauration: 1%
exchange-te3667-001
date du dernier backup: 2015-11-08 02:16:54
progression de la restauration: 95%
Date: 2015-11-09 14:47:15 UTC
exchange-as5598-001
date du dernier backup: 2015-11-09 03:10:17
progression de la restauration: done
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 14:43:11 UTC
xc34.mail.ovh.net
date du dernier backup: 2015-11-08 05:40:14
progression de la restauration: 100%
Date: 2015-11-09 14:28:25 UTC
exchange-pv16220-001
date du dernier backup: 2015-11-08 07:12:00
progression de la restauration: done.
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 14:05:30 UTC
exchange-as5598-001
date du dernier backup: 2015-11-09 03:10:17
progression de la restauration: 15%
xc34.mail.ovh.net
date du dernier backup: 2015-11-08 05:40:14
progression de la restauration: 20%
Date: 2015-11-09 13:49:47 UTC
exchange-rs11916-001
date du dernier backup: 2015-11-08 01:20:00
exchange-ms101996-001
date du dernier backup: 2015-11-08 10:20:14
Les services Exchange sont relancés et accessibles pour ces serveurs.
xc34.mail.ovh.net est en cours de restauration (10%)
exchange-pv16220-001 est en cours de restauration (70%)
La stratégie est donc de redescendre les backups et de relancer les services rapidement. Nous tâcherons dans un second temps de récupérer les éléments entre la date du dernier backup et celle de l'incident (2015-11-09 08:00)
Date: 2015-11-09 11:31:16 UTC
Nous lancons les restaurations des dernières sauvegardes disponibles.
Date: 2015-11-09 11:10:04 UTC
L'équipe stockage a pu restaurer partiellement les données, nous faisons le maximum pour rétablir l'accès aux serveurs.
Les équipes investiguent.
Serveurs impactés:
xc34.mail.ovh.net
xc75.mail.ovh.net
xc97.mail.ovh.net
xc116.mail.ovh.net
xc136.mail.ovh.net
exchange-ae5914-001
exchange-as5598-001
exchange-bf71841-001
exchange-cc69351-001
exchange-cj4838-001
exchange-cr45271-001
exchange-fb14091-001
exchange-ha29966-001
exchange-lm75700-001
exchange-me32741-001
exchange-ms101996-001
exchange-oe3641-002
exchange-pf8450-001
exchange-pv16220-001
exchange-rs11916-001
exchange-te3667-001
Update(s):
Date: 2015-11-13 14:06:15 UTC
Nous vous présentons nos excuses pour cet incident qui est à caractère exceptionnel, le service Exchange utilise des serveurs avec des disques redondants mais les deux ont été irrécupérables.
Nous avons donc dû nous servir de nos sauvegardes et c’est ce qui a pris du temps pour remettre le service en état fonctionnel.
Nous avons communiqué étape par étape pour indiquer les services qui étaient en cours de restauration.
Nous réiterons nos excuses auprès des clients impactés.
Date: 2015-11-10 22:28:50 UTC
xc116.mail.ovh.net
last backup time : 2015-11-05 02:20:16
restore progress status: 100%
up : 2015-11-10 23:30
Date: 2015-11-10 20:23:59 UTC
xc116.mail.ovh.net
last backup time : 2015-11-05 02:20:16
restore progress status: 81%
Date: 2015-11-10 20:14:14 UTC
xc136.mail.ovh.net
last backup time : 2015-11-08 07:20:14
restore progress status: 100%
up : 2015-11-10 21:15
Date: 2015-11-10 16:12:52 UTC
xc116.mail.ovh.net
last backup time : 2015-11-05 02:20:16
restore progress status: 44%
xc136.mail.ovh.net
last backup time : 2015-11-08 07:20:14
restore progress status: 45%
Date: 2015-11-10 13:44:46 UTC
exchange-cj4838-001
last backup time: 2015-11-08 01:20AM
restore progress status: 100%
up: 2015-11-10 14:45
Date: 2015-11-10 12:15:13 UTC
xc116.mail.ovh.net
last backup time : 2015-11-05 02:20:16
restore progress status: 10%
xc136.mail.ovh.net
last backup time : 2015-11-08 07:20:14
restore progress status: 11%
Date: 2015-11-10 11:56:02 UTC
exchange-rs11916-001
last backup time: 2015-11-08 01:20:
restore progress status: 100%
up: 2015-11-09 13:48
Date: 2015-11-10 11:54:38 UTC
exchange-ms101996-001
last backup time: 2015-11-08 10:20
restore progress status: 100%
up: 2015-11-09 13:46
Date: 2015-11-10 11:53:34 UTC
exchange-lm75700-001
last backup time: 2015-11-08 13:17
restore progress status: 100%
up: 2015-11-10 01:00
Date: 2015-11-10 11:49:37 UTC
exchange-cr45271-001
last backup time: 2015-11-08 01:22
restore progress status: 100%
up: 2015-11-10 00:45
Date: 2015-11-10 11:45:20 UTC
exchange-ae5914-001
last backup time: 2015-11-08 08:24
restore progress status: 100%
up: 2015-11-10 09:45
Date: 2015-11-10 10:55:32 UTC
exchange-cj4838-001
last backup time: 2015-11-08 01:20AM
restore progress status: 0%
Date: 2015-11-10 10:44:49 UTC
exchange-fb14091-001
last backup time: 2015-11-07 05:13PM
restore progress status: 100%
up: 2015-11-10 11:30AM
Date: 2015-11-10 09:40:12 UTC
exchange-bf71841-001
last backup time: 2015-11-06 06:25PM
restore progress status: 100%
up: 2015-11-10 08:00AM
Date: 2015-11-10 08:19:19 UTC
xc136.mail.ovh.net
last backup time : 2015-11-08 06:54
restore progress status: 25%
xc116.mail.ovh.net
last backup time : 2015-11-05 01:45
restore progress status: 27%
Date: 2015-11-10 04:43:34 UTC
xc97.mail.ovh.net
last backup time : 2015-11-09 05:40:20 AM
restore progress status: 100%
up : 11/10/2015-5h30
xc75.mail.ovh.net
last backup time : 2015-11-09 05:50:20
restore progress status: 100%
up : 11/10/2015-5h30
Date: 2015-11-09 22:43:42 UTC
exchange-cr45271-001
backup date => 11/08/2015-01:22
up =>
status => doing
restore progress status: 15%
exchange-fb14091-001
backup date => 11/07/2015-17:13
up =>
status => doing
restore progress status: 10%
Date: 2015-11-09 22:14:59 UTC
restore-exchange-me32741-001
backup date => 11/08/2015-00:45
up => 2015-11-09 21:05:00
status => done
restore-exchange-cc69351-001
backup date => 11/08/2015-09:48
up => 2015-11-09 22:30:00
status => done
Date: 2015-11-09 17:04:36 UTC
xc97.mail.ovh.net
last backup time : 2015-11-09 05:40:20 AM
restore progress status: 46%
Date: 2015-11-09 16:45:14 UTC
xc34.mail.ovh.net
last backup time: 2015-11-08 05:40:14
restore progress status: Terminé.
Les services Exchange sont relancés et accessibles.
xc75.mail.ovh.net
last backup time : 2015-11-09 05:50:20
restore progress status: 46%
Date: 2015-11-09 16:27:15 UTC
exchange-ha29966-001
Date du dernier Backup : 09/11/2015 03:10:17
Progression de la restauration: Terminée
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 16:19:06 UTC
exchange-lm75700-001
date du dernier backup: 11/08/2015 13:17:00
progression de la restauration : 9%
Date: 2015-11-09 16:12:30 UTC
exchange-pf8450-001
date du dernier backup: 2015-11-08 09:05:00
progression de la restauration : terminée
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 15:35:11 UTC
exchange-pf8450-001
last backup time: 2015-11-08 09:05:00
restore progress status: 5%
xc34.mail.ovh.net
last backup time: 2015-11-08 05:40:14
restore progress status: 50%
Date: 2015-11-09 15:03:35 UTC
exchange-te3667-001
date du dernier backup: 2015-11-08 02:16:54
progression de la restauration: done
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 14:52:49 UTC
exchange-ha29966-001
date du dernier backup: 2015-11-08 22:50:16
progression de la restauration: 1%
exchange-te3667-001
date du dernier backup: 2015-11-08 02:16:54
progression de la restauration: 95%
Date: 2015-11-09 14:47:15 UTC
exchange-as5598-001
date du dernier backup: 2015-11-09 03:10:17
progression de la restauration: done
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 14:43:11 UTC
xc34.mail.ovh.net
date du dernier backup: 2015-11-08 05:40:14
progression de la restauration: 100%
Date: 2015-11-09 14:28:25 UTC
exchange-pv16220-001
date du dernier backup: 2015-11-08 07:12:00
progression de la restauration: done.
Les services Exchange sont relancés et accessibles.
Date: 2015-11-09 14:05:30 UTC
exchange-as5598-001
date du dernier backup: 2015-11-09 03:10:17
progression de la restauration: 15%
xc34.mail.ovh.net
date du dernier backup: 2015-11-08 05:40:14
progression de la restauration: 20%
Date: 2015-11-09 13:49:47 UTC
exchange-rs11916-001
date du dernier backup: 2015-11-08 01:20:00
exchange-ms101996-001
date du dernier backup: 2015-11-08 10:20:14
Les services Exchange sont relancés et accessibles pour ces serveurs.
xc34.mail.ovh.net est en cours de restauration (10%)
exchange-pv16220-001 est en cours de restauration (70%)
La stratégie est donc de redescendre les backups et de relancer les services rapidement. Nous tâcherons dans un second temps de récupérer les éléments entre la date du dernier backup et celle de l'incident (2015-11-09 08:00)
Date: 2015-11-09 11:31:16 UTC
Nous lancons les restaurations des dernières sauvegardes disponibles.
Date: 2015-11-09 11:10:04 UTC
L'équipe stockage a pu restaurer partiellement les données, nous faisons le maximum pour rétablir l'accès aux serveurs.
This incident affected: Collaborative solutions || Hosted Exchange (Reception).