Our systems detected an incident on storage unit tete-119. The datastore hosted on this cluster are unavailable.
We are working on it.
Incident start: 2020-02-01 8:48 am UTC
Incident end: 2020-02-01 9:01 am UTC
Impacted datastores:
pcc-000359
pcc-000362
pcc-000363
pcc-000364
pcc-001227
Thank you for your understanding,
OVHcloud technical team.
Update(s):
Date: 2020-02-02 00:27:59 UTC All migrations done.
Date: 2020-02-01 22:53:56 UTC Copy done for :
pcc-000359
pcc-000363
In progress :
pcc-000362
pcc-000364
pcc-001227
Date: 2020-02-01 21:51:12 UTC Copy done for :
pcc-000359
pcc-000363
In progress :
pcc-000362
We still have trouble to mount the data of the pools:
pcc-000364
pcc-001227
Date: 2020-02-01 20:32:25 UTC Copy in progress for the pools below:
pcc-000359
pcc-000362
pcc-000363
We still have trouble to mount the data of the pools:
pcc-000364
pcc-001227
Date: 2020-02-01 19:01:33 UTC We successfully mounted the disk on another storage unit. We are moving the data to other datastores.
Date: 2020-02-01 17:40:44 UTC We are trying to remount the data.
Date: 2020-02-01 16:23:20 UTC We are still moving the disks.
Date: 2020-02-01 15:52:37 UTC All the VMs are down, we are moving the disks.
Date: 2020-02-01 15:22:46 UTC We are shutting down the virtual machines to avoid data corruption.
Date: 2020-02-01 14:43:00 UTC The storage unit restarts too many time, we are not able to move the data other storage units.
We are going to physically move the disks to another cluster. The data will be not available during this time.
We will keep you informed.
Date: 2020-02-01 11:20:49 UTC We are moving the data to other storage units.
Date: 2020-02-01 10:39:01 UTC New incident detected on 2020-02-01 at 10:31 am UTC. The datastores are unreachable.
Posted Feb 01, 2020 - 09:01 UTC
This incident affected: VMware Private Cloud || RBX (Compute).