OVHcloud Network Status
Current status
Legend
- Operational
- Degraded performance
- Partial Outage
- Major Outage
- Under maintenance
176.31.232.0/24 et 176.31.233.0/24
Incident
Report for Network & Infrastructure
Resolved
L'un des 2 nexus 5k a rebooté, une fois a 2h puis maintenant.
Il n'y a pas d'impact car les paquets sont fwd par le 2nd nexus du couple.
La cause est le bug sur port-security,
Reason: Reset triggered due to HA policy of Reset
System version: 6.0(2)N2(2)
Service: eth_port_sec hap reset
On regarde a stabilisé le switch avant de le le mettre a jour
Update(s):
Date: 2014-12-23 05:13:02 UTC
Le 2eme n5 et a jour.
Tout les serveur sont UP.
Date: 2014-12-23 04:40:34 UTC
On met a jour le deuxieme n5.
Date: 2014-12-23 04:36:17 UTC
l'ensemble des Fexs ont été mis a jour a chaud :
Module 100: Non-disruptive upgrading.
SUCCESS
Module 101: Non-disruptive upgrading.
SUCCESS
Module 102: Non-disruptive upgrading.
SUCCESS
Module 103: Non-disruptive upgrading.
SUCCESS
Module 104: Non-disruptive upgrading.
SUCCESS
Module 105: Non-disruptive upgrading.
SUCCESS
Module 106: Non-disruptive upgrading.
SUCCESS
Module 107: Non-disruptive upgrading.
SUCCESS
Module 108: Non-disruptive upgrading.
SUCCESS
Module 109: Non-disruptive upgrading.
SUCCESS
Module 111: Non-disruptive upgrading.
SUCCESS
Install has been successful.
Date: 2014-12-23 04:19:32 UTC
tous les fex ont téléchargé leurs nouvelles images:
2014 Dec 23 05:17:19 sw %$ VDC-1 %$ %SATCTRL-FEX101-2-SATCTRL_IMAGE: FEX101 Image update complete. Install pending
2014 Dec 23 05:17:21 sw %$ VDC-1 %$ %SATCTRL-FEX100-2-SATCTRL_IMAGE: FEX100 Image update complete. Install pending
2014 Dec 23 05:17:31 sw %$ VDC-1 %$ %SATCTRL-FEX102-2-SATCTRL_IMAGE: FEX102 Image update complete. Install pending
2014 Dec 23 05:17:50 sw %$ VDC-1 %$ %SATCTRL-FEX103-2-SATCTRL_IMAGE: FEX103 Image update complete. Install pending
2014 Dec 23 05:17:55 sw %$ VDC-1 %$ %SATCTRL-FEX104-2-SATCTRL_IMAGE: FEX104 Image update complete. Install pending
2014 Dec 23 05:18:19 sw %$ VDC-1 %$ %SATCTRL-FEX105-2-SATCTRL_IMAGE: FEX105 Image update complete. Install pending
2014 Dec 23 05:18:21 sw %$ VDC-1 %$ %SATCTRL-FEX106-2-SATCTRL_IMAGE: FEX106 Image update complete. Install pending
2014 Dec 23 05:18:28 sw %$ VDC-1 %$ %SATCTRL-FEX107-2-SATCTRL_IMAGE: FEX107 Image update complete. Install pending
2014 Dec 23 05:18:36 sw %$ VDC-1 %$ %SATCTRL-FEX108-2-SATCTRL_IMAGE: FEX108 Image update complete. Install pending
2014 Dec 23 05:18:42 sw %$ VDC-1 %$ %SATCTRL-FEX109-2-SATCTRL_IMAGE: FEX109 Image update complete. Install pending
2014 Dec 23 05:18:57 sw %$ VDC-1 %$ %SATCTRL-FEX111-2-SATCTRL_IMAGE: FEX111 Image update complete. Install pending
Date: 2014-12-23 04:11:54 UTC
L'issu est en cours. L'image se télécharge sur les fex:
Pre-loading modules.
[This step might take upto 20 minutes to complete - please wait.]
[*Warning -- Please do not abort installation/reload or powercycle fexes*]
[# ]
Date: 2014-12-23 03:52:40 UTC
Plus de place dispo :
# install all system bootflash:n5000-uk9.7.0.5.N1.1a.bin kickstart bootflash:n5000-uk9-kickstart.7.0.5.N1.1a.bin
Pre-upgrade check failed. Return code 0x40930062 (free space in the filesystem is below threshold).
On va lancer le plugin pour faire de la place:
sw.176.31.232.249# load bootflash:plug
Loading plugin version 6.0(2)N2(3)
###############################################################
Warning: debug-plugin is for engineering internal use only!
For security reason, plugin image has been deleted.
###############################################################
Successfully loaded debug-plugin!!!
Linux(debug)# cd /var/sysmgr/logs
Linux(debug)# cat /dev/null > lcsm.out
Linux(debug)# df -h | grep sysmgr
none 1000M 32M 969M 4% /var/sysmgr
none 400M 84K 400M 1% /var/sysmgr/ftp
none 100M 0 100M 0% /var/sysmgr/ftp/cores
none 400M 15M 386M 4% /var/sysmgr/startup-cfg
Linux(debug)# exit
Date: 2014-12-23 03:40:50 UTC
Le n5 A n'est pas stable (ssh connection refused, etc). On le reboot pour partir sur une base stable avant de mettre a jour le couple en 7.0.5.N1.1a.
Il n'y a pas d'impact car les paquets sont fwd par le 2nd nexus du couple.
La cause est le bug sur port-security,
Reason: Reset triggered due to HA policy of Reset
System version: 6.0(2)N2(2)
Service: eth_port_sec hap reset
On regarde a stabilisé le switch avant de le le mettre a jour
Update(s):
Date: 2014-12-23 05:13:02 UTC
Le 2eme n5 et a jour.
Tout les serveur sont UP.
Date: 2014-12-23 04:40:34 UTC
On met a jour le deuxieme n5.
Date: 2014-12-23 04:36:17 UTC
l'ensemble des Fexs ont été mis a jour a chaud :
Module 100: Non-disruptive upgrading.
SUCCESS
Module 101: Non-disruptive upgrading.
SUCCESS
Module 102: Non-disruptive upgrading.
SUCCESS
Module 103: Non-disruptive upgrading.
SUCCESS
Module 104: Non-disruptive upgrading.
SUCCESS
Module 105: Non-disruptive upgrading.
SUCCESS
Module 106: Non-disruptive upgrading.
SUCCESS
Module 107: Non-disruptive upgrading.
SUCCESS
Module 108: Non-disruptive upgrading.
SUCCESS
Module 109: Non-disruptive upgrading.
SUCCESS
Module 111: Non-disruptive upgrading.
SUCCESS
Install has been successful.
Date: 2014-12-23 04:19:32 UTC
tous les fex ont téléchargé leurs nouvelles images:
2014 Dec 23 05:17:19 sw %$ VDC-1 %$ %SATCTRL-FEX101-2-SATCTRL_IMAGE: FEX101 Image update complete. Install pending
2014 Dec 23 05:17:21 sw %$ VDC-1 %$ %SATCTRL-FEX100-2-SATCTRL_IMAGE: FEX100 Image update complete. Install pending
2014 Dec 23 05:17:31 sw %$ VDC-1 %$ %SATCTRL-FEX102-2-SATCTRL_IMAGE: FEX102 Image update complete. Install pending
2014 Dec 23 05:17:50 sw %$ VDC-1 %$ %SATCTRL-FEX103-2-SATCTRL_IMAGE: FEX103 Image update complete. Install pending
2014 Dec 23 05:17:55 sw %$ VDC-1 %$ %SATCTRL-FEX104-2-SATCTRL_IMAGE: FEX104 Image update complete. Install pending
2014 Dec 23 05:18:19 sw %$ VDC-1 %$ %SATCTRL-FEX105-2-SATCTRL_IMAGE: FEX105 Image update complete. Install pending
2014 Dec 23 05:18:21 sw %$ VDC-1 %$ %SATCTRL-FEX106-2-SATCTRL_IMAGE: FEX106 Image update complete. Install pending
2014 Dec 23 05:18:28 sw %$ VDC-1 %$ %SATCTRL-FEX107-2-SATCTRL_IMAGE: FEX107 Image update complete. Install pending
2014 Dec 23 05:18:36 sw %$ VDC-1 %$ %SATCTRL-FEX108-2-SATCTRL_IMAGE: FEX108 Image update complete. Install pending
2014 Dec 23 05:18:42 sw %$ VDC-1 %$ %SATCTRL-FEX109-2-SATCTRL_IMAGE: FEX109 Image update complete. Install pending
2014 Dec 23 05:18:57 sw %$ VDC-1 %$ %SATCTRL-FEX111-2-SATCTRL_IMAGE: FEX111 Image update complete. Install pending
Date: 2014-12-23 04:11:54 UTC
L'issu est en cours. L'image se télécharge sur les fex:
Pre-loading modules.
[This step might take upto 20 minutes to complete - please wait.]
[*Warning -- Please do not abort installation/reload or powercycle fexes*]
[# ]
Date: 2014-12-23 03:52:40 UTC
Plus de place dispo :
# install all system bootflash:n5000-uk9.7.0.5.N1.1a.bin kickstart bootflash:n5000-uk9-kickstart.7.0.5.N1.1a.bin
Pre-upgrade check failed. Return code 0x40930062 (free space in the filesystem is below threshold).
On va lancer le plugin pour faire de la place:
sw.176.31.232.249# load bootflash:plug
Loading plugin version 6.0(2)N2(3)
###############################################################
Warning: debug-plugin is for engineering internal use only!
For security reason, plugin image has been deleted.
###############################################################
Successfully loaded debug-plugin!!!
Linux(debug)# cd /var/sysmgr/logs
Linux(debug)# cat /dev/null > lcsm.out
Linux(debug)# df -h | grep sysmgr
none 1000M 32M 969M 4% /var/sysmgr
none 400M 84K 400M 1% /var/sysmgr/ftp
none 100M 0 100M 0% /var/sysmgr/ftp/cores
none 400M 15M 386M 4% /var/sysmgr/startup-cfg
Linux(debug)# exit
Date: 2014-12-23 03:40:50 UTC
Le n5 A n'est pas stable (ssh connection refused, etc). On le reboot pour partir sur une base stable avant de mettre a jour le couple en 7.0.5.N1.1a.
This incident affected: Infrastructure || RBX (RBX4).