OVHcloud Network Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
176.31.225.0/24 && 176.31.224.0/24
Scheduled Maintenance Report for Network & Infrastructure
Completed
3eme case pour ces 2 reseaux:

Suite au bug CSCuu07598 sur 7.1.1, certain fex se trouve en single attach et des uplinks sont down sur un n5
Nous allons reloader ce n5 pour revenir dans un état stable. pas de coupure a prévoir, les uplinks et les port de fex down sont uniquement sur ce n5

Aussi, dans la nuit du 30 au 31, nous allons faire un roll-back vers la 7.0.5 qui ne contient pas le bug
C'est le safe choice en attendant la release 7.1(2)
Le downgrade est disruptif...

##
Pour rappel, ce couple a été mis a jour en release 7.1.1 pour correction de bug ainsi que le support des fex2348 (48x10g base-T)

Cette release ré-introduit un vieux bug sur les n5548*p* qui coupe des ports du châssis (not connect) et on ne peut les re-uppé qu'avec un reload.
Il existe un work around avec une commande de debug, cependant, cela ne fonctionne pas sur ce couple....

Update(s):

Date: 2015-07-30 23:06:26 UTC
J'ai fais le tour avec les équipes datacentre et tout semble okay

Date: 2015-07-30 22:43:43 UTC
# sh fex
FEX FEX FEX FEX Fex
Number Description State Model Serial
------------------------------------------------------------------------
100 FEX0100 Online N2K-C2248TP-1GE SSI142520WD
101 FEX0101 Online N2K-C2248TP-1GE SSI14440285
102 FEX0102 Online N2K-C2248TP-1GE SSI142810TW
103 FEX0103 Online N2K-C2248TP-1GE SSI1444023E
104 FEX0104 Online N2K-C2248TP-1GE SSI144506J8
105 FEX0105 Online N2K-C2248TP-1GE SSI14450H7E
106 FEX0106 Online N2K-C2248TP-1GE SSI144401WG
107 FEX0107 Online N2K-C2248TP-1GE SSI1444023D
108 FEX0108 Online N2K-C2248TP-1GE SSI144401X3
109 FEX0109 Online N2K-C2248TP-1GE SSI14280VQ4
111 FEX0111 Online N2K-C2248TP-1GE SSI144401XE

Software
BIOS: version 3.6.0
loader: version N/A
kickstart: version 7.0(5)N1(1a)
system: version 7.0(5)N1(1a)
Power Sequencer Firmware:
Module 1: version v5.0
Module 3: version v2.0



Date: 2015-07-30 22:37:11 UTC
# sh fex
FEX FEX FEX FEX Fex
Number Description State Model Serial
------------------------------------------------------------------------
102 FEX0102 Connected N2K-C2248TP-1GE SSI142810TW
105 FEX0105 Connected N2K-C2248TP-1GE SSI14450H7E
106 FEX0106 Online N2K-C2248TP-1GE SSI144401WG
107 FEX0107 Connected N2K-C2248TP-1GE SSI1444023D
109 FEX0109 Connected N2K-C2248TP-1GE SSI14280VQ4
--- -------- Connected N2K-C2248TP-1GE SSI14440285
--- -------- Connected N2K-C2248TP-1GE SSI142520WD
--- -------- Connected N2K-C2248TP-1GE SSI1444023E
--- -------- Connected N2K-C2248TP-1GE SSI144401X3
--- -------- Connected N2K-C2248TP-1GE SSI144506J8
--- -------- Connected N2K-C2248TP-1GE SSI144401XE

Date: 2015-07-30 22:29:13 UTC
[This step might take upto 20 minutes to complete - please wait.]
[*Warning -- Please do not abort installation/reload or powercycle fexes*]
[####################] 100% -- SUCCESS

Finishing the upgrade, switch will reboot in 10 seconds.

Date: 2015-07-30 22:21:30 UTC
les n5 vont preloader les images sur les fex pour limiter le downtime lors du reload final

Date: 2015-07-30 22:20:45 UTC
onverting startup config.
[####################] 100% -- SUCCESS

Pre-loading modules.
[This step might take upto 20 minutes to complete - please wait.]
[*Warning -- Please do not abort installation/reload or powercycle fexes*]

Date: 2015-07-30 22:16:38 UTC
Compatibility check is done:
Module bootable Impact Install-type Reason
------ -------- -------------- ------------ ------
1 yes disruptive reset new image is incompatible
3 yes disruptive reset new image is incompatible
100 yes disruptive reset new image is incompatible
101 yes disruptive reset new image is incompatible
102 yes disruptive reset new image is incompatible
103 yes disruptive reset new image is incompatible
104 yes disruptive reset new image is incompatible
105 yes disruptive reset new image is incompatible
106 yes disruptive reset new image is incompatible
107 yes disruptive reset new image is incompatible
108 yes disruptive reset new image is incompatible
109 yes disruptive reset new image is incompatible
111 yes disruptive reset new image is incompatible



Images will be upgraded according to following table:
Module Image Running-Version New-Version Upg-Required
------ ---------------- ---------------------- ---------------------- ------------
1 system 7.1(1)N1(1) 7.0(5)N1(1a) yes
1 kickstart 7.1(1)N1(1) 7.0(5)N1(1a) yes
1 bios v3.6.0(05/09/2012) v3.6.0(05/09/2012) no
1 power-seq v5.0 v5.0 no
3 power-seq v2.0 v2.0 no
100 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
101 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
102 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
103 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
104 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
105 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
106 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
107 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
108 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
109 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
111 fexth 7.1(1)N1(1) 7.0(5)N1(1a) yes
1 microcontroller v1.1.0.1 v1.0.0.14 no


Additional info for this installation:
--------------------------------------
Remove QoS & ACL config on L3 interfaces and SVIs if any

Service \"fwm\" in vdc 1: Downgrading to a version lower than the current version (7.1(1)N1(1)). Downgrading to 7.0(5)N1(1a) is not supported. Downgrade needs to be disruptive.
(modified the impact to for module )


Switch will be reloaded for disruptive upgrade.
Do you want to continue with the installation (y/n)? [n]

go

Date: 2015-07-30 22:05:10 UTC
on lance le downgrade


Date: 2015-07-30 09:32:14 UTC
Reboot effectué

on reaaplique le work around au cas ou..
# debug hardware internal carmel dom-thread disable

Done.

#

On reprend ce soir pour le downgrade

Date: 2015-07-30 09:09:30 UTC
reload en cours
Posted Jul 30, 2015 - 08:58 UTC
This scheduled maintenance affected: Infrastructure || RBX (RBX4).