OVHcloud Network Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
52C03
Incident Report for Network & Infrastructure
Resolved
Le fex de cette baie ne répond plus, il s'est déco des 2x n5.
Nous investiguons

Update(s):

Date: 2015-07-28 06:14:13 UTC
all up

# sh fex
FEX FEX FEX FEX Fex
Number Description State Model Serial
------------------------------------------------------------------------
100 FEX0100 Online N2K-C2248TP-1GE SSI142520WD
101 FEX0101 Online N2K-C2248TP-1GE SSI14440285
102 FEX0102 Online N2K-C2248TP-1GE SSI142810TW
103 FEX0103 Online N2K-C2248TP-1GE SSI1444023E
104 FEX0104 Online N2K-C2248TP-1GE SSI144506J8
105 FEX0105 Online N2K-C2248TP-1GE SSI14450H7E
106 FEX0106 Online N2K-C2248TP-1GE SSI144401WG
107 FEX0107 Online N2K-C2248TP-1GE SSI1444023D
108 FEX0108 Online N2K-C2248TP-1GE SSI144401X3
109 FEX0109 Online N2K-C2248TP-1GE SSI14280VQ4
111 FEX0111 Online N2K-C2248TP-1GE SSI144401XE

je ne constate plus d'incident sur ce couple

Date: 2015-07-28 06:04:36 UTC
les fex reviennent
# sh fex
FEX FEX FEX FEX Fex
Number Description State Model Serial
------------------------------------------------------------------------
100 FEX0100 Connected N2K-C2248TP-1GE SSI142520WD
101 FEX0101 Connected N2K-C2248TP-1GE SSI14440285
102 FEX0102 Connected N2K-C2248TP-1GE SSI142810TW
103 FEX0103 Connected N2K-C2248TP-1GE SSI1444023E
104 FEX0104 Connected N2K-C2248TP-1GE SSI144506J8
105 FEX0105 Connected N2K-C2248TP-1GE SSI14450H7E
106 FEX0106 Connected N2K-C2248TP-1GE SSI144401WG
107 FEX0107 Connected N2K-C2248TP-1GE SSI1444023D
108 FEX0108 Connected N2K-C2248TP-1GE SSI144401X3
109 FEX0109 Connected N2K-C2248TP-1GE SSI14280VQ4
111 FEX0111 Connected N2K-C2248TP-1GE SSI144401XE

Date: 2015-07-28 05:58:51 UTC
reload du b en cours

n5# reload power-cycle
WARNING: This command will reboot the system
Do you want to continue? (y/n) [n] y

Date: 2015-07-28 05:56:22 UTC
les FEX sont up mais le system est encore un peu chargé, il faut que l'utilisation des buffer baisse
n5# sh system internal mts buffers
MTS buffers in use = 234



Date: 2015-07-28 05:44:12 UTC
ça semble bien etre un side effect de la maj, des fex se deco aleatoirement.


Apres le reload power-cycle, on retrouve les fexs.
J'attend d'avoir tt les fex up et je reload le 2nd N5

Date: 2015-07-28 05:31:13 UTC
rien a faire, le fex n'est pas reconnu...

on a checké les optiques + fibre et testé un fex de spare.

Je reboot l'un des 2 nexus, c'est peut etre un side effect de l'upgrade en 7.1.1 de cette nuit ( http://travaux.ovh.net/?do=details&id=14145 )
Posted Jul 28, 2015 - 04:29 UTC
This incident affected: Infrastructure || RBX (RBX4).