OVHcloud Network Status
Current status
Legend
- Operational
- Degraded performance
- Partial Outage
- Major Outage
- Under maintenance
BHS/NWK
Incident
Report for Network & Infrastructure
Resolved
Nous avons 5x10G down entre BHS/NWK. Les autres
16x10G sont UP.
Nous cherchons l'origine du probleme.
Update(s):
Date: 2014-12-22 09:32:25 UTC
La carte est remplacée
*** CASCADED EXTERNAL NOTES 22-Dec-2014 09:15:34 GMT From CASE: 8715590 - Event
Field Services successfully replaced the card and the Transport NOC confirmed that all of the associated alarms have cleared. Services are up at this time and no further issues are expected. If additional issues are experienced, please contact the Level 3 Technical Service Center
Tous les ports sont de nouveaux UP avec des bon niveaux optiques
Date: 2014-12-22 08:36:45 UTC
la carte de spare est en route.
*** CASCADED EXTERNAL NOTES 22-Dec-2014 07:21:15 GMT From CASE: 8715590 - Event
The courier provided an estimated time of delivery of 9:00 GMT and the Transport NOC advised that Field Services will be on site upon the delivery of the card. The next update will be provided upon delivery, or when new information is available.
Date: 2014-12-22 06:12:08 UTC
le remplacement de la carte a été demandé
*** CASCADED EXTERNAL NOTES 22-Dec-2014 05:46:26 GMT From CASE: 8715590 - Event
The Transport NOC reported that the previous card issue has reoccurred and services have gone back down. The Transport NOC has engaged the equipment vendor for further assistance and is currently engaging Field Services. Please be advised that updates for this event will be relayed hourly unless otherwise noted.
*** CASCADED EXTERNAL NOTES 22-Dec-2014 05:55:33 GMT From CASE: 8715590 - Event
The Transport NOC has engaged Field Services and ordered a replacement card. An estimated time of arrival is not currently available.
Date: 2014-12-22 05:19:44 UTC
CUSTOMER UPDATE] EMEA Technical Service Centre
[SUMMARY OF WORK]
Re engaging Level 3 TNOC to investigate further
[PLAN OF ACTION]
Pending update from TNOC
[UPDATE ETA] 2014/12/22 06:17 (GMT)
Date: 2014-12-22 04:11:26 UTC
La carte chez L3 est de nouveaux tombés, même symptômes.
On a uppé les tickets correspondant.
Date: 2014-12-21 20:50:38 UTC
la carte n'a pas été remplacée, un cold reboot a été suffisant
*** CASCADED EXTERNAL NOTES 21-Dec-2014 19:45:40 GMT From CASE: 8715590 - Event
The Transport NOC has advised that the failed card has recovered after a cold reboot and the completion of its initialization process. The failed card recovered before the new card order was completed. The Transport NOC has advised that while the device will be monitored to ensure its stability, there are currently no plans to replace the affected card. At this time, services have been restored to the impacted customers. If additional issues are experienced, please contact the Level 3 Technical Service Center.
les niveaux optiques sont corrects, on peut clore le ticket.
Date: 2014-12-21 19:55:43 UTC
les liens sont à nouveau UP
wk-1-6k-SUP2T#sh int descr | i bhs
Te2/3 up up bhs-g1-a9
Te3/7 up up bhs-g1-a9
Te4/7 up up bhs-g1-a9
Te5/4 up up bhs-g1-a9
Te5/5 up up bhs-g1-a9
Te6/3 up up bhs-g1-a9
Te6/4 up up bhs-g1-a9
Te7/8 up up bhs-g1-a9
Te8/1 up up bhs-g1-a9
Te8/2 up up bhs-g1-a9
Te8/3 up up bhs-g1-a9
Po18 up up bhs-g1-a9
Po20 up up bhs-g1-a9
Nous attendons la confirmation de notre fournisseur que l'incident est clos.
Date: 2014-12-21 19:26:08 UTC
Une carte est morte sur les equipements de transports
chez le fournisseur de 10G entre BHS/NWK.
12/21/2014 19:05:29 GMT - It appears the card fail alarm returned,
Our Transport NOC has engaged the equipment vendor and will be ordering a card if applicable.
12/21/2014 18:47:00 GMT - Customer please confirm your services have restored,
We had a card failure that cleared once we bounced it. We have engaged our Transport NOC
so they can engage the equipment vendor to see if the card needs to be replaced during
a maintenance window, Thanks!
Date: 2014-12-21 18:24:59 UTC
le ticket vient d'être escaladé, pas encore d'ETA pour le moment.
Date: 2014-12-21 18:14:19 UTC
Afin de désengorger les liens nwk-1-6k <> bhs-g1-a9, nous avons basculé une partie du trafic de Comcast NY vers Comcast CHI.
Nous relançons notre fournisseur afin d'avoir plus d'informations sur l'incident en cours et surtout connaitre un éventuel ETA.
Date: 2014-12-21 17:45:18 UTC
Nous avons ouvert un ticket chez notre fournisseur pour investigation.
16x10G sont UP.
Nous cherchons l'origine du probleme.
Update(s):
Date: 2014-12-22 09:32:25 UTC
La carte est remplacée
*** CASCADED EXTERNAL NOTES 22-Dec-2014 09:15:34 GMT From CASE: 8715590 - Event
Field Services successfully replaced the card and the Transport NOC confirmed that all of the associated alarms have cleared. Services are up at this time and no further issues are expected. If additional issues are experienced, please contact the Level 3 Technical Service Center
Tous les ports sont de nouveaux UP avec des bon niveaux optiques
Date: 2014-12-22 08:36:45 UTC
la carte de spare est en route.
*** CASCADED EXTERNAL NOTES 22-Dec-2014 07:21:15 GMT From CASE: 8715590 - Event
The courier provided an estimated time of delivery of 9:00 GMT and the Transport NOC advised that Field Services will be on site upon the delivery of the card. The next update will be provided upon delivery, or when new information is available.
Date: 2014-12-22 06:12:08 UTC
le remplacement de la carte a été demandé
*** CASCADED EXTERNAL NOTES 22-Dec-2014 05:46:26 GMT From CASE: 8715590 - Event
The Transport NOC reported that the previous card issue has reoccurred and services have gone back down. The Transport NOC has engaged the equipment vendor for further assistance and is currently engaging Field Services. Please be advised that updates for this event will be relayed hourly unless otherwise noted.
*** CASCADED EXTERNAL NOTES 22-Dec-2014 05:55:33 GMT From CASE: 8715590 - Event
The Transport NOC has engaged Field Services and ordered a replacement card. An estimated time of arrival is not currently available.
Date: 2014-12-22 05:19:44 UTC
CUSTOMER UPDATE] EMEA Technical Service Centre
[SUMMARY OF WORK]
Re engaging Level 3 TNOC to investigate further
[PLAN OF ACTION]
Pending update from TNOC
[UPDATE ETA] 2014/12/22 06:17 (GMT)
Date: 2014-12-22 04:11:26 UTC
La carte chez L3 est de nouveaux tombés, même symptômes.
On a uppé les tickets correspondant.
Date: 2014-12-21 20:50:38 UTC
la carte n'a pas été remplacée, un cold reboot a été suffisant
*** CASCADED EXTERNAL NOTES 21-Dec-2014 19:45:40 GMT From CASE: 8715590 - Event
The Transport NOC has advised that the failed card has recovered after a cold reboot and the completion of its initialization process. The failed card recovered before the new card order was completed. The Transport NOC has advised that while the device will be monitored to ensure its stability, there are currently no plans to replace the affected card. At this time, services have been restored to the impacted customers. If additional issues are experienced, please contact the Level 3 Technical Service Center.
les niveaux optiques sont corrects, on peut clore le ticket.
Date: 2014-12-21 19:55:43 UTC
les liens sont à nouveau UP
wk-1-6k-SUP2T#sh int descr | i bhs
Te2/3 up up bhs-g1-a9
Te3/7 up up bhs-g1-a9
Te4/7 up up bhs-g1-a9
Te5/4 up up bhs-g1-a9
Te5/5 up up bhs-g1-a9
Te6/3 up up bhs-g1-a9
Te6/4 up up bhs-g1-a9
Te7/8 up up bhs-g1-a9
Te8/1 up up bhs-g1-a9
Te8/2 up up bhs-g1-a9
Te8/3 up up bhs-g1-a9
Po18 up up bhs-g1-a9
Po20 up up bhs-g1-a9
Nous attendons la confirmation de notre fournisseur que l'incident est clos.
Date: 2014-12-21 19:26:08 UTC
Une carte est morte sur les equipements de transports
chez le fournisseur de 10G entre BHS/NWK.
12/21/2014 19:05:29 GMT - It appears the card fail alarm returned,
Our Transport NOC has engaged the equipment vendor and will be ordering a card if applicable.
12/21/2014 18:47:00 GMT - Customer please confirm your services have restored,
We had a card failure that cleared once we bounced it. We have engaged our Transport NOC
so they can engage the equipment vendor to see if the card needs to be replaced during
a maintenance window, Thanks!
Date: 2014-12-21 18:24:59 UTC
le ticket vient d'être escaladé, pas encore d'ETA pour le moment.
Date: 2014-12-21 18:14:19 UTC
Afin de désengorger les liens nwk-1-6k <> bhs-g1-a9, nous avons basculé une partie du trafic de Comcast NY vers Comcast CHI.
Nous relançons notre fournisseur afin d'avoir plus d'informations sur l'incident en cours et surtout connaitre un éventuel ETA.
Date: 2014-12-21 17:45:18 UTC
Nous avons ouvert un ticket chez notre fournisseur pour investigation.