OVHcloud Network Status
Current status
Legend
- Operational
- Degraded performance
- Partial Outage
- Major Outage
- Under maintenance
bhs < > Nwk
Incident
Report for Network & Infrastructure
Resolved
La fibre Newark < > Beauharnois est down.
Nous investiguons.
Update(s):
Date: 2014-04-01 20:37:48 UTC
The fiber provider has completed all splicing. The cables have been buried and their crews are hands-off at this time. The Transport NOC confirms that alarms remain clear and the Technical Service Center has confirmed restoral with the affected customers. The fiber cut was caused by road construction. The fiber was damaged during the installation of a new post during repairs to a highway guard rail along a bridge. The fiber provider confirmed this was a permanent restoration.
Date: 2014-04-01 20:37:18 UTC
The Transport NOC confirms that all alarms are clear at this time and the final system restored at approximately 17:17 GMT. The Technical Service Center continues confirming restoral with customers. The Transport NOC will continue to monitor alarms while awaiting confirmation that the fiber provider is hands-off.
Date: 2014-04-01 20:37:06 UTC
The Transport NOC sees the majority of alarms clear with all affected systems up at this time. The Technical Service Center has began confirming service restoral with customers.
Date: 2014-04-01 20:36:58 UTC
The fiber provider is completing splicing on one end and has two buffer tubes remaining to splice on the other end. The Transport NOC verified that additional alarms have cleared and services are restoring.
Date: 2014-04-01 20:36:51 UTC
The fiber provider continues with restoration efforts at this time. The Transport NOC is monitoring alarms and confirms some systems have restored.
Date: 2014-04-01 20:35:30 UTC
The fiber provider has completed splicing eight of the ten buffer tubes on one side and has completed splicing of five buffer tubes on the other end. Once all the splicing has completed on one side, those resources will assist with splicing on the other end for a faster restoration. No estimated time of restoral has been provided.
Date: 2014-04-01 16:34:23 UTC
Le cable est réparé et les services remontés. Nous remettons en production les peerings et transits sur New York / Newar / Ashburn et Miami.
Date: 2014-04-01 15:47:46 UTC
The field technician reports that the fiber provider has completed splicing three buffer tubes on both sides and beginning splicing on the fourth tube at this time. The fiber provider has advised they are not able to provide an estimated restoral time currently, but may as work progresses further. The Level 3 field technician remains on site to obtain updates and observe the progress of the repair efforts.
Date: 2014-04-01 15:12:12 UTC
The Transport NOC reoprts that splicing is now underway on both ends of the cable. No estimated time of restoral has been provided as of yet. The Level 3 field technician at the site is working to obtain an estimated restoral time.
Date: 2014-04-01 12:50:04 UTC
The Transport NOC has advised that the additional damaged cable has been fully repaired and the restoration cable for the 120-count fiber has been set in the conduit. The Transport NOC is currently attempting to obtain an estimated time of restoral.
Date: 2014-04-01 11:25:10 UTC
The splice crews have begun prepping the 120-count fiber for splicing.
Date: 2014-04-01 10:07:06 UTC
The Transport NOC advised that the splicing of the additional damaged cable continues. In attempt to complete repairs quickly, four splice crews are at the site working on the damaged fibers. An estimated time of restoral is not available at this time.
Date: 2014-04-01 08:36:44 UTC
The Transport NOC advised that the excavation crew has arrived to the site and efforts to excavate the damaged fibers are underway. An estimated time of restoral is not available at this time.
Date: 2014-04-01 07:37:48 UTC
The Transport NOC advised that the fiber provider continues to await the arrival of the excavation crew. An estimated time of arrival is not available at this time.
Date: 2014-04-01 06:34:13 UTC
The Transport NOC advised that the fiber provider has engaged an excavation crew, but an estimated time of arrival is not available at this time. Upon completion of the excavation, the splice crew will complete the necessary fiber repairs.
Date: 2014-04-01 05:57:50 UTC
The fiber provider's splice crews continue assessing the damage.
Date: 2014-04-01 05:57:43 UTC
The fiber provider has confirmed that their splice crew has arrived to the fault location, and they are currently assessing the situation. Once the extent of the damage is known, an appropriate repair strategy will be developed for implementation, and an estimated restoral time can be provided.
Date: 2014-04-01 05:57:31 UTC
The fiber provider has reported that the fault has been located, and was determined to have been caused by road construction. It appears that the 120-count fiber was damaged by a new post being installed during the repairs to a highway guardrail. Splice crews remain en route to the area; an estimated arrival time has not yet been provided.
Date: 2014-04-01 05:57:24 UTC
The Transport NOC has confirmed that the Level 3 field technician has arrived to the area. Efforts to isolate the location of the damage continue.
Date: 2014-04-01 02:40:08 UTC
The fiber provider has advised that the fault has been isolated to a fiber section along a bridge. Splice crews have been engaged to assist with locating the physical damage, and are currently en route to the area. An estimated arrival time is not yet available.
Date: 2014-04-01 01:43:59 UTC
The fiber provider's field technicians continue working to locate the fault.
Date: 2014-04-01 01:00:03 UTC
The fiber provider has reported that their field technicians are currently on site at two adjacent locations, and are working to isolate the exact break point.
Date: 2014-03-31 23:57:42 UTC
The fiber provider has confirmed a fiber cut on their portion of the span between Suffern and Woodbury, NY. At this time, the fiber provider as well as Level 3 are dispatching field technicians to assist with isolating the exact location of the break. The Level 3 field technician has provided an estimated arrival time of approximately two hours, and an estimated arrival time for the fiber provider's field technician will be provided once it has been made available.
Date: 2014-03-31 23:31:08 UTC
The Transport NOC has advised that the issue is believed
to have been isolated to a fiber provider's network.
Efforts to contact the fiber provider are currently ongoing.
Date: 2014-03-31 23:17:00 UTC
Level3 GFS field technician shot the fiber from the site,
and a fault has been isolated approximately 60 kilometers out.
Outside Plant Engineers have been contacted, and investigations
are ongoing to determine whether the fault is on a fiber
provider's portion of the span.
Date: 2014-03-31 23:14:26 UTC
Nous avons redirigé le trafic de:
- Miami,FL
- Atlanta,GA
- Ashburn,VA
- Newark,NJ
- New York,NYC
sur la coté West de l’Amérique du Nord.
Nous avons activé le PNI avec Comcast.
Date: 2014-03-31 22:21:51 UTC
La coupure de fibre est en sortie de New York vers Albanie
et impacte plusieurs fournisseurs et services
- Level3 NWK / BHS (10x10G)
- Level3 NWK / MTL (2x10G)
- Hibernia NWK / MTL (2x10G)
- Telia NWK / CHI (6x10G)
- Telia NWK / PAL (2x10G)
- Level3 Paris / New York / BHS (4x10G)
Les liens NWK / MTL-BHS c'est \"normal\" dans la mesure où
il s'agit de la route Newark/Albanie/Montréal. Par contre
la route, Newark/Chicago par Albanie sera changé vers une
route plus directe afin d’éviter de problèmes sur l'accès
au DC quand il y a un problème sur NWK/MTL
Date: 2014-03-31 22:19:34 UTC
Des techniciens sont sur sites.
Date: 2014-03-31 22:08:54 UTC
Le fournisseur nous remonte une coupure de fibre a New York.
Date: 2014-03-31 22:03:40 UTC
Le trafic s'écoule via Montreal. Nous contactons notre fournisseur.
Nous investiguons.
Update(s):
Date: 2014-04-01 20:37:48 UTC
The fiber provider has completed all splicing. The cables have been buried and their crews are hands-off at this time. The Transport NOC confirms that alarms remain clear and the Technical Service Center has confirmed restoral with the affected customers. The fiber cut was caused by road construction. The fiber was damaged during the installation of a new post during repairs to a highway guard rail along a bridge. The fiber provider confirmed this was a permanent restoration.
Date: 2014-04-01 20:37:18 UTC
The Transport NOC confirms that all alarms are clear at this time and the final system restored at approximately 17:17 GMT. The Technical Service Center continues confirming restoral with customers. The Transport NOC will continue to monitor alarms while awaiting confirmation that the fiber provider is hands-off.
Date: 2014-04-01 20:37:06 UTC
The Transport NOC sees the majority of alarms clear with all affected systems up at this time. The Technical Service Center has began confirming service restoral with customers.
Date: 2014-04-01 20:36:58 UTC
The fiber provider is completing splicing on one end and has two buffer tubes remaining to splice on the other end. The Transport NOC verified that additional alarms have cleared and services are restoring.
Date: 2014-04-01 20:36:51 UTC
The fiber provider continues with restoration efforts at this time. The Transport NOC is monitoring alarms and confirms some systems have restored.
Date: 2014-04-01 20:35:30 UTC
The fiber provider has completed splicing eight of the ten buffer tubes on one side and has completed splicing of five buffer tubes on the other end. Once all the splicing has completed on one side, those resources will assist with splicing on the other end for a faster restoration. No estimated time of restoral has been provided.
Date: 2014-04-01 16:34:23 UTC
Le cable est réparé et les services remontés. Nous remettons en production les peerings et transits sur New York / Newar / Ashburn et Miami.
Date: 2014-04-01 15:47:46 UTC
The field technician reports that the fiber provider has completed splicing three buffer tubes on both sides and beginning splicing on the fourth tube at this time. The fiber provider has advised they are not able to provide an estimated restoral time currently, but may as work progresses further. The Level 3 field technician remains on site to obtain updates and observe the progress of the repair efforts.
Date: 2014-04-01 15:12:12 UTC
The Transport NOC reoprts that splicing is now underway on both ends of the cable. No estimated time of restoral has been provided as of yet. The Level 3 field technician at the site is working to obtain an estimated restoral time.
Date: 2014-04-01 12:50:04 UTC
The Transport NOC has advised that the additional damaged cable has been fully repaired and the restoration cable for the 120-count fiber has been set in the conduit. The Transport NOC is currently attempting to obtain an estimated time of restoral.
Date: 2014-04-01 11:25:10 UTC
The splice crews have begun prepping the 120-count fiber for splicing.
Date: 2014-04-01 10:07:06 UTC
The Transport NOC advised that the splicing of the additional damaged cable continues. In attempt to complete repairs quickly, four splice crews are at the site working on the damaged fibers. An estimated time of restoral is not available at this time.
Date: 2014-04-01 08:36:44 UTC
The Transport NOC advised that the excavation crew has arrived to the site and efforts to excavate the damaged fibers are underway. An estimated time of restoral is not available at this time.
Date: 2014-04-01 07:37:48 UTC
The Transport NOC advised that the fiber provider continues to await the arrival of the excavation crew. An estimated time of arrival is not available at this time.
Date: 2014-04-01 06:34:13 UTC
The Transport NOC advised that the fiber provider has engaged an excavation crew, but an estimated time of arrival is not available at this time. Upon completion of the excavation, the splice crew will complete the necessary fiber repairs.
Date: 2014-04-01 05:57:50 UTC
The fiber provider's splice crews continue assessing the damage.
Date: 2014-04-01 05:57:43 UTC
The fiber provider has confirmed that their splice crew has arrived to the fault location, and they are currently assessing the situation. Once the extent of the damage is known, an appropriate repair strategy will be developed for implementation, and an estimated restoral time can be provided.
Date: 2014-04-01 05:57:31 UTC
The fiber provider has reported that the fault has been located, and was determined to have been caused by road construction. It appears that the 120-count fiber was damaged by a new post being installed during the repairs to a highway guardrail. Splice crews remain en route to the area; an estimated arrival time has not yet been provided.
Date: 2014-04-01 05:57:24 UTC
The Transport NOC has confirmed that the Level 3 field technician has arrived to the area. Efforts to isolate the location of the damage continue.
Date: 2014-04-01 02:40:08 UTC
The fiber provider has advised that the fault has been isolated to a fiber section along a bridge. Splice crews have been engaged to assist with locating the physical damage, and are currently en route to the area. An estimated arrival time is not yet available.
Date: 2014-04-01 01:43:59 UTC
The fiber provider's field technicians continue working to locate the fault.
Date: 2014-04-01 01:00:03 UTC
The fiber provider has reported that their field technicians are currently on site at two adjacent locations, and are working to isolate the exact break point.
Date: 2014-03-31 23:57:42 UTC
The fiber provider has confirmed a fiber cut on their portion of the span between Suffern and Woodbury, NY. At this time, the fiber provider as well as Level 3 are dispatching field technicians to assist with isolating the exact location of the break. The Level 3 field technician has provided an estimated arrival time of approximately two hours, and an estimated arrival time for the fiber provider's field technician will be provided once it has been made available.
Date: 2014-03-31 23:31:08 UTC
The Transport NOC has advised that the issue is believed
to have been isolated to a fiber provider's network.
Efforts to contact the fiber provider are currently ongoing.
Date: 2014-03-31 23:17:00 UTC
Level3 GFS field technician shot the fiber from the site,
and a fault has been isolated approximately 60 kilometers out.
Outside Plant Engineers have been contacted, and investigations
are ongoing to determine whether the fault is on a fiber
provider's portion of the span.
Date: 2014-03-31 23:14:26 UTC
Nous avons redirigé le trafic de:
- Miami,FL
- Atlanta,GA
- Ashburn,VA
- Newark,NJ
- New York,NYC
sur la coté West de l’Amérique du Nord.
Nous avons activé le PNI avec Comcast.
Date: 2014-03-31 22:21:51 UTC
La coupure de fibre est en sortie de New York vers Albanie
et impacte plusieurs fournisseurs et services
- Level3 NWK / BHS (10x10G)
- Level3 NWK / MTL (2x10G)
- Hibernia NWK / MTL (2x10G)
- Telia NWK / CHI (6x10G)
- Telia NWK / PAL (2x10G)
- Level3 Paris / New York / BHS (4x10G)
Les liens NWK / MTL-BHS c'est \"normal\" dans la mesure où
il s'agit de la route Newark/Albanie/Montréal. Par contre
la route, Newark/Chicago par Albanie sera changé vers une
route plus directe afin d’éviter de problèmes sur l'accès
au DC quand il y a un problème sur NWK/MTL
Date: 2014-03-31 22:19:34 UTC
Des techniciens sont sur sites.
Date: 2014-03-31 22:08:54 UTC
Le fournisseur nous remonte une coupure de fibre a New York.
Date: 2014-03-31 22:03:40 UTC
Le trafic s'écoule via Montreal. Nous contactons notre fournisseur.
This incident affected: Infrastructure || BHS (BHS1, BHS2, BHS3, BHS4, BHS5, BHS6, BHS7).