Fiber cut in SF Bay Area?

Hello, I'm only posting this here because the Outages list appears to be broken. I've got confirmed reports (from Cogent and Megapath) that there is a fiber cut affecting service through the South Bay. We have Cogent fiber circuits down in Campbell and San Martin. In San Martin, AT&T cell phones have no service whatsoever, DSL service is spotty. Landline and DSL service in Gilroy is almost completely gone. We know of a Cogent fiber link in Campbell that is down as well. Anyone have any additional info? -Robert Anyone have any further details? The issue seems to have started around 1:00am PDT or so. -Robert

On Apr 16, 2013, at 11:45 AM, Robert Glover <robertg@garlic.com> wrote:
Hello,
I'm only posting this here because the Outages list appears to be broken.
I'll look into that.
I've got confirmed reports (from Cogent and Megapath) that there is a fiber cut affecting service through the South Bay.
We have Cogent fiber circuits down in Campbell and San Martin. In San Martin, AT&T cell phones have no service whatsoever, DSL service is spotty. Landline and DSL service in Gilroy is almost completely gone. We know of a Cogent fiber link in Campbell that is down as well.
I've heard about a number of circuits down with splice crew on the way. - jared

Lost a Zayo circuit from Palo Alto to Los Angeles. ETR was given as 11AM PDT. -RR On 4/16/13, Robert Glover <robertg@garlic.com> wrote:
Hello,
I'm only posting this here because the Outages list appears to be broken.
I've got confirmed reports (from Cogent and Megapath) that there is a fiber cut affecting service through the South Bay.
We have Cogent fiber circuits down in Campbell and San Martin. In San Martin, AT&T cell phones have no service whatsoever, DSL service is spotty. Landline and DSL service in Gilroy is almost completely gone. We know of a Cogent fiber link in Campbell that is down as well.
Anyone have any additional info?
-Robert
Anyone have any further details? The issue seems to have started around 1:00am PDT or so.
-Robert
-- Sent from my mobile device

Level3 is also impacted. This cut seems to be vandalism but only heard this from one source. Zaid Sent from my iPhone On Apr 16, 2013, at 12:51 PM, Ravi Pina <ravi@cow.org> wrote:
Our Zayo provided ETR is 11:00 - 11:30 PDT.
XO is one of the impacted providers as well.
-r
On Tue, Apr 16, 2013 at 08:55:56AM -0700, Raul Rodriguez wrote:
Lost a Zayo circuit from Palo Alto to Los Angeles. ETR was given as 11AM PDT.
-RR

I heard of a fiber cut in Texas where the thieves thought it was copper :-) On 4/16/2013 10:26 AM, Zaid Ali Kahn wrote:
Level3 is also impacted. This cut seems to be vandalism but only heard this from one source.
Zaid
Sent from my iPhone
On Apr 16, 2013, at 12:51 PM, Ravi Pina <ravi@cow.org> wrote:
Our Zayo provided ETR is 11:00 - 11:30 PDT.
XO is one of the impacted providers as well.
-r
On Tue, Apr 16, 2013 at 08:55:56AM -0700, Raul Rodriguez wrote:
Lost a Zayo circuit from Palo Alto to Los Angeles. ETR was given as 11AM PDT.
-RR .

The information that I have is consistent with that...the cut appears to be vandalism related. Splicing has been under way for several hours and is expected to be completed within the next 30 minutes. Dave -----Original Message----- From: Zaid Ali Kahn [mailto:zaid@zaidali.com] Sent: Tuesday, April 16, 2013 11:27 AM To: Ravi Pina Cc: nanog@nanog.org Subject: Re: Fiber cut in SF Bay Area? Level3 is also impacted. This cut seems to be vandalism but only heard this from one source. Zaid Sent from my iPhone On Apr 16, 2013, at 12:51 PM, Ravi Pina <ravi@cow.org> wrote:
Our Zayo provided ETR is 11:00 - 11:30 PDT.
XO is one of the impacted providers as well.
-r
On Tue, Apr 16, 2013 at 08:55:56AM -0700, Raul Rodriguez wrote:
Lost a Zayo circuit from Palo Alto to Los Angeles. ETR was given as 11AM PDT.
-RR

I just spoke to Cogent about 10 minutes ago. They confirmed with AT&T that it was vandalism, but AT&T gave them an ETR of 4:00PM PDT. On 4/16/2013 12:18 PM, Siegel, David wrote:
The information that I have is consistent with that...the cut appears to be vandalism related.
Splicing has been under way for several hours and is expected to be completed within the next 30 minutes.
Dave
-----Original Message----- From: Zaid Ali Kahn [mailto:zaid@zaidali.com] Sent: Tuesday, April 16, 2013 11:27 AM To: Ravi Pina Cc: nanog@nanog.org Subject: Re: Fiber cut in SF Bay Area?
Level3 is also impacted. This cut seems to be vandalism but only heard this from one source.
Zaid
Sent from my iPhone
On Apr 16, 2013, at 12:51 PM, Ravi Pina <ravi@cow.org> wrote:
Our Zayo provided ETR is 11:00 - 11:30 PDT.
XO is one of the impacted providers as well.
-r
On Tue, Apr 16, 2013 at 08:55:56AM -0700, Raul Rodriguez wrote:
Lost a Zayo circuit from Palo Alto to Los Angeles. ETR was given as 11AM PDT.
-RR

All, Just got off the horn with Cogent. They called AT&T while they had me on hold, AT&T told them they have extracted the fiber, which was, according to them, "very heavily damaged". They have brought a new cable in, and are in the process of splicing. -Robert On 4/16/2013 12:21 PM, Robert Glover wrote:
I just spoke to Cogent about 10 minutes ago. They confirmed with AT&T that it was vandalism, but AT&T gave them an ETR of 4:00PM PDT.
On 4/16/2013 12:18 PM, Siegel, David wrote:
The information that I have is consistent with that...the cut appears to be vandalism related.
Splicing has been under way for several hours and is expected to be completed within the next 30 minutes.
Dave
-----Original Message----- From: Zaid Ali Kahn [mailto:zaid@zaidali.com] Sent: Tuesday, April 16, 2013 11:27 AM To: Ravi Pina Cc: nanog@nanog.org Subject: Re: Fiber cut in SF Bay Area?
Level3 is also impacted. This cut seems to be vandalism but only heard this from one source.
Zaid
Sent from my iPhone
On Apr 16, 2013, at 12:51 PM, Ravi Pina <ravi@cow.org> wrote:
Our Zayo provided ETR is 11:00 - 11:30 PDT.
XO is one of the impacted providers as well.
-r
On Tue, Apr 16, 2013 at 08:55:56AM -0700, Raul Rodriguez wrote:
Lost a Zayo circuit from Palo Alto to Los Angeles. ETR was given as 11AM PDT.
-RR

We saw service restoration start at or about 1026 PDT. -r On Tue, Apr 16, 2013 at 12:51:16PM -0400, Ravi Pina wrote:
Our Zayo provided ETR is 11:00 - 11:30 PDT.
XO is one of the impacted providers as well.
-r
On Tue, Apr 16, 2013 at 08:55:56AM -0700, Raul Rodriguez wrote:
Lost a Zayo circuit from Palo Alto to Los Angeles. ETR was given as 11AM PDT.
-RR

MegaPath reports no service disruptions for DSL services. My latency graph says otherwise... http://i.imgur.com/pwC2oX2.png These graphs are for 2 Megapath DSL serviced locations in NorCal from a SoCal perspective. -Ryan On Tue, Apr 16, 2013 at 8:45 AM, Robert Glover <robertg@garlic.com> wrote:
Hello,
I'm only posting this here because the Outages list appears to be broken.
I've got confirmed reports (from Cogent and Megapath) that there is a fiber cut affecting service through the South Bay.
We have Cogent fiber circuits down in Campbell and San Martin. In San Martin, AT&T cell phones have no service whatsoever, DSL service is spotty. Landline and DSL service in Gilroy is almost completely gone. We know of a Cogent fiber link in Campbell that is down as well.
Anyone have any additional info?
-Robert
Anyone have any further details? The issue seems to have started around 1:00am PDT or so.
-Robert

This might be related: http://www.reuters.com/article/2013/04/16/california-electricity-siliconvall... — Sent from Mailbox for iPhone On Tue, Apr 16, 2013 at 1:50 PM, Ryan Bonnell <nanog@dm0.org> wrote:
MegaPath reports no service disruptions for DSL services. My latency graph says otherwise... http://i.imgur.com/pwC2oX2.png These graphs are for 2 Megapath DSL serviced locations in NorCal from a SoCal perspective. -Ryan On Tue, Apr 16, 2013 at 8:45 AM, Robert Glover <robertg@garlic.com> wrote:
Hello,
I'm only posting this here because the Outages list appears to be broken.
I've got confirmed reports (from Cogent and Megapath) that there is a fiber cut affecting service through the South Bay.
We have Cogent fiber circuits down in Campbell and San Martin. In San Martin, AT&T cell phones have no service whatsoever, DSL service is spotty. Landline and DSL service in Gilroy is almost completely gone. We know of a Cogent fiber link in Campbell that is down as well.
Anyone have any additional info?
-Robert
Anyone have any further details? The issue seems to have started around 1:00am PDT or so.
-Robert

That wouldn't surprise me at all. The substation they're talking about is actually quite large ( http://goo.gl/maps/2FuO4 ) and is right next to a NG power plant. http://en.wikipedia.org/wiki/Metcalf_Energy_Center http://en.wikipedia.org/wiki/Path_15 On 2013.04.16 10:52:46, Jason L. Sparks wrote:
This might be related: http://www.reuters.com/article/2013/04/16/california-electricity-siliconvall... — Sent from Mailbox for iPhone
On Tue, Apr 16, 2013 at 1:50 PM, Ryan Bonnell <nanog@dm0.org> wrote:
MegaPath reports no service disruptions for DSL services. My latency graph says otherwise... http://i.imgur.com/pwC2oX2.png These graphs are for 2 Megapath DSL serviced locations in NorCal from a SoCal perspective. -Ryan On Tue, Apr 16, 2013 at 8:45 AM, Robert Glover <robertg@garlic.com> wrote:
Hello,
I'm only posting this here because the Outages list appears to be broken.
I've got confirmed reports (from Cogent and Megapath) that there is a fiber cut affecting service through the South Bay.
We have Cogent fiber circuits down in Campbell and San Martin. In San Martin, AT&T cell phones have no service whatsoever, DSL service is spotty. Landline and DSL service in Gilroy is almost completely gone. We know of a Cogent fiber link in Campbell that is down as well.
Anyone have any additional info?
-Robert
Anyone have any further details? The issue seems to have started around 1:00am PDT or so.
-Robert

On Tue, Apr 16, 2013 at 1:48 PM, Ryan Bonnell <nanog@dm0.org> wrote:
MegaPath reports no service disruptions for DSL services. My latency graph says otherwise...
that's not a service 'disruption'... that's just longer latency.
looks like your packets took the east-coast path up the west-coast. -chris
participants (11)
-
Christopher Morrow
-
Jared Mauch
-
Jason L. Sparks
-
Raul Rodriguez
-
Ravi Pina
-
Robert Glover
-
Roy
-
Ryan Bonnell
-
Sean Head
-
Siegel, David
-
Zaid Ali Kahn