Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information? http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us
The current line is Level3 is currently having an issue where they have certain code versions of a certain router vendor deployed. They haven't said anything yet, so it's still kind of sketchy. -----Original Message----- From: Peter Pauly [mailto:ppauly@gmail.com] Sent: Monday, November 07, 2011 10:04 AM To: nanog@nanog.org Subject: Time Warner Telecom problems Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information? http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us
L3 reported multiple links bouncing nationwide in the US approx 30 minutes ago. Causing multiple IP issues. Lane -- Lane Powers On 11/7/11 9:04 AM, "Peter Pauly" <ppauly@gmail.com> wrote:
Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information?
http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us
Any idea where this information can be found publically? -----Original Message----- From: Lane Powers [mailto:lane.powers@swat.coop] Sent: Monday, November 07, 2011 10:06 AM To: Peter Pauly; nanog@nanog.org Subject: Re: Time Warner Telecom problems L3 reported multiple links bouncing nationwide in the US approx 30 minutes ago. Causing multiple IP issues. Lane -- Lane Powers On 11/7/11 9:04 AM, "Peter Pauly" <ppauly@gmail.com> wrote:
Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information?
http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us
If your an L3 transit customer you should be able to refer to event id 5197215. Not sure if they have published anything otherwise, it is still very early. In our case we had to drop our L3 sessions until the storm passes. Lane On 11/7/11 9:08 AM, "Drew Weaver" <drew.weaver@thenap.com> wrote:
Any idea where this information can be found publically?
-----Original Message----- From: Lane Powers [mailto:lane.powers@swat.coop] Sent: Monday, November 07, 2011 10:06 AM To: Peter Pauly; nanog@nanog.org Subject: Re: Time Warner Telecom problems
L3 reported multiple links bouncing nationwide in the US approx 30 minutes ago. Causing multiple IP issues.
Lane -- Lane Powers
On 11/7/11 9:04 AM, "Peter Pauly" <ppauly@gmail.com> wrote:
Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information?
http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us
I believe you are referring to Time Warner Cable. There is no such thing as Time Warner Telecom anymore. -----Original Message----- From: Peter Pauly [mailto:ppauly@gmail.com] Sent: Monday, November 07, 2011 8:04 AM To: nanog@nanog.org Subject: Time Warner Telecom problems Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information? http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us ------------- The content contained in this electronic message is not intended to constitute formation of a contract binding tw telecom. tw telecom will be contractually bound only upon execution, by an authorized officer, of a contract including agreed terms and conditions or by express application of its tariffs. This message is intended only for the use of the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the sender of this E-Mail or by telephone.
On Mon, 7 Nov 2011, Calkins, Mark wrote:
I believe you are referring to Time Warner Cable. There is no such thing as Time Warner Telecom anymore.
It's just TW Telecom now. http://www.twtelecom.com/ ---------------------------------------------------------------------- Jon Lewis, MCP :) | I route Senior Network Engineer | therefore you are Atlantic Net | _________ http://www.lewis.org/~jlewis/pgp for PGP public key_________
On Mon, 7 Nov 2011, Peter Pauly wrote:
Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information?
http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us
I noticed just a little while ago that we're having a lot of DNS fail. Initial findings were that several of the root-servers we were trying to reach via our TWTelecom link were unreachable after 2 hops into TWT. 4 64-128-130-233.static.twtelecom.NET (64.128.130.233) 2.399 ms 2.298 ms 2.338 ms 5 mia2-pr1-xe-1-3-0-0.us.twtelecom.net (66.192.253.18) 11.571 ms 11.552 ms 9.467 ms 6 * * * 7 * * * 8 * * * For instance, a.root-servers.net is pingable from a rackspace server, but not from our network (unless I shut off TWT, at which point it is, but it's apparently not the same a.root-servers.net instance rackspace sees). I assume this is one of the root-servers being anycast. Shutting off our BGP with TWT didn't appear to help (though the root-servers became reachable)...so I assume there's more going on than just TWT routing fail. ---------------------------------------------------------------------- Jon Lewis, MCP :) | I route Senior Network Engineer | therefore you are Atlantic Net | _________ http://www.lewis.org/~jlewis/pgp for PGP public key_________
On Mon, Nov 07, 2011 at 07:04:19AM -0800, Peter Pauly wrote:
Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information?
http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us
FWIW, my home TWC connection dropped this morning for about 15 minutes (Southern California around 6:30AM'ish). Still could ping the default gateway, but packets weren't traversing much beyond that. Didn't investigate further, just headed into work. Ray
Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information?
http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us
Actually, it looks to me like they mean "Time Warner", because that's what they said. The company once known as "Time Warner Telecom" has always been a different entity, and hasn't been known as that in some time, now being called "twtelecom." Much of that company is what was once known as inc.net, a Milwaukee area provider of the '90's. Time Warner Cable appears to have experienced an implosion this morning, being out of service for about 11 minutes. During that time, packets originating here in Milwaukee quickly died in Chicago; 1 76.46.192.1 8.320 ms 9.900 ms 7.974 ms 2 24.160.230.32 7.967 ms 5.975 ms 8.479 ms 3 24.160.229.132 8.471 ms 7.969 ms 10.991 ms 4 24.160.229.193 9.972 ms 9.973 ms 24.160.229.197 9.985 ms 5 * * * 6 * * * while packets destined for RR all seemed to be headed out to SJC, from what I can tell. ... JG -- Joe Greco - sol.net Network Services - Milwaukee, WI - http://www.sol.net "We call it the 'one bite at the apple' rule. Give me one chance [and] then I won't contact you again." - Direct Marketing Ass'n position on e-mail spam(CNN) With 24 million small businesses in the US alone, that's way too many apples.
Joe Greco wrote the following on 11/7/2011 9:54 AM:
Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information?
http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us Actually, it looks to me like they mean "Time Warner", because that's what they said.
The company once known as "Time Warner Telecom" has always been a different entity, and hasn't been known as that in some time, now being called "twtelecom." Much of that company is what was once known as inc.net, a Milwaukee area provider of the '90's.
Time Warner Cable appears to have experienced an implosion this morning, being out of service for about 11 minutes. During that time, packets originating here in Milwaukee quickly died in Chicago;
Using the looking glass from TWtelecom, we saw 30-60min outage (roughly 8:30AM to 9:30AM CST) between the Kansas City location and our own server room in Kansas City. Other TWtelecom locations appeared to be unaffected. Perhaps TWtelecom is served by Timewarner or shares equipment in KC. Either way, none of our KC customers who were served via TWtelecom or Timewarner were able to reach us. Packets would hit Level 3 Communications and die in either direction at the border between L3 and TW. FWIW, TW was showing a good BGP route to us and vise versa. http://lglass.twtelecom.net/
FWIW, We saw issues here in Indianapolis between TWTC and L3 up until a few minutes ago. --Thomas York -----Original Message----- From: Blake Hudson [mailto:blake@ispn.net] Sent: Monday, November 07, 2011 11:02 AM To: nanog@nanog.org Subject: Re: Time Warner Telecom problems Joe Greco wrote the following on 11/7/2011 9:54 AM:
Gizmodo is reporting problems at Time Warner Telecom .... we're suffering from it too and calls to the NOC have not been answered so far... does anyone have any further information?
http://gizmodo.com/5857010/massive-time-warner-outage-hits-the-us Actually, it looks to me like they mean "Time Warner", because that's what they said.
The company once known as "Time Warner Telecom" has always been a different entity, and hasn't been known as that in some time, now being called "twtelecom." Much of that company is what was once known as inc.net, a Milwaukee area provider of the '90's.
Time Warner Cable appears to have experienced an implosion this morning, being out of service for about 11 minutes. During that time, packets originating here in Milwaukee quickly died in Chicago;
Using the looking glass from TWtelecom, we saw 30-60min outage (roughly 8:30AM to 9:30AM CST) between the Kansas City location and our own server room in Kansas City. Other TWtelecom locations appeared to be unaffected. Perhaps TWtelecom is served by Timewarner or shares equipment in KC. Either way, none of our KC customers who were served via TWtelecom or Timewarner were able to reach us. Packets would hit Level 3 Communications and die in either direction at the border between L3 and TW. FWIW, TW was showing a good BGP route to us and vise versa. http://lglass.twtelecom.net/
participants (9)
-
Blake Hudson
-
Calkins, Mark
-
Drew Weaver
-
Joe Greco
-
Jon Lewis
-
Lane Powers
-
Peter Pauly
-
Ray Van Dolson
-
Thomas York