What we noticed on home RoadRunner and on business TWC fiber about 6:15 AM EDT on the 27th: We could access systems from one to another by IP address but not DNS. We could ping other systems by IP. Home DHCP was up but TWC DNS was down at home and at work on the business fiber. Couldn't even reach TWC DNS servers by IP address. I'm not sure why two different classes of systems, business and residential, thirty miles apart would both be down on DNS but up on routing since the DNS servers are on different subnets. (We use TWC business DNS as Forwarders.) It was acting like a DNS failure more than a routing failure for us. I vaguely remembered something about Cox DNS having an outage a few days earlier that someone in the Middle East took credit for but I can't find the article now. I was wondering if TWC was putting in a mitigation and got it wrong, or TWC did not put in a mitigation and the Middle Easters knocked on their door. My impression is that it was acting like all DNS traffic in and out of TWC was getting blocked but it cleared up too soon to perform further testing. Ray
Date: Thu, 28 Aug 2014 15:17:37 -0400 From: eric.stoltz@neovera.com To: nanog@nanog.org Subject: Re: Time Warner outage?
Looks like TW is having further issues this afternoon.
Eric Stoltz Neovera
On 08/28/2014 01:37 PM, Chris Garrett wrote:
Based on the link that Wes shared, sounds like someone made a BGP boo boo.
Not that I routed damn near the whole internet down a customers DS3 or anything once, but I can see how it could happen and then propagate out of control before it was caught.
On Aug 28, 2014, at 11:57 AM, Jay Ashworth <jra@baylink.com> wrote:
----- Original Message -----
From: "Steve Naslund" <SNaslund@medline.com> I don’t buy that excuse either. If Level 3 is doing fiber maintenance on any route and takes down your entire network, then you have a pretty poor backbone design. It is not Level 3s fault if you design your network such that a single route loss causes a huge outage. Does the T-Bone run over L3? I thought it was either owned or dark-leased fiber and their own routers...
Cheers, -- jra -- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://www.bcp38.info 2000 Land Rover DII St Petersburg FL USA BCP38: Ask For It By Name! +1 727 647 1274