Time Warner outage?

Sat Aug 30 02:17:03 UTC 2014

What we noticed on home RoadRunner and on business TWC fiber about 6:15 AM EDT on the 27th:

We could access systems from one to another by IP address but not DNS. 
We could ping other systems by IP.
Home DHCP was up but TWC DNS was down at home and at work on the business fiber. Couldn't even reach TWC DNS servers by IP address.

I'm not sure why two different classes of systems, business and residential, thirty miles apart would both be down on DNS but up on routing since the DNS servers are on different subnets. (We use TWC business DNS as Forwarders.)

It was acting like a DNS failure more than a routing failure for us. I vaguely remembered something about Cox DNS having an outage a few days earlier that someone in the Middle East took credit for but I can't find the article now. I was wondering if TWC was putting in a mitigation and got it wrong, or TWC did not put in a mitigation and the Middle Easters knocked on their door. My impression is that it was acting like all DNS traffic in and out of TWC was getting blocked but it cleared up too soon to perform further testing.

Ray

> Date: Thu, 28 Aug 2014 15:17:37 -0400
> From: eric.stoltz at neovera.com
> To: nanog at nanog.org
> Subject: Re: Time Warner outage?
> 
> Looks like TW is having further issues this afternoon.
> 
> Eric Stoltz
> Neovera
> 
> 
> On 08/28/2014 01:37 PM, Chris Garrett wrote:
> > Based on the link that Wes shared, sounds like someone made a BGP boo boo.
> >
> > Not that I routed damn near the whole internet down a customers DS3 or anything once, but I can see how it could happen and then propagate out of control before it was caught.
> >
> > On Aug 28, 2014, at 11:57 AM, Jay Ashworth <jra at baylink.com> wrote:
> >
> >> ----- Original Message -----
> >>> From: "Steve Naslund" <SNaslund at medline.com>
> >>> I don’t buy that excuse either. If Level 3 is doing fiber maintenance
> >>> on any route and takes down your entire network, then you have a
> >>> pretty poor backbone design. It is not Level 3s fault if you design
> >>> your network such that a single route loss causes a huge outage.
> >> Does the T-Bone run over L3?  I thought it was either owned or dark-leased
> >> fiber and their own routers...
> >>
> >> Cheers,
> >> -- jra
> >> -- 
> >> Jay R. Ashworth                  Baylink                       jra at baylink.com
> >> Designer                     The Things I Think                       RFC 2100
> >> Ashworth & Associates       http://www.bcp38.info          2000 Land Rover DII
> >> St Petersburg FL USA      BCP38: Ask For It By Name!           +1 727 647 1274
> 