Nationwide Routing issues with Wiltel

Mon Jun 26 22:44:18 UTC 2006

FYI Level 3 had a pre-existing peering issue with UUNet/Alternet at the
end of last week that was due to issues on an oc48.  If that hasn't been
resolved, it is a separate (or compound) issue compared to today's
Wiltel outage.  We have been told by L3 that it was an outage on the
legacy Wiltel network.  From what we gather they had to reroute a lot of
that traffic onto other parts of their network, causing increased total
traffic and then latency, but that has not been confirmed to us.

	-Scott

-----Original Message-----
From: owner-nanog at merit.edu [mailto:owner-nanog at merit.edu] On Behalf Of
Jeremy Chadwick
Sent: Monday, June 26, 2006 5:04 PM
To: nanog at merit.edu
Subject: Re: Nationwide Routing issues with Wiltel

On Mon, Jun 26, 2006 at 04:55:04PM -0400, david raistrick wrote:
> On Mon, 26 Jun 2006, Vincent India wrote:
> >Anyone experiencing problems with Wiltel Backbone, or know of any
issues
> >with the Wiltel Backbone? I called their NOC and was told they are
> >experiencing a nationwide routing problem that they are working on
but
> >couldn't get any further details?
> 
> Told me it was related to the L3/Wiltel integration.  Most of the
breaks 
> I've been seeing seem to be at the point where most of my traffic has
be 
> going from wiltel to l3 in DC or so.  Oh, and that the "former wiltel"

> tier 1 guys had 40+ calls in the hold queue...

I can confirm this as well, although have no proof (at this point)
that Layer3 is necessarily to blame.  We (or rather the company I
work for) are seeing similar between MCI/UU/Verizon and WCG when
reaching some of our clients:

4. 0.so-4-0-0.CL1.LAX15.ALTER.NET     0.0%   102   10.9  11.3  10.9
17.1   0.7
5. POS6-0.GW1.LAX15.ALTER.NET         0.0%   102   10.7  11.1  10.7
13.9   0.5
6. wcgGigELAX-gw.customer.alter.net  98.0%   102  135.4 147.0 135.4
158.5  16.3
7. anhmca1wcx2-pos6-1-oc48.wcg.net   98.0%   102  162.9 156.8 150.8
162.9   8.6

-- 
| Jeremy Chadwick                                 jdc at parodius.com |
| Parodius Networking                        http://www.parodius.com/ |
| UNIX Systems Administrator                   Mountain View, CA, USA |
| Making life hard for others since 1977.               PGP: 4BD6C0CB |