Level3 worldwide emergency upgrade?

Mon Feb 11 01:47:53 UTC 2013

I think you might find its this issue.

PSN-2013-01-823

"Junos: Crafted TCP packet can lead to kernel crash"

-----Original Message-----
From: Matthew Petach [mailto:mpetach at netflight.com] 
Sent: Thursday, 7 February 2013 7:23 a.m.
To: Jonathan Towne
Cc: nanog at nanog.org
Subject: Re: Level3 worldwide emergency upgrade?

On Wed, Feb 6, 2013 at 5:10 AM, Jonathan Towne <jtowne at slic.com> wrote:
> On Wed, Feb 06, 2013 at 07:57:06AM -0500, Alex Rubenstein scribbled:
> # The question should be more along the lines of, "why aren't you multihomed in a way that would make a 30 minute outage (which is inevitable) irrelevant to you?
>
> The fun part of this emergency maintenance in the northeast USA was 
> that even folks who are multihomed felt it: Level3 managed to do this 
> in a way that kept BGP sessions up but killed the ability to actually 
> pass traffic.  I'm not sure what they did that caused this, or whether 
> anyone but northeast folks were affected by it, but it sure was neat 
> to be effectively blackholed in and out of one of your provided circuits for a while.

I recommend you grab
http://kestrel3.netflight.com/2013.02.05-NANOG57-day2-afternoon-session.txt

and search for PR8361907

Richard did a very good lightning talk about why Juniper boxes will bring up BGP but blackhole traffic for 30 minutes to over an hour, depending on number of BGP sessions it is handling.

His recommendation--if you don't like it, go tell Juniper to fix that bug.

Matt

--
BEGIN-ANTISPAM-VOTING-LINKS
------------------------------------------------------

Teach Email Guard if this mail (ID 09IV6SM1n) is spam:
Spam:        https://emailguard.orcon.net.nz/canit/b.php?i=09IV6SM1n&m=d5617dabf346&t=20130207&c=s
Not spam:    https://emailguard.orcon.net.nz/canit/b.php?i=09IV6SM1n&m=d5617dabf346&t=20130207&c=n
Forget vote: https://emailguard.orcon.net.nz/canit/b.php?i=09IV6SM1n&m=d5617dabf346&t=20130207&c=f
------------------------------------------------------
END-ANTISPAM-VOTING-LINKS