CloudFlare issues?

Mon Jun 24 12:39:12 UTC 2019

This is my final update, I’m going back to bed, wake me up when the
internet is working again.

https://news.ycombinator.com/item?id=20262316

——

1230 UTC update We are working with networks around the world and are
observing network routes for Google and AWS being leaked at well.

On Mon, Jun 24, 2019 at 05:20 Robbie Trencheny <me at robbiet.us> wrote:

> *1204 UTC update* This leak is wider spread that just Cloudflare.
>
> *1208 UTC update* Amazon Web Services now reporting external networking
> problem
>
> On Mon, Jun 24, 2019 at 05:18 Tom Paseka <tom at cloudflare.com> wrote:
>
>> a Verizon downstream BGP customer is leaking the full table, and some
>> more specific from us and many other providers.
>>
>> On Mon, Jun 24, 2019 at 7:56 AM Robbie Trencheny <me at robbiet.us> wrote:
>>
>>> *1147 UTC update* Staring at internal graphs looks like global traffic
>>> is now at 97% of expected so impact lessening.
>>>
>>> On Mon, Jun 24, 2019 at 04:51 Dovid Bender <dovid at telecurve.com> wrote:
>>>
>>>> We are seeing issues as well getting to HE. The traffic is going via
>>>> Alter.
>>>>
>>>>
>>>>
>>>> On Mon, Jun 24, 2019 at 7:48 AM Robbie Trencheny <me at robbiet.us> wrote:
>>>>
>>>>> From John Graham-Cumming, CTO of Cloudflare, on Hacker News right now:
>>>>>
>>>>> This appears to be a routing problem with Level3. All our systems are
>>>>> running normally but traffic isn't getting to us for a portion of our
>>>>> domains.
>>>>>
>>>>> 1128 UTC update Looks like we're dealing with a route leak and we're
>>>>> talking directly with the leaker and Level3 at the moment.
>>>>>
>>>>> 1131 UTC update Just to be clear this isn't affecting all our traffic
>>>>> or all our domains or all countries. A portion of traffic isn't hitting
>>>>> Cloudflare. Looks to be about an aggregate 10% drop in traffic to us.
>>>>>
>>>>> 1134 UTC update We are now certain we are dealing with a route leak.
>>>>>
>>>>> On Mon, Jun 24, 2019 at 04:04 Antonios Chariton <daknob.mac at gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Yes, traffic from Greek networks is routed through NYC (alter.net),
>>>>>> and previously it had a 60% packet loss. Now it’s still via NYC, but no
>>>>>> packet loss. This happens in GR-IX Athens, not GR-IX Thessaloniki, but the
>>>>>> problem definitely exists.
>>>>>>
>>>>>> Antonis
>>>>>>
>>>>>>
>>>>>> On 24 Jun 2019, at 13:55, Dmitry Sherman <dmitry at interhost.net>
>>>>>> wrote:
>>>>>>
>>>>>> Hello are there any issues with CloudFlare services now?
>>>>>>
>>>>>> Dmitry Sherman
>>>>>> dmitry at interhost.net
>>>>>> Interhost Networks Ltd
>>>>>> Web: http://www.interhost.co.il
>>>>>> fb: https://www.facebook.com/InterhostIL
>>>>>> Office: (+972)-(0)74-7029881 Fax: (+972)-(0)53-7976157
>>>>>>
>>>>>>
>>>>>> --
>>>>> --
>>>>> Robbie Trencheny (@robbie <http://twitter.com/robbie>)
>>>>> 925-884-3728
>>>>> robbie.io
>>>>>
>>>> --
>>> --
>>> Robbie Trencheny (@robbie <http://twitter.com/robbie>)
>>> 925-884-3728
>>> robbie.io
>>>
>> --
> --
> Robbie Trencheny (@robbie <http://twitter.com/robbie>)
> 925-884-3728
> robbie.io
>
-- 
--
Robbie Trencheny (@robbie <http://twitter.com/robbie>)
925-884-3728
robbie.io
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nanog.org/pipermail/nanog/attachments/20190624/ed019b61/attachment.html>