Global issues @ Telia - doing a "FB/hold my beer" move?

Thu Oct 7 20:28:45 UTC 2021

I've just sent this update over the Outages ML:

>Dear Customer,
>
>We regret to inform you that your services were affected by an incident occurred at 16:00 UTC during a routine update of a routing policy for aggregated prefixes in Telia Carrier IP Core network. This caused traffic to prefixes contained within the aggregates >to be blackholed, resulting in a impact on some parts of the network.
>
>When the underlying problem source was traced, the configuration was rolled back to the earlier working version of the routing policy (17:05 UTC). Affected services started to recover gradually after this operation was applied. No further disturbances >related to this incident are expected.
>
>Due to the wide impact on several customer services, a number of complaints was received by our Customer Support Centre, resulting in delays in the communication with customers via email and/or phone. We apologize for any inconvenience this incident >has caused to your services.

On Thu, Oct 7, 2021 at 3:48 PM Max Tulyev <maxtul at netassist.ua> wrote:
>
> Really it depends on the problem source. BGP do not know either route
> really reachable or not. This time we was just lucky.
>
> 07.10.21 22:36, Ca By пише:
> >
> >
> > On Thu, Oct 7, 2021 at 11:47 AM Max Tulyev <maxtul at netassist.ua
> > <mailto:maxtul at netassist.ua>> wrote:
> >
> >     We have 2 ports from Telia, one in Kiev (Ukraine) and one in New York
> >     (USA). I have seen both ports simultaneously dropped traffic volume for
> >     about one hour today.
> >
> >     It was not critical (for us), as traffic was shifted to another links,
> >     and there was no unreachable destinations like BGP announces with
> >     traffic blackholed. But looks strange.
> >
> >
> > Thats why it is called the bridging gap protocol
> >
> > While Telia barfed, it bridged the gap.
> >
> > See, bgp is not all bad. There are no bad routes, only bad days
> >
> >
> >
> >     07.10.21 21:23, Vincentz Petzholtz пише:
> >      > Hi everyone,
> >      >
> >      > Looks like the season for outages is on. Does anyone has more
> >     details regarding the issues at Telia? I didn't found any public
> >     available information. They say it's over but this is clearly not
> >     the case.
> >      >
> >      > Best regards,
> >      > Vincentz
> >      >
> >