30% packet loss between cox.net and hetzner.de, possibly at tinet.net

Constantine A. Murenin mureninc at gmail.com
Sat Apr 6 04:27:24 UTC 2013


On 2013-W14-6 05:04 +0300, Denys Fedoryshchenko wrote:
> On 2013-04-06 04:32, Constantine A. Murenin wrote:
> >Hello,
> >
> >There has been at least a 25% packet loss between hetzner.de and
> >cox.net
> >in the last couple of hours.
> >
> >Tried contacting hetzner.de, but they said it's not on their network.
> >This has already happened a couple of days ago, too (strangely, on
> >April 1),
> >but then was good for the rest of the week -- no problems whatsoever.
> >
> >I wouldn't really care about this, if not for ssh:
> >it just doesn't work on such huge loss.
> >
> >No other routes or networks seem affected.
> >
> >Any advice?
> >
> Doesnt looks like tinet for me.

Might have been eurorings.net, as your Amazon EC2 to Hetzner 
traceroute seemed to suggest?


This loss was apparent even with their own main websites:


cox.net from a hetzner.de node:

# mtr --report{,-wide,-cycles=60} --order "SRL BGAWV" cox.net ; date
...
  3.|-- hos-bb2.juniper4.rz2.hetzner.de              60    60  0.0%    2.7   3.5   5.8  62.5  10.1
  4.|-- r1nue1.core.init7.net                        60    60  0.0%    2.8   4.2   5.2  13.5   3.8
  5.|-- r1nue2.core.init7.net                        60    60  0.0%    2.9   4.7   6.0  28.7   5.0
  6.|-- r1fra2.core.init7.net                        60    60  0.0%    5.7   7.4   8.1  15.9   3.6
  7.|-- r1fra1.core.init7.net                        60    60  0.0%    5.9   7.6   8.1  16.8   3.2
  8.|-- xe-4-2-2.fra23.ip4.tinet.net                 60    60  0.0%    5.9   6.4   7.1  36.2   5.6
  9.|-- xe-9-0-0.was14.ip4.tinet.net                 60    43 28.3%  142.3 145.0 145.2 190.0   9.6
 10.|-- cox-communications-gw.ip4.tinet.net          60    48 20.0%  124.8 129.6 130.2 176.6  13.2
 11.|-- dukedsrj02-ge210.0.rd.at.cox.net             60    45 25.0%  137.7 141.2 141.6 194.7  11.6
 12.|-- 68.1.15.238                                  60    49 18.3%  138.1 138.7 138.7 140.0   0.4
 13.|-- 68.99.123.4                                  60    36 40.0%  140.4 140.9 140.9 141.6   0.3
 14.|-- ww2.cox.com                                  60    44 26.7%  140.6 140.9 140.9 141.8   0.3
Fri Apr  5 18:19:21 PDT 2013


hetzner.de from a cox.net node:

...
  5.|-- COX-68-12-8-132-static.coxinet.net     60    60  0.0%   11.6  15.3  15.8  35.1   4.9
  6.|-- 68.1.5.161                             60    60  0.0%   55.7  59.8  60.0  95.8   5.3
  7.|-- nyk-s2-rou-1001.US.eurorings.net       60    60  0.0%   55.8  63.8  64.9 139.4  14.7
  8.|-- nntr-s1-rou-1101.FR.eurorings.net      60    60  0.0%  149.8 154.1 154.1 171.9   4.3
  9.|-- kehl-s2-rou-1103.DE.eurorings.net      60    60  0.0%  147.2 152.8 153.1 206.1   8.7
 10.|-- ffm-s1-rou-1102.DE.eurorings.net       60    60  0.0%  143.3 147.7 147.7 177.2   5.0
 11.|-- nbg-s1-rou-1001.DE.eurorings.net       60    60  0.0%  147.3 153.8 154.0 211.1  10.0
 12.|-- kpn-gw.hetzner.de                      60    44 26.7%  173.3 177.6 177.6 184.5   2.7
 13.|-- hos-bb2.juniper3.rz2.hetzner.de        60    42 30.0%  170.3 175.1 175.2 203.1   5.6
 14.|-- hos-tr4.ms-ex3k2.rz1.hetzner.de        60    44 26.7%  171.9 175.9 175.9 185.4   2.8
 15.|-- www.hetzner.de                         60    42 30.0%  170.4 175.1 175.2 187.0   4.1
Fri  5 Apr 2013 17:38:11 PDT

...
  5.|-- COX-68-12-8-132-static.coxinet.net     60    60  0.0%   11.3  14.2  14.5  33.6   3.3
  6.|-- 68.1.5.161                             60    60  0.0%   56.2  61.1  61.8 135.6  11.6
  7.|-- nyk-s2-rou-1001.US.eurorings.net       60    60  0.0%   56.0  60.6  61.0 121.1   8.7
  8.|-- nntr-s1-rou-1101.FR.eurorings.net      60    58  3.3%  150.1 153.5 153.5 166.3   2.8
  9.|-- kehl-s2-rou-1103.DE.eurorings.net      60    29 51.7%  147.5 152.0 152.1 170.8   5.3
 10.|-- ffm-s1-rou-1102.DE.eurorings.net       60    28 53.3%  143.7 148.4 148.6 186.7   8.0
 11.|-- nbg-s1-rou-1001.DE.eurorings.net       60    60  0.0%  147.2 151.8 151.9 178.2   4.7
 12.|-- kpn-gw.hetzner.de                      60    45 25.0%  172.7 177.0 177.0 197.4   4.0
 13.|-- hos-bb2.juniper3.rz2.hetzner.de        60    41 31.7%  170.4 176.5 176.6 190.9   6.2
 14.|-- hos-tr4.ms-ex3k2.rz1.hetzner.de        60    50 16.7%  171.8 175.6 175.6 183.1   2.8
 15.|-- www.hetzner.de                         60    47 21.7%  170.5 174.2 174.3 188.8   3.2
Fri  5 Apr 2013 19:22:36 PDT



But it has since subsided:

...
  3.|-- hos-bb2.juniper4.rz2.hetzner.de              60    60  0.0%    2.7   2.9   3.4  41.4   5.0
  4.|-- r1nue1.core.init7.net                        60    60  0.0%    2.8   5.2   6.3  12.4   3.8
  5.|-- r1nue2.core.init7.net                        60    60  0.0%    2.9   4.0   4.7  14.0   3.2
  6.|-- r1fra2.core.init7.net                        60    60  0.0%    5.7   7.7   8.4  17.0   3.9
  7.|-- r1fra1.core.init7.net                        60    60  0.0%    5.9   8.7   9.3  17.1   3.7
  8.|-- xe-4-2-2.fra23.ip4.tinet.net                 60    60  0.0%    5.9   6.1   6.2  15.0   1.3
  9.|-- xe-9-0-0.was14.ip4.tinet.net                 60    60  0.0%   95.9  99.4  99.8 134.3   8.9
 10.|-- cox-communications-gw.ip4.tinet.net          60    60  0.0%  100.0 100.5 100.5 104.0   0.6
 11.|-- dukedsrj02-ge210.0.rd.at.cox.net             60    60  0.0%  113.2 116.7 117.1 163.6  10.9
 12.|-- 68.1.15.238                                  60    60  0.0%  113.4 113.8 113.8 116.0   0.4
 13.|-- 68.99.123.4                                  60    50 16.7%  115.6 115.9 115.9 116.6   0.2
 14.|-- ww2.cox.com                                  60    59  1.7%  115.7 116.1 116.1 117.2   0.3
Fri Apr  5 19:46:48 PDT 2013

...
  5.|-- COX-68-12-8-132-static.coxinet.net     60    60  0.0%   11.5  16.2  16.8  57.0   6.1
  6.|-- 68.1.5.161                             60    60  0.0%   56.3  61.5  61.8 105.1   6.5
  7.|-- nyk-s2-rou-1001.US.eurorings.net       60    60  0.0%   56.6  63.9  64.6 122.2  11.0
  8.|-- nntr-s1-rou-1101.FR.eurorings.net      60    60  0.0%  150.4 157.6 158.0 226.0  11.8
  9.|-- kehl-s2-rou-1103.DE.eurorings.net      60    60  0.0%  147.7 152.5 152.7 206.0   7.7
 10.|-- ffm-s1-rou-1102.DE.eurorings.net       60    60  0.0%  143.6 150.4 150.5 184.4   7.6
 11.|-- nbg-s1-rou-1001.DE.eurorings.net       60    60  0.0%  147.7 154.6 155.2 261.1  15.2
 12.|-- kpn-gw.hetzner.de                      60    60  0.0%  148.0 153.1 153.2 175.2   4.2
 13.|-- hos-bb2.juniper3.rz2.hetzner.de        60    60  0.0%  145.0 164.8 166.2 220.6  22.2
 14.|-- hos-tr4.ms-ex3k2.rz1.hetzner.de        60    59  1.7%  145.8 152.5 152.6 166.7   4.4
 15.|-- www.hetzner.de                         60    58  3.3%  144.5 149.7 149.7 161.3   3.9
Fri  5 Apr 2013 20:53:59 PDT


With the end-to-end working, too.


Cheers,
Constantine.




More information about the NANOG mailing list