Verizon FIOS IPv6?

Fri Jan 10 05:17:53 UTC 2014

On Jan 9, 2014, at 14:32, Stephen Frost <sfrost at snowman.net> wrote:

> Sure, entirely possible, but I'd be investigating into why because
> clearly there's a better ipv4 route than that being used, if ipv6
> tunneled over ipv4 is faster.  A bit of difference is fine, but it
> sounded like more than 'a bit'.

Of course it's a routing issue. At AdaCore (AS32019), we have very
good connectivity with level3 (<2ms), but the Verizon/Level3 path seems
variable and generally slow.

Here are the relevant bits.  Note that I've seen lots of different
routings for IPv4 traffic, routing over Cogent, Alter.net, Above.net,
but not so much when using the HE tunnel. Of course, I could
just ascribe this to NSA traffic redirection/inspection, or some
traffic engineering by a New Jersey governor, but I guess VZ
might have their own reasons for subpar routing. It always seems
as if VZ is avoiding L3.

The Hurricane Electric tunnel server I'm using is 209.51.161.14.

kwai:~%ping -i0.2 -c20  209.51.161.14
...
--- 209.51.161.14 ping statistics ---
20 packets transmitted, 20 received, 0% packet loss, time 3819ms
rtt min/avg/max/mdev = 1.604/1.763/2.497/0.205 ms

potomac:~%ping -i0.2 -c20 209.51.161.14
...
--- 209.51.161.14 ping statistics ---
20 packets transmitted, 20 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 6.832/8.040/9.152/0.720 ms

The sum of these times is just 10ms. 

Now, look at the resulting time for my IPv4 tunnel endpoint:
kwai:~%ping -i0.2 -c20 72.69.184.141
...
--- 72.69.184.141 ping statistics ---
20 packets transmitted, 20 received, 0% packet loss, time 3817ms
rtt min/avg/max/mdev = 22.843/25.422/27.725/1.538 ms

That's where the difference is.

With trace routes:
kwai:~%traceroute 209.51.161.14
traceroute to 209.51.161.14 (209.51.161.14), 30 hops max, 60 byte packets
 1  jordan.gnat.com (205.232.38.200)  5.402 ms  5.483 ms  5.535 ms
 2  towerstream-gw.gnat.com (69.38.252.177)  2.113 ms  2.119 ms  2.159 ms
 3  g4-0.cr.nyc1.ny.towerstream.com (69.38.244.13)  2.253 ms  2.260 ms  2.296 ms
 4  br.nyc0203.ny.towerstream.net (69.38.138.110)  3.181 ms  3.190 ms  3.209 ms
 5  64.125.173.225 (64.125.173.225)  3.299 ms  3.308 ms  3.394 ms
 6  xe-1-2-1.er2.lga5.us.above.net (64.125.31.166)  4.224 ms  2.113 ms  2.123 ms
 7  core1.nyc4.he.net (198.32.118.57)  3.733 ms  10.968 ms  10.960 ms
 8  tserv1.nyc4.he.net (209.51.161.14)  2.088 ms  1.694 ms  1.870 ms

kwai:~%traceroute 72.69.184.141
traceroute to 72.69.184.141 (72.69.184.141), 30 hops max, 60 byte packets
 1  jordan.gnat.com (205.232.38.200)  5.888 ms  6.295 ms  6.442 ms
 2  towerstream-gw.gnat.com (69.38.252.177)  2.062 ms  2.066 ms  2.108 ms
 3  g4-0.cr.nyc1.ny.towerstream.com (69.38.244.13)  2.201 ms  2.206 ms  2.319 ms
 4  xe-4-0-1.edge4.NewYork1.Level3.net (4.28.130.57)  3.124 ms  3.129 ms  3.156 ms
 5  vlan70.csw2.NewYork1.Level3.net (4.69.155.126)  3.248 ms vlan60.csw1.NewYork1.Level3.net (4.69.155.62)  3.299 ms vlan80.csw3.NewYork1.Level3.net (4.69.155.190)  3.304 ms
 6  ae-81-81.ebr1.NewYork1.Level3.net (4.69.134.73)  4.702 ms ae-62-62.ebr2.NewYork1.Level3.net (4.69.148.33)  2.372 ms ae-81-81.ebr1.NewYork1.Level3.net (4.69.134.73)  2.392 ms
 7  4.69.201.42 (4.69.201.42)  2.377 ms ae-45-45.ebr2.NewYork2.Level3.net (4.69.141.22)  2.366 ms ae-47-47.ebr2.NewYork2.Level3.net (4.69.201.34)  2.407 ms
 8  ae-1-51.edge2.NewYork2.Level3.net (4.69.138.195)  2.369 ms  2.518 ms  2.529 ms
 9  po6-20G.ar6.NYC1.gblx.net (208.51.134.113)  18.468 ms  18.474 ms  18.655 ms
10  0.ae11.BR3.NYC4.ALTER.NET (204.255.168.193)  20.372 ms  19.718 ms  17.999 ms
11  * * *
12  * * *
13  * * *
14  * * *
15  * * *
16  * * *
17  * * *
18  * * *C^Cpotomac:%traceroute 209.51.161.14
traceroute to 209.51.161.14 (209.51.161.14), 64 hops max, 52 byte packets
 1  wireless_broadband_router (192.168.1.1)  1.238 ms  0.852 ms  0.805 ms
 2  l100.nycmny-vfttp-102.verizon-gni.net (71.190.186.1)  5.275 ms  5.189 ms  5.732 ms
 3  g1-15-4-1.nycmny-lcr-22.verizon-gni.net (130.81.218.160)  9.572 ms  7.315 ms  8.120 ms
 4  so-3-1-0-0.ny5030-bb-rtr2.verizon-gni.net (130.81.199.12)  7.135 ms
    ae2-0.ny5030-bb-rtr1.verizon-gni.net (130.81.199.178)  7.228 ms
    so-5-0-0-0.ny5030-bb-rtr1.verizon-gni.net (130.81.22.18)  7.047 ms
 5  0.xe-10-0-0.br3.nyc4.alter.net (152.63.24.109)  7.925 ms
    0.xe-11-3-0.br2.nyc4.alter.net (152.63.23.137)  7.892 ms
    0.xe-10-0-0.br3.nyc4.alter.net (152.63.24.109)  7.114 ms
 6  204.255.168.190 (204.255.168.190)  7.497 ms  10.291 ms  8.601 ms
 7  hurricane-electric-llc-new-york.tengigabitethernet1-3.ar5.nyc1.gblx.net (64.209.92.98)  8.228 ms  7.101 ms  17.883 ms
 8  tserv1.nyc4.he.net (209.51.161.14)  8.962 ms  8.231 ms  6.681 ms
potomac:%traceroute kwai.gnat.com
traceroute to kwai.gnat.com (205.232.38.4), 64 hops max, 52 byte packets
 1  wireless_broadband_router (192.168.1.1)  4.037 ms  2.140 ms  2.572 ms
 2  l100.nycmny-vfttp-102.verizon-gni.net (71.190.186.1)  6.554 ms  7.270 ms  7.757 ms
 3  g0-14-3-3.nycmny-lcr-22.verizon-gni.net (130.81.104.44)  11.689 ms  9.961 ms  9.519 ms
 4  so-6-1-0-0.ny5030-bb-rtr2.verizon-gni.net (130.81.151.224)  6.582 ms
    ae0-0.ny5030-bb-rtr2.verizon-gni.net (130.81.209.126)  7.804 ms
    ae4-0.ny5030-bb-rtr1.verizon-gni.net (130.81.163.224)  7.244 ms
 5  0.xe-10-1-0.br1.nyc1.alter.net (152.63.18.225)  8.677 ms  8.347 ms  8.810 ms
 6  te-7-3-0.edge2.newyork2.level3.net (4.68.111.137)  27.316 ms
    ae11.edge2.newyork.level3.net (4.68.62.41)  29.472 ms  28.588 ms
 7  vlan51.ebr1.newyork2.level3.net (4.69.138.222)  25.019 ms
    vlan52.ebr2.newyork2.level3.net (4.69.138.254)  23.100 ms
    vlan51.ebr1.newyork2.level3.net (4.69.138.222)  23.718 ms
 8  ae-48-48.ebr2.newyork1.level3.net (4.69.201.49)  23.335 ms
    ae-46-46.ebr1.newyork1.level3.net (4.69.201.41)  24.846 ms
    4.69.201.37 (4.69.201.37)  25.430 ms
 9  ae-62-62.csw1.newyork1.level3.net (4.69.148.34)  24.207 ms
    ae-92-92.csw4.newyork1.level3.net (4.69.148.46)  24.709 ms
    ae-82-82.csw3.newyork1.level3.net (4.69.148.42)  27.682 ms
10  ae-2-70.edge4.newyork1.level3.net (4.69.155.84)  23.184 ms  22.921 ms
    ae-4-90.edge4.newyork1.level3.net (4.69.155.210)  25.784 ms
11  bandcon.edge4.newyork1.level3.net (4.28.130.58)  8.355 ms  8.672 ms  8.877 ms
12  e1-1.cr.nyc0007.c.ny.towerstream.net (69.38.231.173)  27.119 ms  25.984 ms  26.617 ms
13  jordan-towerstream.gnat.com (69.38.252.178)  28.139 ms  29.953 ms  29.601 ms
14  kwai.gnat.com (205.232.38.4)  28.848 ms  26.241 ms  28.212 ms