Anyone observing latency and dropped packets at peering points in Seattle?

Sat Apr 3 00:58:04 UTC 2010

I've been troubleshooting an issue all day. Traffic leaving our site, on
Verizon public transport, destined for the Spokane area is routing to Qwest
and hitting 400ms rapidly. The offending router seems to be a Verizon router
(number 6 here).

On top of that, we're seeing this via Level3 coming in from Spokane towards
Seattle (targeting our Verizon IPs).

 3. 116.atm2-0.xr2.sea4.alter.net
0.0%  8143    7.4   1.7   1.1 100.6  10.3
 4. 0.so-6-0-0.xt2.sea1.alter.net
0.0%  8143    2.6   4.2   2.1 148.5  14.8
 5. pos7-0.br1.sea1.alter.net
0.0%  8142    2.6   2.2   2.0  38.1   1.6
 6.
204.255.169.30
0.0%  8142  431.3 405.0 320.2 469.8  22.2
 7. sea-core-01.inet.qwest.net
0.0%  8142  430.5 407.3 324.0 541.3  24.2
 8. spk-core-01.inet.qwest.net
0.0%  8142  440.4 414.0 324.9 470.6  22.2
 9. spk-edge-04.inet.qwest.net
0.0%  8142  441.1 414.9 323.7 539.6  22.6

Testing on XO looks a lot different.

                66.236.9.5.ptr.us.xo.net -    1 | 1034 | 1031 |    1 |   47
|  112 |   53 |
|      p6-0-0d0.mar1.seattle-wa.us.xo.net -    1 | 1033 | 1030 |    1 |   48
|  170 |   50 |
|      p4-2-0d0.rar1.seattle-wa.us.xo.net -    1 | 1033 | 1031 |    1 |   47
|  168 |   51 |
|      te-3-1-0.rar3.seattle-wa.us.xo.net -    0 | 1033 | 1033 |    2 |   46
|  170 |   54 |
|             207.88.13.145.ptr.us.xo.net -    1 | 1033 | 1032 |    1 |   48
|  113 |   52 |
|            216.156.100.18.ptr.us.xo.net -    0 | 1033 | 1033 |    2 |   49
|  297 |   50 |
|          agg1-sea-p10.bb.spectrumnet.us -    0 | 1033 | 1033 |    2 |   47
|  239 |   52 |
|tierpoint-sea-1000m.demarc.spectrumnet.us -    1 | 1033 | 1032 |    9 |
54 |  249 |   56 |

Any assistance would be appreciated, confirmation would be excellent, this
is causing issues.

Thank you

E

ps - I will turn off my MTR shortly, I don't use it much anymore.