L2VPN/L2transport, Cumulus Linux & hardware suggestion

Wed Jul 8 12:40:07 UTC 2020

I do run the 7280SR2-48YC6, but I don't do VPLS or pseudowires on them right now so I can't help directly with that.

Based on my experience with Arista so far, it'll be perfectly-well documented, just for a different platform, and in a blog post instead of in the user manual.  :-(

(Note to anyone from Arista lurking on the list: your User Manual sucks rocks because it's wildly incomplete.  Please put some of the effort that goes into those EOS Central blog posts, into the manual instead.)

As to the Juniper, I'm a client on a Juniper-based VPLS system, and the only thing it consistently intercepts is LLDP... which I'm actually OK with, mostly.  Other BPDUs and other Ethernet protocols get passed through (that we've tested, so far).  We have heard of some feature limitations on the EX4650, no CCC is unfortunate.  I don't have any experience with the QFX series as an operator or customer so can't comment.

Adam Thompson
Consultant, Infrastructure Services
[1593169877849]
100 - 135 Innovation Drive
Winnipeg, MB, R3T 6A8
(204) 977-6824 or 1-800-430-6404 (MB only)
athompson at merlin.mb.ca<mailto:athompson at merlin.mb.ca>
www.merlin.mb.ca<http://www.merlin.mb.ca/>

________________________________
From: NANOG <nanog-bounces+athompson=merlin.mb.ca at nanog.org> on behalf of Jürgen Jaritsch <juergen at jaritsch.at>
Sent: Tuesday, July 7, 2020 5:05:03 PM
To: nanog at nanog.org
Subject: AW: L2VPN/L2transport, Cumulus Linux & hardware suggestion

Dear Adam,

yeah, forget about LACP - the bigger problem is all the LLDP and STP stuff,
that gets interpreted at the UNI port. LACP is a bad example - but there are
many other frames and protocols, which must work. Could be that a customer
wants to run MPLS+LDP on his VLL (for whatever reason ...).

> For your requirements, although I hesitate to recommend them for
enterprise/carrier use, Miktotik's EoIP protocol does a much better job of
this than most "carrier-grade" implementations.

Not at wirespeed ... and not without causing other issues (single thread
load, etc).

> Juniper has the EX4650 that matches your h/w specs,...  Not 100% sure the
Juniper EX does 25G, now that I think of it.

Yeah, EX4650 it does: 48x 1/10/25G + 6x 100G + MPLS
It also supports Ethernet over MPLS (at least they say here:
https://www.juniper.net/documentation/en_US/junos/topics/topic-map/mpls-over
view.html#id-mpls-feature-support-on-qfx-series-and-ex4600-switches) but at
some of their sites they mention, that MPLS-based CCC are not support:
https://www.juniper.net/documentation/en_US/junos/topics/topic-map/mpls-over
view.html#jd0e2531

" ... MPLS-based circuit cross-connects (CCC) are not supported—only
circuit-based pseudowires are supported. ..."

There is also the QFX5120-48Y - 48x 1/10/25G + 8x 100G + MPLS
In the past QFX wasn't the best idea for MPLS topics ... has this changed?

> and Arista has, oh, at least half a dozen boxes of various spec that
comply, too.

Yeah, I already know them (do have some older 7050S). The call it "VXLAN P2P
Pseudowire", but there is absolutely nothing in there CLI documentation :(.
Looks like the feature is only support on the 7280 platform.

Possible options:
7280SR2-48YC6

Do you have any experience with what they call "VXLAN P2P Pseudowire"? I
can't even find a config example on the net :(

thanks & best regards
Jürgen

-----Ursprüngliche Nachricht-----
Von: Adam Thompson [mailto:athompson at merlin.mb.ca]
Gesendet: Dienstag, 7. Juli 2020 23:09
An: Jürgen Jaritsch <juergen at jaritsch.at>; nanog at nanog.org
Betreff: RE: L2VPN/L2transport, Cumulus Linux & hardware suggestion

Good luck with tunnelling LACP, no matter what boxes you have - LACP has (de
facto) hard jitter requirements of under 1msec, or you'll be getting TCP
resets coming out your ears due to mis-ordered packets.

For your requirements, although I hesitate to recommend them for
enterprise/carrier use, Miktotik's EoIP protocol does a much better job of
this than most "carrier-grade" implementations.

Otherwise, Juniper and Arista both come to mind, Juniper has the EX4650 that
matches your h/w specs, and Arista has, oh, at least half a dozen boxes of
various spec that comply, too.  Not 100% sure the Juniper EX does 25G, now
that I think of it.

Adam Thompson
Consultant, Infrastructure Services
MERLIN
100 - 135 Innovation Drive
Winnipeg, MB, R3T 6A8
(204) 977-6824 or 1-800-430-6404 (MB only) mailto:athompson at merlin.mb.ca
http://www.merlin.mb.ca

> -----Original Message-----
> From: NANOG <mailto:nanog-bounces+athompson=merlin.mb.ca at nanog.org> On
Behalf
> Of Jürgen Jaritsch
> Sent: Tuesday, July 7, 2020 3:15 PM
> To: mailto:nanog at nanog.org
> Subject: L2VPN/L2transport, Cumulus Linux & hardware suggestion
>
> Dear folks,
>
> have anyone already tried to run VXLAN/EVPN + “Bridge Layer 2 Protocol
> Tunneling” on Cumulus Linux as an replacement for classic MPLS
> L2VPN/VPWS (“xconnect”, l2circuit, VLL) ?
>
> I need to provide transparent Ethernet P2P virtual leased lines to my
> customers and these have to support stuff like LLDP, STP, LACP, etc.
> The transport L2 network is not THAT big: max hops between VTEP is 4.
>
> Anyone have suggestions for the below hardware request?
> #) 1-3U L2/L3 box
> #) 48x SFP28 / 1/10/25G
> #) 6x QSFP28 / 100G
> #) VXLAN/EVPN with L2 tunneling support or
> #) MPLS VPWS/l2circuit
> #) Dual PSU
>
>
> thanks & best regards
> Jürgen
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nanog.org/pipermail/nanog/attachments/20200708/0bb21613/attachment.html>