Linux router network cards

Fri Oct 23 10:55:45 UTC 2020

Hi Jared,

This project looks very interesting. 

Can you share with us which software or package do you use in DANOS for routing? Is it a kind of command wrapper on top of FRR?

Also, it seems stable, but I am sure you already faced some minor or weird bugs. How is the support handle with DANOS? Is it community driven?

Thanks for sharing

Jean

From: NANOG <nanog-bounces+jean=ddostest.me at nanog.org> On Behalf Of Jared Geiger
Sent: Friday, October 23, 2020 12:30 AM
To: NANOG <nanog at nanog.org>
Subject: Re: Linux router network cards

I use DANOS with Intel XL710 10G NICs in DPDK mode for linux based routing.

If you're doing routing protocols, allocate 2 CPU cores to the control plane and then a CPU core per 10G/1G interface for the dataplane, plus an extra core for good measure. So for a 4 x 10G router taking in full routes, 2 cores for control plane, 5 cores for the dataplane. Those cores should be Intel Xeon E5-2600v3/4 or newer and faster the clocks, the better.

Similar CPU core allocations if you choose TNSR.

On Thu, Oct 22, 2020 at 3:21 PM Jean St-Laurent via NANOG <nanog at nanog.org <mailto:nanog at nanog.org> > wrote:

Chelsio cards are probably what you are looking for.

https://www.chelsio.com/terminator-6-asic/

It's closer to an asic than a traditional nic as the router/firewall rules
are pushed directly into the hardware.

I don't know how good they are with linux and they seem to be compatible.
https://www.chelsio.com/linux/

You will need to mess around a bit and fiddle here and there. If you don't
mind using FreeBSD instead of linux, you could achieve a smoother and more
integrated experience.

Jean

-----Original Message-----
From: NANOG <nanog-bounces+jean=ddostest.me at nanog.org <mailto:ddostest.me at nanog.org> > On Behalf Of micah
anderson
Sent: Thursday, October 22, 2020 5:31 PM
To: Philip Loenneker <Philip.Loenneker at tasmanet.com.au <mailto:Philip.Loenneker at tasmanet.com.au> >; NANOG
<nanog at nanog.org <mailto:nanog at nanog.org> >
Subject: RE: Linux router network cards

Thanks for the reply.

Philip Loenneker <Philip.Loenneker at tasmanet.com.au <mailto:Philip.Loenneker at tasmanet.com.au> > writes:
> Take a look at the Mellanox ConnectX 5 series of cards. They handle 
> DPDK, PVRDMA (basically SR-IOV that allows live migration between 
> hosts), and can even process packets within the NIC for some

>From what I can tell, SR-IOV/PVRDMA aren't really useful for me in building
a router that wont be doing any virtualization.

If the card can do DPDK, can it do XDP?

> The slidedeck for the presentation is here:
> https://www.ausnog.net/sites/default/files/ausnog-2019/presentations/1
> .9_Rhod_Brown_AusNOG2019.pdf
>
> It's heavily targeting virtualised workloads but some of the feature sets
apply to bare-metal uses too.

Yeah, this wont be a virtualized environment, just a router passing packets,
dropping them, handling bgp and collecting flows.

-- 
        micah

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nanog.org/pipermail/nanog/attachments/20201023/b6f58afd/attachment.html>