scaling linux-based router hardware recommendations

Charles N Wyble charles at
Wed Jan 28 14:35:07 UTC 2015

There is no free lunch. If you want " tools that end users can just use" then buy Cisco. 

Otherwise you need to roll up your sleeves and take the pieces and put them together. Or hire people like me to do it for you. 

It isn't overly complicated in my opinion. Also you'll find plenty of reasonably priced Linux or BSD integration engineers out there across the globe who are used to doing this sort of thing. 

Now once you move beyond basic forwarding / high PPS processing (which seems mostly commodity now) and get into say 80gbps (40gbps full duplex) IPS , ip reputation, data loss prevention, SSL MITM, AV... well that requires some very beefy hardware. Can that be done on x86? I doubt it.

Tilera seems the way to go here. Newer FPGA boards can implement various CPU architectures on the fly. You also have CUDA. I hadn't seen chelsio, I'm very excited about that. Ill have one in my grubby little hands soon enough. 

transceivers are still horribly expensive. This is a major portion of the bom cost on any build, no matter what software stack is putting packets onto them. 

It isn't so simple once you move beyond the 1gbps range and want full feature set. And not in one box I think. Look at for interesting multi box scaling. 

On January 28, 2015 7:02:34 AM CST, "Paul S." <contact at> wrote:
>That's the problem though.
>Everyone has presentations for the most part, very few actual tools
>end users can just use exist.
>On 1/28/2015 午後 08:02, Robert Bays wrote:
>>> On Jan 27, 2015, at 8:31 AM, Jim Shankland <nanog at>
>>> My expertise, such as it ever was, is a bit stale at this point, and
>>> figures might be a little off. But I think the general principle
>>> applies: think about the minimum number of x86 instructions, and the
>>> minimum number of main memory accesses, to inspect a packet header,
>do a
>>> routing table lookup, and enqueue the packet on an outbound
>interface. I
>>> can't see that ever getting reduced to the point where a generic
>>> can handle 40-byte packets at line rate (for that matter, "line
>rate" is
>>> increasing a lot faster than "speed of generic server" these days).
>> Using DPDK it’s possible to do everything stated and achieve 10Gbps
>line rate at 64byte packets on multiple interfaces simultaneously.  Add
>ACLs to the test setup and you can reach significant portions of 10Gbps
>at 64byte packets and full line rate at 128bytes.
>> Check out Venky Venkatesan’s presentation at the last DPDK Summit for
>interesting information on pps/CPU cycles and some of the things that
>can be done to optimize forwarding in a generic processor environment.

Sent from my Android device with K-9 Mail. Please excuse my brevity.

More information about the NANOG mailing list