Akvorado Resource Requirements

Fri Mar 24 19:46:57 UTC 2023

Thanks, Vincent, I appreciate the feedback.

Regards,
Graham

-----Original Message-----
From: Vincent Bernat <bernat at luffy.cx> 
Sent: Friday, March 24, 2023 2:35 PM
To: Graham Johnston <graham.johnston at execulinktelecom.ca>; nanog at nanog.org
Subject: Re: Akvorado Resource Requirements

On 2023-03-24 15:01, Graham Johnston via NANOG wrote:
> For anyone running Akvorado, can you please comment on resource requirements. I'm most concerned with CPU and memory, with the assumption that resources are somewhat linear to flow rate, but also curious about disk usage secondarily.

A VM with 64 GB, 24 vCPU can sustain about 100k flows/s.

1 TB seems enough to keep data for about 5 years at 30k flows/s with the default setup. This is however highly dependent on how well your flows can be compressed. The main table with the default retention can use around 600 GB by itself. The data compresses well outside of the main table.

You should test on your setup and let it run for a few days. You can check how much space each table uses and extrapolate depending on the TTL set on each table.