Customer Edge Site Sizing Reference
Objective
This reference documentation provides guidance around the minimum requirements for deploying a Customer Edge (CE) site and helping you get an informed estimate of the system requirements according to their features, scale, and performance needs.
Customer Edge Site Resource Requirements
A CE site is deployed as a cluster with three control nodes and optional worker nodes. The minimum resource requirements for each node are 4 vCPUs, 14 GB RAM, and 80 GB disk storage for Mesh nodes or 100 GB disk storage for App Stack nodes.
F5 recommends four sizes of nodes according to the CE performance requirements:
- Small: 4 vCPUs and 16 GB RAM
- Medium: 8 vCPUs and 32 GB RAM
- Large: 16 vCPUs and 64 GB RAM
- Extra Large: 24 vCPUs and 96 GB RAM
For deploying CE sites on providers, like VMware, KVM, F5 rSeries or a CE as a pod on Kubernetes, the instances/VMs can be created with the recommended CPU and memory listed above.
For public cloud providers, these instance flavors must be used:
| Provider | Small | Medium | Large | Extra Large |
|---|---|---|---|---|
| AWS | t3.xlarge | t3.2xlarge | m5.4xlarge | m5.8xlarge |
| Azure | Standard_DS3_v2 | Standard_DS4_V2 | Standard_DS5_v2 | Standard_D32s_v3 |
| GCP | n1-standard-4, t2d-standard-4, a2-highgpu-1g | n1-standard-8, t2d-standard-8, a2-highgpu-2g | n1-standard-16, t2d-standard-16, a2-highgpu-4g | n1-standard-32, t2d-standard-32, a2-highgpu-8g |
For Oracle cloud, the instance shape of VM.Standard3.Flex must be selected and the required CPU and memory must be set.
Baremetal Hardware Requirements
A CE site deployed on a baremetal server will use all of its available resources. Therefore, the server must have the minimum required CPU and memory resources as mentioned above. Additionally, it must also have the following:
- 1x 1000Mb/s Intel-based NIC
- 1 USB 2.0/3.0 for imaging the host
- 1 HDMI for accessing local console
The supported network interface controller (NIC) hardware for baremetal servers are:
- Intel XXV710 (10/25G)
- Intel X710 10G SFP
- Intel XL710 40G QSFP
- Intel X710-T4L Quad Port 10GbE BASE-T
- Intel X710-T2L Dual Port 10GbE BASE-T Adaptor
- Intel E810-XXV Quad Port 10/25GbE SFP28
- Intel i350 1G
Recommended CE Site Scale Limits
The data plane resource limits scales with the size of the CE. This also dictates the maximum data plane configuration objects a given size of a CE can support. Although there are no hard limits on these objects, below are the tested maximum numbers recommended for each size:
Configuration Limits
| Category | Resource | Small | Medium | Large | Extra Large | Notes |
|---|---|---|---|---|---|---|
| Networking | L3 routes | 1K | 16K | 128K | 512K | |
| Networking | Segments | 3 | 8 | 64 | 128 | |
| Networking | IPsec | 16 | 64 | 2K | 4K | Inclusive of Site Mesh Group, external connectors, and connections to REs. |
| Networking | Cloud Connect/number of VPCs | 8 | 16 | 32 | 64 | |
| Networking | Fast ACLs | 2K | 8K | 32K | 64K | |
| Networking | vCPU for load balancer process | 1 | 2 | 4 | 4 | Not user configurable. |
| Load Balancing | Load balancers | 64 | 256 | 512 | 1024 | |
| Load Balancing | Origin servers | 1K | 4K | 8K | 16K | |
| Load Balancing | Load balancer routes | 1K | 4K | 8K | 16K | Limit per load balancer is 256. |
| Load Balancing | Load balancer threads | 4 | 8 | 16 | 20 | Per CE node. Multiple threads can share a CPU. |
Runtime Limits
| Category | Resource | Small | Medium | Large | Extra Large | Notes |
|---|---|---|---|---|---|---|
| Networking | Flow entries | 64K | 128K | 512K | 512K | |
| Networking | CPUs for L3 processing in L3 performance mode | 2 | 4 | 8 | 16 | Per CE node. |
Note: The numbers above are for a CE Site. The limits remain the same regardless of the number of nodes in the Site.