Monitor your Site

Objective

This document provides instructions on how to monitor your sites in F5® Distributed Cloud Console. To learn more about site and how Console provides monitoring support, see Site and Monitoring.

Using the instructions provided in this document, you can check the health, connectivity status, and metrics of your site.


Prerequisites

Note: If you do not have an account, see Create an Account.

  • One or more cloud or edge locations with a Site.

Note: Install the Distributed Cloud node or cluster image in your cloud or edge location. See Create a Site for more information.


Activities of Monitoring

The following video provides a brief tutorial on how to monitor your site:

Perform the activities presented in the following chapters to monitor your site.


Observe Sites in Aggregate

In the Multi-Cloud Network Connect service, Select Overview > Sites to see all your sites from different viewpoints. This page contains four tabs:

  • Dashboard - a quick view of site health, alerts, and statistics, as well as a list of all your sites.
  • Site Map - a map showing the location and health of all your sites.
  • RE (Pop) Connectivity - A graph showing your sites, cloud providers, regional edges (REs), and connections.
  • Fleets - a list of all your fleets, and indirectly which sites are part of which fleets.

Sites Dashboard

The Sites dashboard provides an overview of the health, characteristics, and status of all your sites in aggregate.

sites dashboard
Figure: Sites Map
Sites Dashboard Details

Dashboard Time Frame

The dashboard contents are dependent on the settings in the right-justified, top bar of options.

  • The time drop-down allows you to specify the time frame for the data shown, including both quick-pick options like Last 24 hours and the ability to specify a custom time frame. Custom time frames are limited to 24 hours within the last 30 days.
  • Click the Refresh button next to the time drop-downs to update the contents of the dashboard manually.

Health and Alerts

Each health or alerts section shows a donut chart for a specific metric. The number at the center of the donut indicates the total count for the time frame. The donut chart will show different colors representing subcategories of the metric, which correspond to the colored check boxes below the donut. Click a checkbox to add or remove that subcategory from the donut. You can hover over a donut to see the actual quantities of the subcategories.

  • Site Health shows how many sites are in which health state.

  • Infrastructure Alerts shows how many and the which kind of alerts you've had during the selected time frame. Click Infrastructure Alerts to see the alerts you've received.

Top Providers/Regions

  • Top Providers ranks your cloud and edge providers by number of sites in each.
  • Top Regions ranks your regions based on the number of sites deployed to that region.

Note: Region information is automatically sources from cloud providers. For non-cloud sites, you can assign a region y applying the ves.io/region label to the site.

Sites

The Sites section shows an overview of all of your sites. Entries under the Name column with a circle next to them are the sites deployed by a provider, and those with a square next to them are regional edges. The color of each site circle represents the health of the site: Green - healthy, Yellow - degraded health, Red - seriously degraded health.

  • Use the Search and Add Filter fields above the list to now the list of sites shown.
  • Click the gear icon ( âš™ ) see different column data in the table.
  • Use the items per page selector below the list to set the maximum number of sites listed on a page, and use the page selector to see other pages.
  • Click on a site name in the list to get an in-depth view of the site - see Explore a Site

Site Map

The Site Map tab shows all your sites displayed on a world map, including some status information.

sites map
Figure: Sites Map
Site Map Details

The map shows your sites and regional endpoints as symbols on the map giving both location information and health status.

Map SymbolRepresents
Registration
Healthy Site
Warning Site
Alert Site
Regional Edge
An encircled number icon indicates quantity of sites and/or edges represented by the circle, and the circle colors indicate the statuses shown above in this table. This example represents two regional edges, one healthy site, and one warning site.

Interact with the map:

  • Use the Show Legends Filters dropdown menu to filter the symbols shown.
  • Use the Search Site on map dropdown to find a specific site or regional edge. For sites, you will also see the site details panel (Shown below).
  • Hover the cursor over a symbol to see details for that site or group of sites.
  • Click on a numbered circle to zoom in and see the associated sites and/or regional edges.
  • Click on a site to see the site details panel (Shown below).
  • Click Edit Site to make changes to the site configuration.

Site details panel:

site map detail
Figure: Site Detail Panel

The Detail tab provides some details about the site, and the Health tab provides an overview of the site's health. Click the site name in the side panel for an in-depth look at the site. See Explore Site.

RE (PoP) Connectivity

The PoP (RE) Connectivity tab shows all your sites, REs, and cloud providers in a graph showing how they are connected to each other.

sites connectivity
Figure: Site Connectivity Status
RE (PoP) Connectivity Details
  • Hover over a thick link to see the number of connections it represents.
  • Hover over a link to see details about the connection.
  • Hover over a site to see details about the site.
  • Hover over a cloud provider to see how many sites are provisioned by that provider.
  • Click on a cloud provider to zoom into the connections for that provider. Click the Back or All Sites button in the upper left corner of the graph to return to the previous view.
  • Click on a link or site and check the right pane for additional metrics and statistics. For example, the image below shows the site details for a selected node.
site connectivity detail
Figure: Site Details

Fleets

The Fleets tab shows a list of your fleets along with some metrics for the sites included in that fleet.

sites fleet
Figure: Fleets in Sites Overview
Fleets Details
  • Each fleet in the list has it's own section showing the number of sites in the fleet, some health statistics, and a chart showing the memory and CPU usage for each site in the fleet (Each dot represents a site).
  • Hover over a site the graph to see site name, node name, and actual memory and CPU usage values.
  • Click on the fleet name to see a site map of the sites in the fleet (the default) or a list of sites in the fleet (in the Site List tab).

Find a Site

There are a number of ways to find a site. To start, select the Multi-Cloud Network Connect service and navigate to Overview > Sites. To find a specific site, use one of the following methods:

sites dashboard
Figure: Sites Map
Site List
  • From the Overview > Sites page, go to the Dashboard tab.
  • Scroll down to the Sites section which provides a list of your sites.
  • Use the Search and Add Filter capabilities at the top of the list to narrow the list.
  • Click the name of the site you wish to explore.
Site Map
site map detail
Figure: Site Detail Panel
  • From the Overview > Sites page, go to the Site Map tab.
  • Find your site on the map. The following options will help you find your site:
    • Use the search drop-down menu to select your site.
    • Use the Show Legend Filters menu to narrow the search by site type.
    • Pan and zoom on the map to see more detail in an area.
    • Click on a multi-site icon to see the sites in that area.
  • Click on the site icon on the map to see the site details panel.
  • Click on the name of the site in the panel.

Note: You can also edit the site from the site details panel.

Site in a Fleet
  • From the Overview > Sites page, go to the Fleets tab.
  • Find the fleet containing your site and click the fleet name.
  • Use either the Site Map or Site List tabs to find and click on your site, as described above.

Explore a Site

To explore a site, first use one of the methods in Find Site above to open the site page for your site.

site dashboard
Figure: Site Dashboard

The Site page provides detailed information about a single site. The Site: drop-down menu at the top of the page show you the current site being displayed, and it allows you to switch sites.

There are a number of tabs at the top of the page allowing you to see information by topic. Each tab is shown below. Note: Some tabs are only available for a site with certain characteristics.

Most pages also use the time and refresh options near the top-right of the page.

  • The time drop-down allows you to specify the time frame for any time-frame-dependent data shown, including both quick-pick options like Last 24 hours and the ability to specify a custom time frame. Custom time frames are limited to 24 hours within the last 30 days. The selected time frame remains consistent across all tabs on the page, although some tabs and some data shown on the tab is current data and not time frame dependent.

  • Click the Refresh button next to the time drop-downs to update the contents of the dashboard manually.

Dashboard

The Site dashboard provides summary information about a single site across a broad number of categories. The Site: drop-down menu at the top of the page show you the current site being displayed, and it allows you to switch sites.

Dashboard Details
  • Click Manage Configuration to view and/or edit this site's configuration on the fly.

  • Click Tech Docs to open this document in a new tab explaining how to monitor a site.

  • Click Site Topology to see this site's connectivity on the Overview > Sites page, RE (PoP) Connectivity tab. For more information, see RE (PoP) Connectivity.

  • Click Traffic Flow to see flows for this site on the Overview > Performance page, Flow Analysis tab. You can visualize traffic between this site and any other entities of interest. For more information, see Monitor Performance.

Health and Status Sections

  • Site Health displays a numeric value indicating overall system health for the selected time frame.

  • Alerts provides a snapshot of the current active alerts on your site, segmented by alert categories Critical, Major, and Minor. Hover over the bar to see the number of alerts in each category. Click on the Alerts title to see detailed information in the Alerts tab. The alerts shown are current and not affected by the selected time frame.

  • Site Status shows the current state of the Data Plane, Control Plane (Up or Down) and Local Control Plane (Enabled or Not Reported). Note that Local Control Plane will only show an Enabled status when Site Offline Survivability is configured or the site is an App Stack site. Otherwise, the status field will display Not Reported. Also, all statuses shown are current and not affected by the selected time frame.

  • Site Details shows basic information about the site you are observing. These details shown are current and not affected by the selected time frame.

    • Site - Shows what type of site was created: AWS VPC Site, Azure VNET, etc.
    • Site Type - Shows the site configuration: App Stack or Mesh.
    • Provider - The cloud infrastructure in which the site is deployed (VMWARE, AWS, GCP, etc.). This is only applicable to cloud sites.
    • Region - Specifies the cloud provider's region. This is only applicable to cloud sites.
    • Gateway Type - Ingress (single NIC) or Ingress and Egress (dual NIC).
  • F5 Software provides a snapshot of the current software configuration of the site. You can perform upgrades using the Upgrade button if an upgrade is available. You can see complete information about the software in JSON format by clicking See All in the lower right corner. The details shown are current and not affected by the selected time frame.

  • Nodes shows how many nodes are control nodes versus worker nodes, and how many of them are up. Click on the Nodes title to see detailed information in the Infrastructure tab. The node details shown are current and not affected by the selected time frame.

  • Operating System provides a snapshot of the Operating System information. You can perform upgrades using the Upgrade button if an upgrade is available. You can see complete information about the operating system in JSON format by clicking See All in the lower right corner. The details shown are current and not affected by the selected time frame.

Connection Throughput Chart

The Connection Throughput chart shows the the incoming and outgoing throughput from this site to a particular connection, where that connection can be the regional edges (REs) as well as other customer edges (CEs) if directly connected via site mesh group or DC cluster group.

re connection throughput
Figure: RE Connection Throughput
  • Select a CE or RE in the upper right corner to see how much traffic is going in to and out of the CE/RE over time.

    re connection throughput selector
    Figure: RE Connection Throughput Selector

  • Toggle the In and Out checkboxes to view or hide the data line for that category. This can be useful if one category has significantly more traffic than the other causing the lower traffic line to look flat at zero throughput.

Connectivity Table

The Connectivity table shows the connectivity to this site.

site connectivity table
Figure: Site Connectivity Table
  • Use the edge-type selector to change what you want to see:

    • RE to see regional edge connections.
    • CE to see customer edge connections.
    • Private to see CloudLink connections.
  • Click on the name of an RE to see detailed information for that site in JSON format.

  • Click on a link for a CE to see connectivity metrics for that link.

  • Enter a search string in the Search field to see only line items containing that string.

  • Click the gear icon ( âš™ ) see different column data in the table.

Metrics

The Metrics tab allows you to examine the trends of different aspects of your site. Use the selector below the Metrics tab choose what you want to examine.

Note: For any of the graphs, use the time dropdown to the right of the graph selector for specifying a time interval for the graph. The default for this is 1 hour and maximum allowed interval is 24 hours. You can customize the interval by selecting the Custom option and choosing date range. This can also be set graphically by adjusting the controls (gray bars) beneath the main graph.

Note: Graphs showing Nodes, Interfaces, or Pods allow you to compare up to 5 items.

site metrics system
Figure: Site System Metrics
System

The system metrics presents an overall view for your site system so that you examine trends for throughput, drop rates, deployment and pod count, reachability and connection statuses. The metrics are displayed in graphs representing the trend over a period of time (default 1 hour).

Note: The Data Plane Reachability information is displayed by default.

  • The panel to the right of the graph shows the various metrics that can be graphed. Each metric is part of a category, e.g. In Throughput is part of the Throughput category. You may select any metric to graph, and then for comparison you may select a second trend from that category by clicking a different color (blue vs magenta). This will graph the two metrics on a common timeline.

  • Click on In Throughput or Out Throughput fields on the right side under the Throughput section to display the throughput trend.

  • Click on In Drop Rate or Out Drop Rate fields on the right side under the Packets per second section to display the packet drop rate trend.

  • Click on Deployment Count or Pod Count fields on the right side under the Count section to display the deployment and pod count trend.

  • Click on Data Plane Reachability field on the right side under the Percent section to display the reachability trend.

  • Click on Connection Status, Control Plane Status, or Local Control Plane Status fields on the right side under the Status section to display the connection and control plane status trends.

Nodes
  • Use the Nodes drop-down menu to choose which node(s) to examine. The numbers in parentheses in the drop-down title indicate the number of nodes selected and the maximum number allowed to be selected (e.g. 2/5 means 2 nodes are shown and up to 5 can be shown at once.)
    site metrics nodes select
    Figure: Site Node Selection
site metrics nodes
Figure: Site Node Metrics
  • The panel to the right of the graph shows the various metrics that can be graphed. Click a metric to graph.

  • Click on Memory Usage, Disk Usage, GPU Usage, or CPU Usage to see a graph of the percentage of that metric used over time.

  • Click on GPU Temperature to see the trend of the GPU temperature (°C) over time.

  • Click on In Throughput or Out Throughput to see a graph of the traffic (in bits per second) of that metric over time.

  • Click on Status to see up/down status of the node(s). The graph is numeric, so 0 represents the site being down, 1 represents the site being up, and a value in between indicates the degree to which the site is degraded.

    • Hover in the graph to see the numeric value for the metric(s) at that time point.
Interfaces
  • Use the Interfaces drop-down menu to choose which interface(s) to examine. The numbers in parentheses in the drop-down menu indicate the number of interfaces selected and the maximum number allowed to be selected (e.g. 2/5 means 2 interfaces are shown and up to 5 can be shown at once.) Within the drop-down, the list of interfaces are grouped by their respective nodes. Click the box to select or unselect the interfaces you want to see on the graph.
    site metrics interfaces select
    Figure: Site Interface Metrics
site metrics interfaces
Figure: Site Interface Metrics
  • The panel to the right of the graph shows the various metrics that can be graphed. Click a metric to graph.

  • Click on In Throughput or Out Throughput to see a graph of the traffic (in bits per second) of that metric over time.

  • Click on In Drop Rate or Out Drop Rate to see a graph of the drop rate (in packets per second) of that metric over time.

  • Hover in the graph to see the numeric value for the metric(s) at that time point.

Pods

Note: Pods reference customer applications and are thus only available for App Stack sites.

  • Use the Pods drop-down menu to choose which Pod(s) to examine. The numbers in parentheses in the drop-down menu indicate the number of pods selected and the maximum number allowed to be selected (e.g. 2/5 means 2 interfaces are shown and up to 5 can be shown at once.) Within the drop-down, the list of pods are grouped by their respective kubernetes namespaces. Click the box to select or unselect the pods you want to see on the graph.
    site metrics pods select
    Figure: Site Pods Metrics
site metrics pods
Figure: Site Pods Metrics
  • The panel to the right of the graph shows the various metrics that can be graphed. Click a metric to graph.

  • Click on CPU Usage to see a graph of the traffic (in bits per second) of that metric over time.

  • Click on Memory Usage or Disk Usage to see the amount of memory or disk space used over time.

  • Click on In Drop Rate or Out Drop Rate to see a graph of the drop rate (in packets per second) of that metric over time.

  • Hover in the graph to see the numeric value for the metric(s) at that time point.

Infrastructure

The Infrastructure tab provides an overview of your nodes and interfaces and your DHCP configuration. Use the selector below the Infrastructure tab to choose what you want to examine.

site infra nodes
Figure: Site Infrastructure Nodes and Interfaces
Nodes and Interfaces

This page shows three sections of information: Nodes, Interfaces, and Scaling Status.

Nodes

  • The Nodes section shows a list of your current nodes (not time frame dependent) with certain details shown for each node. Some key information shown is

    • Node status (green/up vs. red/down indicators),
    • Control vs Worker Nodes,
    • Infrastructure Provider,
    • Availability Zone, and
    • VPC details in which the node resides.
  • You can change the key details you see in the table by clicking on the gear icon ( âš™ ) and selecting different fields.

  • Click on a node name in the table to see in-depth node information.

Nodes details
site infra nodes status
Figure: Site Infrastructure Nodes and Interfaces
Node Status
  • The Software Version section provides information about the software running on the node. Click Upgrade for either the F5 software or the operating system to upgrade the node to the latest version. Click Software Version to all the version information in JSON format.

  • The Node Status section shows details on the current state of the node. Click Nodes Status to see all of the details in JSON format.

  • The GPU Status section shows details on the current state of the GPU.

  • The Interfaces section shows a list of the interfaces on this node with key details shown for each interface. You can change the key details you see in the table by clicking on the gear icon ( âš™ ) and selecting different fields. Click on an interface name in the table to go to the Metrics tab for that interface.

Hardware Information
site infra nodes hardware
Figure: Site Infrastructure Nodes and Interfaces

The Hardware Information tab shows a number of sections providing hardware details for the node.

Interfaces

  • The Interfaces section shows a list of interfaces for a selected node (not time frame dependent).

  • Use the node drop-down menu to select the node to view.

    site infra nodes select
    Figure: Site Infrastructure Nodes and Interfaces
  • All interfaces for the selected node are shown in the table. Some key information shown in the columns is

    • Interfaces status (green/up vs. red/down indicators),
    • IPv4 and/or IPv6 address,
    • and the public address.
  • You can change the key details you see in the table by clicking on the gear icon ( âš™ ) and selecting different fields.

  • Select a node in the node name drop-down list at the top of the table to see interfaces for that node in the table.

  • Click on an interface name in the table to go to the Metrics tab for that interface.

Scaling Status

The Scaling Status section shows how well the node is scaling for the time frame selected at the top of the sections.

DHCP
site infra dhcp
Figure: Site Infrastructure DHCP

This page shows this site's list of DHCP subnets and DHCP hosts. This section is not applicable to cloud sites (AWS, Azure, GCP, etc.)

  • The DHCP Subnets section shows a list of your subnets with key details shown for each. You can change the key details you see in the table by clicking on the gear icon ( âš™ ) and selecting different fields.

  • The DHCP section shows a list of your DHCP hosts with key details shown for each. You can change the key details you see in the table by clicking on the gear icon ( âš™ ) and selecting different fields.

Cloud Connect

Note: The Cloud Connect tab will only appear if your selected site is an AWS TGW site. You can learn more about Cloud Connects in the Connectors document.

The Cloud Connect tab displays a list of your Cloud Connects in a table that includes key details for each.

site cloud connect
Figure: Monitor Cloud Connect
Cloud Connect Details
  • Click the gear icon ( âš™ ) see different column data in the table.
  • Click the arrow icon ( > ) to expand the line to show all the data for that line item in JSON format.
  • Click the ... > Show Status in the action menu to see a list of status objects. Then click the UID in the status objects table to see detailed information.

TGW

Note: The TGW tab will only appear if your selected site is an AWS TGW site. To create a TGW Site, see Create AWS Site with TGW.

site tgw
Figure: Monitor TGW Site

The TGW tab displays three lists: VPC Attached, Tunnels, and BGP Connections. Each list provides a name for the line item and key details.

TGW Details
  • Click the gear icon ( âš™ ) see different column data in the table.
  • Click the arrow icon ( > ) to expand the line to show all the data for that line item in JSON format.

Hub VNET

Note: The Hub VNET tab will only appear if your selected site is an Azure site. To create a Hub VNET Site, see Create Azure Site.

The Hub VNET tab displays information about the hub VNET, such as Name, CIDR, and internal load balancer. Below the general information is a list of attached VNETs.

Tools

The Tools tab provides a set of tools for more site exploration and device interaction.

site tools
Figure: Site Tool Selection
  • Select a tool from the drop-down list.
  • In some cases you may need to enter required or optional fields.
  • Press the blue button at the bottom to run the tool.

Below are some examples.

Ping
  • Select Ping from the tools drop-down list.
  • Fill in the required field, Destination.
  • Enter values for any desired optional fields.
  • Press the blue button, Call ping, to run the tool.
  • The results will show at the bottom of the page.
site tools ping
Figure: Use ping tool
Traceroute
  • Select Traceroute from the tools drop-down list.
  • Fill in the two required fields, Node name and Destination.
  • Enter values for any desired optional fields.
  • Press the blue button, Call traceroute, to run the tool.
  • The results will show at the bottom of the page.
site tools traceroute
Figure: Use ping tool
Flow Table
site tools flow table
Figure: Flow Table Tool
  • Select Flow table from the tools drop-down list to get more information on how data is flowing through your site. Each row of the table provides information such as source and destination IPs, ports, TCP flags, packet counts, and more.

  • Use the Select Node drop-down list to choose which node to see in the table.

  • Use the time frame drop-down menu to select the time frame covered for the data in the table. Use the Refresh button next to it to get the latest data.

  • Enter a search string in the Search field to see only line items containing that string.

  • Click the gear icon ( âš™ ) see different column data in the table.

  • Click the arrow ( > ) at the left of a row to see additional information for any flow between IP addresses in JSON or YAML format.

Alerts

site alerts
Figure: Site Alerts

The active alerts are displayed by default. Use the toggle selection to load all alerts. You can also set a time interval in the active alerts view to display alerts over a specific period of time. Click > for any alert entry to display details in JSON format.


Concepts


API References