Monitor your Site

Objective

This document provides instructions on how to monitor your sites in F5® Distributed Cloud Console. To learn more about site and how Console provides monitoring support, see Site and Monitoring.

Using the instructions provided in this document, you can check the health, connectivity status, and metrics of your site.


Prerequisites

Note: If you do not have an account, see Create an Account.

  • One or more cloud or edge locations with a Site.

Note: Install the Distributed Cloud node or cluster image in your cloud or edge location. See Create a Site for more information.


Activities of Monitoring

The following video provides a brief tutorial on how to monitor your site:

Perform the activities presented in the following chapters to monitor your site.


Observe Sites in Aggregate

In the Multi-Cloud Network Connect service, Select Overview > Sites to see all your sites from different viewpoints. This page contains four tabs:

  • Dashboard - a quick view of site health, alerts, and statistics, as well as a list of all your sites.
  • Site Map - a map showing the location and health of all your sites.
  • RE (Pop) Connectivity - A graph showing your sites, cloud providers, regional edges (REs), and connections.
  • Fleets - a list of all your fleets, and indirectly which sites are part of which fleets.
Sites Dashboard
sites dashboard
Figure: Sites Map

Dashboard Time Period

The dashboard contents are dependent on the settings in the right-justified, top bar of options.

  • The time drop-down allows you to specify the time period for the data shown, including both quick-pick options like Last 24 hours and the ability to specify a custom time period. Custom time periods are limited to 24 hours within the last 30 days.
  • Click the Refresh button next to the time drop-downs to update the contents of the dashboard manually.

Health and Alerts

Each health or alerts section shows a donut chart for a specific metric. The number at the center of the donut indicates the total count for the time period. The donut chart will show different colors representing subcategories of the metric, which correspond to the colored check boxes below the donut. Click a checkbox to add or remove that subcategory from the donut. You can hover over a donut to see the actual quantities of the subcategories.

  • Site Health shows how many sites are in which health state.

  • Infrastructure Alerts shows how many and the which kind of alerts you've had during the selected time period. Click Infrastructure Alerts to see the alerts you've received.

Top Providers/Regions

  • Top Providers ranks your cloud and edge providers by number of sites in each.
  • Top Regions ranks your regions based on the number of sites deployed to that region.

Note: Region information is automatically sources from cloud providers. For non-cloud sites, you can assign a region y applying the ves.io/region label to the site.

Sites

The Sites section shows an overview of all of your sites. Entries under the Name column with a circle next to them are the sites deployed by a provider, and those with a square next to them are regional edges. The color of each site circle represents the health of the site: Green - healthy, Yellow - degraded health, Red - seriously degraded health.

  • Use the Search and Add Filter fields above the list to now the list of sites shown.
  • Click the gear icon ( ⚙ ) see different column data in the table.
  • Use the items per page selector below the list to set the maximum number of sites listed on a page, and use the page selector to see other pages.
  • Click on a site name in the list to get an in-depth view of the site - see Explore a Site
Site Map

The Site Map tab shows all your sites displayed on a world map, including some status information.

sites map
Figure: Sites Map

The map shows your sites and regional endpoints as symbols on the map giving both location information and health status.

Map SymbolRepresents
Registration
Healthy Site
Warning Site
Alert Site
Regional Edge
An encircled number icon indicates quantity of sites and/or edges represented by the circle, and the circle colors indicate the statuses shown above in this table. This example represents two regional edges, one healthy site, and one warning site.

Interact with the map:

  • Use the Show Legends Filters dropdown menu to filter the symbols shown.
  • Use the Search Site on map dropdown to find a specific site or regional edge. For sites, you will also see the site details panel (Shown below).
  • Hover the cursor over a symbol to see details for that site or group of sites.
  • Click on a numbered circle to zoom in and see the associated sites and/or regional edges.
  • Click on a site to see the site details panel (Shown below).
  • Click Edit Site to make changes to the site configuration.

Site details panel:

site map detail
Fiture: Site Detail Panel

The Detail tab provides some details about the site, and the Health tab provides an overview of the site's health. Click the site name in the side panel for an in-depth look at the site. See Explore Site.

RE (PoP) Connectivity

The PoP (RE) Connectivity tab shows all your sites, REs, and cloud providers in a graph showing how they are connected to each other.

sites connectivity
Figure: Site Connectivity Status
  • Hover over a thick link to see the number of connections it represents.
  • Hover over a link to see details about the connection.
  • Hover over a site to see details about the site.
  • Hover over a cloud provider to see how many sites are provisioned by that provider.
  • Click on a cloud provider to zoom into the connections for that provider. Click the Back or All Sites button in the upper left corner of the graph to return to the previous view.
  • Click on a link or site and check the right pane for additional metrics and statistics. For example, the image below shows the site details for a selected node.
site connectivity detail
Figure: Site Details
Fleets

The Fleets tab shows a list of your fleets along with some metrics for the sites included in that fleet.

sites fleet
Figure: Fleets in Sites Overview
  • Each fleet in the list has it's own section showing the number of sites in the fleet, some health statistics, and a chart showing the memory and CPU usage for each site in the fleet (Each dot represents a site).
  • Hover over a site the graph to see site name, node name, and actual memory and CPU usage values.
  • Click on the fleet name to see a site map of the sites in the fleet (the default) or a list of sites in the fleet (in the Site List tab).

Find a Site

There are a number of ways to find a site. To start, select the Multi-Cloud Network Connect service and navigate to Overview > Sites. To find a specific site, use one of the following methods:

Site List
sites dashboard
Figure: Sites Map
  • From the Overview > Sites page, go to the Dashboard tab.
  • Scroll down to the Sites section which provides a list of your sites.
  • Use the Search and Add Filter capabilities at the top of the list to narrow the list.
  • Click the name of the site you wish to explore.
Site Map
site map detail
Fiture: Site Detail Panel
  • From the Overview > Sites page, go to the Site Map tab.
  • Find your site on the map. The following options will help you find your site:
    • Use the search drop-down menu to select your site.
    • Use the Show Legend Filters menu to narrow the search by site type.
    • Pan and zoom on the map to see more detail in an area.
    • Click on a multi-site icon to see the sites in that area.
  • Click on the site icon on the map to see the site details panel.
  • Click on the name of the site in the panel.

Note: You can also edit the site from the site details panel.

Site in a Fleet
  • From the Overview > Sites page, go to the Fleets tab.
  • Find the fleet containing your site and click the fleet name.
  • Use either the Site Map or Site List tabs to find and click on your site, as described above.

Explore a Site

To explore a site, fist use one of the methods in Find Site above to open the site page for your site.

Dashboard: Inspect site dashboard.
site dashbaord
Figure: Site Dashboard
  • Check System Metrics part of the dashboard to get a snapshot for the throughput, drop rate, reachability, and deployment information. Click on any of the field value to load the System Metrics tab for obtaining detailed information on that field.

  • Check Application Metrics to get a snapshot for the request rate, error rate, latency, and throughput.

  • Check Active Alerts to get a snapshot for the request rate, error rate, latency, and throughput. Click Active Alerts to load the Alerts tab for detailed information on the alerts.

  • Check Inside(LAN) Interfaces and Outside(WAN) Interfaces to monitor the interface status, throughput, and the data (both in and out).

  • Check Software Version to get a snapshot of the F5 Software and Operating System information. You can also perform upgrades using the Upgrade button if an upgrade is available.

  • Check Denied Rules Hit to monitor the request attempts which are configured to be rejected.

  • Check RE Connectivity to get a snapshot of the connectivity status to the REs.

  • Check Nodes: CPU, Memory and Disk Usage and Pods: CPU, Memory and Disk Usage to monitor the resource consumption information of nodes and pods respectively.

Note: Click Last 10 minutes dropdown on the upper right end of the dashboard and select a time interval to inspect your site dashboard for that interval. The default for this is 10 minutes. You can also refresh the status periodically by setting a refresh value using the Refresh every field. Alternatively, click Refresh next to the Last 10 minutes option to manually refresh the status.

System Metrics: Inspect Site System Metrics.

The system metrics presents an overall view for your site system so that you examine trends for throughput, drop rates, deployment and pod count, reachability and connection statuses. The metrics are displayed in graphs representing the trend over a period of time (default 1 hour).

sys metrics
Figure: Site System Metrics

Note: The Data Plane Reachability information is displayed by default.

  • Click on In Throughput or Out Throughput fields on the right side under the Throughput section to display the throughput trend. Each field has 2 graph bar fields to its left. Select an area of one field and the other area of the second field to display combined graph for in throughput and out throughput.

  • Click on In Drop Rate or Out Drop Rate fields on the right side under the Packets per second section to display the packet drop rate trend. Each field has 2 graph bar fields to its left. Select an area of one field and the other area of the second field to display combined graph for in and out drop rate.

  • Click on Deployment Count or Pod Count fields on the right side under the Count section to display the deployment and pod count trend. Each field has 2 graph bar fields to its left. Select an area of one field and the other area of one of the other fields to display combined graph for them.

  • Click on Data Plane Reachability field on the right side under the Percent section to display the reachability trend.

  • Click on Connection Status, Control Plane Status, or Local Control Plane Status fields on the right side under the Status section to display the connection and control plane status trends. Each field has 2 graph bar fields to its left. Select an area of one field and the other area of one of the other fields to display combined graph for them.

Note: Click time dropdown on the upper right end of the dashboard and select a time interval to inspect your site dashboard for that interval. The default for this is 1 hour and maximum allowed interval is 24 hours. You can customize the interval by selecting the Custom option and choosing date range. This can also be set graphically by adjusting the controls beneath the main graph.

Application Metrics: Inspect Site Application Metrics.

Click the Application Metrics tab to load the site application metrics view:

app metrics
Figure: Site Application Metrics

The application metrics present the trend of the following metrics in graph view over a default or configured time interval:

  • Rates: Request Rate, Error Rate, Connection Rate, Connection Error Rate, Error Rate 4xx, Error Rate 5xx, Error Rate Client, Error Rate Upstream.
  • Throughput: Upstream and downstream throughput
  • Latency: Client RTT, Server RTT, Latency, App Latency, Connection Duration

You can select any two metrics under a field such as Rate to display the combined graph for them.

You can change the time interval either using the drop-down option or using the controls beneath the graph.

Site Status: Inspect Site Status.

Click the Site Status tab to load the site status view:

site status
Figure: Site Status

The Site Status tab shows the following fields:

  • F5 Software Status
  • F5 OS Status
  • Scaling Status
  • RE Connectivity

In the F5 Software Status and F5 OS Status fields, the option to perform upgrade or reload is also available. In the RE Connectivity field, click a connected RE to load its details in JSON format.

Nodes: Inspect Site Nodes.

Click the Nodes tab to load the node monitoring view:

site nodes
Figure: Site Nodes

Click on a node to open the node monitoring view. The Node Status tab gets displayed by default. You can also perform upgrades to the node software and operating system from here for that node.

node status
Figure: Site Node Status

Click on the Hardware Information tab to obtain detailed information on the node hardware. In this view, click on any of the network device name to display its detailed information in the JSON format.

node hw
Figure: Node Hardware Information

Click the Metrics tab in the node monitoring view to display a graph for node metrics. You can get trend graphs for

  • CPU, memory, disk, and GPU usage.
  • GPU temperature.
  • GPU TX and GPU RX throughputs.
  • Up/down status.
Interfaces: Inspect Site Interfaces.

Click the Site Interfaces tab to load the site interfaces view:

site intf
Figure: Site Interfaces

Use the toggle selection to switch between inside and outside interface monitoring view. Click on any interface or any metric value to open its metrics view.

intf metrics
Figure: Interface Metrics
Alerts: Inspect Site Alerts.

Click the Alerts tab to load the alerts view:

site alerts
Figure: Site Alerts

The active alerts are displayed by default. Use the toggle selection to load all alerts. You can also set a time interval in the active alerts view to display alerts over a specific period of time. Click > for any alert entry to display details in JSON format.

Requests: Inspect Site Requests.

Click the Site Requests tab to load the view for the trend of sampled HTTP requests:

site req
Figure: Site Requests

The requests are displayed in a graphical trend as well as in a list for the default or specific time interval. Click > for any listed request to display detailed information in JSON format.

You can apply filters to display the trend for specific HTTP codes. For example, de-select all and select only 2xx to display the requests for HTTP code 2XX.

You can get more details on the requests by clicking Forensics at the right of the graph to show the Forensics side panel.

Note: A custom time period must be within the last 7 days, which is the log retention limit.

Top Talkers: Inspect Site Connections.

Click the Top Talkers tab to load the view traffic by the top 10 apps and top flows.

The two Top 10 Apps tables show the top applications sending and receiving data as the amount of data sent or received. Top Flows shows source and destination traffic for top applications.

Connections: Inspect Site Connections.

Click the Connections tab to load the view for the trend of sampled HTTP connections.

The connections are displayed in a graphical trend as well as in a list for the default or specific time interval. Click > for any listed request to display detailed information in JSON format.

You can apply filters to display the trend for connections based on OK connections or connections with errors. For example, de-select all and select only Client Errors to display only connections that experienced a client error.

You can get more details on the requests by clicking Forensics at the right of the graph to show the Forensics side panel.

Hub VNET: Inspect an Azure Hub Virtual Net.

The Hub VNET tab displays information about the hub VNET, such as Name, CIDR, and internal load balancer. Below the general information is a list of attached VNETs.

Flow Table: Inspect Site Flow Table.

Click the Flow Table tab to get more information on how data is flowing through your site. Each row of the table provides information such as source and destination IPs, ports, TCP flags, packet counts, and more. To see additional information for any flow between IP addresses, click the arrow ( > ) at the left of a row to drop down the JSON or YAML for that row.

DHCP: Inspect Site DHCP Setup.

Click the DHCP tab to see all DHCP clients and subnets on the site, and well as the details for each.

Status Objects: Inspect Site Status Objects.

Click the Site Status Objects tab to load the view status objects related to site:

site statusobj
Figure: Site Status Objects

Click on any status object to load its status in the JSON format.

Tools: Additional Site Tools.

The Tools tab provides a set of tools for more site exploration and device interaction.

site tools
Figure: Site Tool Selection

Select a tool from the drop-down list, enter any required or optional fields, and then press the blue button at the bottom, e.g. Show, Reboot, Call ping, etc. For example, select Traceroute from the drop-down list and fill in the two required fields, Node name and Destination. Enter values for any desired optional fields and then press the blue button at the bottom, Call traceroute, to run the tool.

site tools traceroute
Figure: Use traceroute tool

Concepts


API References