View infrastructure metrics by resource type

The Infrastructure Inventory page provides a metrics-driven view of your entire infrastructure grouped by the resources you are monitoring. All monitored resources emitting a core set of infrastructure metrics are displayed to give you a quick view of the overall health of your infrastructure.

To open the Infrastructure inventory page in:

  • Elastic Stack, find Infrastructure in the main menu or use the global search field.
  • Serverless, go to Infrastructure inventory in your Observability Serverless project.
Infrastructure UI in Kibana

To learn more about the metrics shown on this page, refer to the Metrics reference.

Note

Don’t see any metrics?

If you haven’t added data yet, click Add data to search for and install an Elastic integration.

Need help getting started? Follow the steps in Get started with system metrics.

To get started with your analysis, select the type of resources you want to show in the high-level view. From the Show menu, select one of the following:

  • Hosts: the default view. Refer to Host metrics for more on supported data types for this view.
  • Kubernetes Pods: Refer to Kubernetes pod metrics for more on supported data types for this view.
  • Docker Containers: shows all containers, not only Docker containers. Refer to Container metrics for more on supported data types for this view.
  • AWS: includes EC2 instances, S3 buckets, RDS databases, and SQS queues. Refer to AWS metrics for more on supported data types for this view.

A Schema menu lets you choose the data collection schema for the following resource types:

  • Hosts: Choose between the Elastic System integration and OpenTelemetry.
  • Kubernetes Pods: Choose between the Kubernetes integration and OpenTelemetry.

Docker Containers and AWS show data collected using Elastic integrations only, so they have no Schema menu.

When you hover over each resource in the waffle map, the metrics specific to that resource are displayed.

You can sort by resource, group the resource by specific fields related to it, and sort by either name or metric value. For example, you can filter the view to display the memory usage of your Kubernetes pods, grouped by namespace, and sorted by the memory usage value.

Kubernetes pod filtering

You can also use the search bar to create structured queries using Kibana Query Language. For example, enter host.hostname : "host1" to view only the information for host1.

To examine the metrics for a specific time, use the time filter to select the date and time.

Note

Refer to Host metrics for more on supported data types for this view.

By default the Infrastructure Inventory page displays a waffle map that shows the hosts you are monitoring and the current CPU usage for each host. Alternatively, you can click the Table view icon table view icon to switch to a table view.

Without leaving the Infrastructure Inventory page, you can view enhanced metrics relating to each host running in your infrastructure. On the waffle map, select a host to display the host details overlay.

Note

When showing Hosts, the Schema dropdown menu shows the available data collection schemas for the current query. If data from both the Elastic System integration and OpenTelemetry is available, the schema defaults to OpenTelemetry. Select Elastic System Integration to see data collected by the Elastic System integration.

Tip

To expand the overlay and view more detail, click Open as page in the upper-right corner.

The host details overlay contains the following tabs:

Note

These metrics are also available when viewing hosts on the Hosts page.

When you select Kubernetes Pods, the Infrastructure inventory page displays a waffle map that shows the pods you are monitoring and the current CPU usage for each pod. Alternatively, you can click the Table view icon Table view icon to switch to a table view.

Note

Refer to Kubernetes pod metrics for more on supported data types for this view.

To analyze the metrics for a specific pod, click the pod and select Kubernetes Pod metrics:

Kubernetes pod metrics

The Schema menu shows the available data collection schemas for the current query. If pod data from both the Kubernetes integration and OpenTelemetry is available, the schema defaults to OpenTelemetry. Select Elastic System Integration to see pod data collected by the Kubernetes integration.

The selected schema determines which pods appear on the waffle map, and which field identifies each pod: k8s.pod.uid for OpenTelemetry, or kubernetes.pod.uid for the Kubernetes integration. Kubernetes Pod logs, Kubernetes Pod APM traces, and Kubernetes Pod metrics all follow the selected schema.

Keep the following in mind when you switch schemas:

  • Group by uses the fields of the selected schema. Switching schemas doesn't clear Group by, so a field left over from the other schema can leave the map empty. Clear or reselect Group by after switching.
  • Anomaly detection isn't available for OpenTelemetry pods.
  • On the Kubernetes pod metrics page, charts that depend on the Kubernetes integration stay hidden when the schema is OpenTelemetry. This includes Pod log usage and the Nginx charts.

Refer to Kubernetes pod metrics for the field calculation formulas used by each schema.

Note

Refer to Container metrics for more on supported data types for this view.

When you select Docker containers, the Infrastructure inventory page displays a waffle map that shows the containers you are monitoring and the current CPU usage for each container. Alternatively, you can click the Table view icon Table view icon to switch to a table view.

Without leaving the Infrastructure inventory page, you can view enhanced metrics relating to each container running in your infrastructure.

Note

Why do some containers report 0% or null (-) values in the waffle map?

The waffle map shows all monitored containers, including containerd, provided that the data collected from the container has the container.id field. However, the waffle map currently only displays metrics for Docker fields. This display problem will be resolved in a future release.

On the waffle map, select a container to display the container details overlay.

Tip

To expand the overlay and view more detail, click Open as page in the upper-right corner.

The container details overlay contains the following tabs:

Note

Refer to AWS metrics for more on supported data types for this view.

When you have searched and filtered for a specific resource, you can drill down to analyze the metrics relating to it. For example, when viewing EC2 instances in the high-level view, click the instance you want to analyze and select EC2 Instance metrics to see detailed metrics.

If the predefined metrics displayed on the Inventory page for each resource are not sufficient for your specific use case, you can add and define custom metrics.

Select your resource, and from the Metric filter menu, click Add metric.

Add custom metrics

Depending on the features you have installed and configured, you can view logs or traces relating to a specific resource. For example, in the high-level view, when you click a Kubernetes Pod resource, you can choose: