Monitor Kubernetes 🔗
Note
The following topic describes the new Kubernetes navigator. See Monitor Kubernetes (classic version) for documentation on the classic Kubernetes navigator.
You can monitor Kubernetes metrics with Splunk Observability Cloud. Splunk Observability Cloud uses the Splunk Distribution of OpenTelemetry Collector for Kubernetes to provide robust infrastructure monitoring capabilities. To learn more, see Get started with the Splunk Distribution of the OpenTelemetry Collector.
Prerequisites 🔗
To start monitoring Kubernetes resources, you must:
Log in with your administrator credentials.
Hierarchy map 🔗
Note
The hierarchy map is only available on the Kubernetes nodes, pods, and containers navigators.
Monitor your Kubernetes infrastructure with an interactive hierarchical map that displays the child resources associated with a selected Kubernetes instance. You can select elements in the map to drill down into them, or use the filter to explore your data. The level of detail shown on the map is dynamic and depends on the number of elements shown.
To navigate to the hierarchy map:
On the Infrastructure landing page, select the Kubernetes nodes, pods, or containers navigator.
The table view displays by default. Select an instance from the table.
Expand the hierarchy map.
Nodes, pods, and containers are colored by health and status, as reported by Kubernetes:
Nodes are colored by condition:
Node Ready
,Memory Pressure
,PID Pressure
,Disk Pressure
,Network Unavailable
, andOut of Disk
Pods are colored by phase:
Running
,Pending
,Succeeded
,Failed
, andUnknown
Containers are colored by status:
Ready
,Not Ready
, andUnknown
Investigate instances in the hierarchy map 🔗
Breadcrumb navigation: Switch to different instances and jump across entity levels using the breadcrumb navigation bar.
Hover: Get more information about an instance, including its status or phase, by hovering over that instance.
Select and zoom: Drill down into an instance and change the zoom level of the map, if applicable, by selecting the instance. Details about the instance display in the sidebar, in the About this <Entity_Type> panel.
Filter: Filter the map by any available metadata in your Kubernetes data, such as a namespace, a workload, or any other key-value pair. When you apply a filter, the map highlights instances that match the filter. You can still hover over the dimmed instances to view details about them.
Analyzer 🔗
Note
The Analyzer is only available on the Kubernetes nodes, pods, and containers navigators.
The Analyzer, accessed through the K8s analyzer tab, helps you troubleshoot Kubernetes problems at scale by highlighting Kubernetes instances that are in a bad state, such as nodes that are not ready. The Analyzer produces theories about what those instances might have in common, such as that all of the instances are running the same workload or all instances are located in the same AWS region. Select a finding in the Analyzer panel to filter the map.
The Analyzer panel displays suggested filters for the elements selected in the table or heat map view. Select links in the Analyzer panel to add filters to the table or heat map view and explore conditions across your entire Kubernetes environment.
The Analyzer uses AI-driven insights to examine patterns that nodes, pods, or containers could have in common. The trouble indicators are:
Pods that are in pending status
Pods that are in failed status
Pods with unknown condition
Containers with high restart counts
Nodes not ready
Nodes with unknown condition
Nodes experiencing high CPU
Nodes experiencing high memory
The Analyzer displays overrepresented metrics properties for known conditions, such as pods in pending status, pods in failed status, and so on. You can use properties that are highly correlated with these conditions to filter the table or heat map. You can explore data about each of those elements in the navigator using context-sensitive dashboards. This enables you to identify the underlying patterns noticeable on the filtered map that might be correlated with Kubernetes issues. For example, if all failed pods are in certain types of clusters, the Analyzer provides suggested paths to follow to troubleshoot such issues.
View services and hosts running on Kubernetes 🔗
Apart from monitoring your Kubernetes infrastructure, you can also track services and hosts running on Kubernetes in the navigator sidebar. When you select a service or host from the sidebar, you are switching to the navigator for that service or host instance.
Next steps 🔗
You can also export and monitor data related to your Kubernetes clusters, as described in the following table.
Get data in |
Monitor |
Description |
---|---|---|
Connect to the cloud service provider your Kubernetes clusters run in, if any. |
||
Instrument back-end applications to send spans to Splunk APM |
Collect metrics and spans from applications running in Kubernetes clusters. |