Data resolution and rollups in charts đź”—
Splunk Observability Cloud has two types of resolution:
Chart resolution: Interval at which data points appear on a chart
Data collection intervals: Interval at which a server or application sends data points to Splunk Observability Cloud. This interval is the native resolution of the data. To learn more about native resolution, see Resolution and data retention in Splunk Infrastructure Monitoring.
Chart data resolution đź”—
When it renders charts, Splunk Observability Cloud defaults to a display resolution based on the time range of the chart. In general, shorter time ranges have a fine resolution, and the chart resolution is more likely to be the same as the native resolution. Conversely, longer time ranges have a coarse resolution, and the chart resolution is more likely to differ from the native resolution. For longer time range charts, Splunk Observability Cloud ensures that the displayed points accurately reflect the actual data points by using rollups.
The chart resolution of a chart appears next to the title of the chart in the Chart Builder or on the dashboard that contains the chart. To increase or decrease the chart resolution of a chart, use the chart resolution selector at the top of the chart or dashboard. To learn more, see Chart display resolution.
Plots with different resolutions đź”—
A chart can contain multiple plots, each of which represents a different metric time series (MTS). Each MTS can have its own resolution. Splunk Observability Cloud chooses one resolution per chart, and for multiple plots the chart uses the coarsest resolution. Using this resolution lines up data points to facilitate plots and computations.
For example, metrics from AWS CloudWatch typically have a one-minute or five-minute resolution, while metrics reported using the Splunk Distribution of OpenTelemetry Collector (or the SignalFx Smart Agent, now deprecated) typically have a 10-second resolution. If a single chart has one plot that contains AWS Cloudwatch metrics (five-minute resolution) and another plot that contains Collector or Smart Agent metrics, the chart resolution is always five minutes or more.
Minimum chart resolution đź”—
On the Chart Options tab, you can select a minimum resolution for a chart. The following list shows you the options and, in parentheses, the appearance of the option in the UI:
Auto
One second (1s)
Five seconds (5s)
Ten seconds (10s)
Thirty seconds (30s)
One minute (1m)
One hour (1h).
The value you select specifies the minimum interval that Splunk Observability Cloud uses to roll up data point values that appear in the chart.
To learn more about chart rollups, see Rollups.
To learn more about minimum intervals, see Minimum resolution.
Chart resolution and data retention đź”—
The resolution of a metric time series in a chart is affected by amount of time that the time series has existed. This time, or age, controls the data retention policy for the time series. To learn more, see Resolution and data retention in Splunk Infrastructure Monitoring.
Rollups đź”—
A rollup is a statistical function that takes all the data points for an MTS over a time period and outputs a single data point. Splunk Observability Cloud applies rollups after it retrieves the data points from storage but before it applies analytics functions.
In a chart, the rolled up data points for an MTS appear with a chart resolution that’s coarser that the native resolution of the MTS. The coarse resolution helps Splunk Observability Cloud create a reasonable display of the data.
For example, suppose you create a chart with a one week time range. In the chart you plot an MTS that has a native resolution of 30 seconds. If Splunk Observability Cloud doesn’t apply a rollup to the MTS, the plot contains 20,160 data points; two per minute, 120 per hour, 2,880 per day, 20,160 per week. This number is ten times the number of pixels available for a typical thirty-inch monitor.
To reduce the plot to a displayable size, Splunk Observability Cloud applies a rollup to the MTS. Each data point that appears in the chart is now a summary of actual data points in the MTS.
Splunk Observability Cloud doesn’t always apply a rollup. If you create a chart with a time range of fifteen minutes for the same MTS, the plot only contains thirty data points. Splunk Observability Cloud automatically determines that it doesn’t need to roll up the MTS, and the resolution of the chart is the same as the native resolution of the data points in the MTS.
For a plot in a chart, Splunk Observability Cloud rolls up data when it determines that the time window for the chart requires it to display too many data points to fit on the screen.
Splunk Observability Cloud also rolls up data for long-term storage. To learn more, see Rollups, resolution, and data retention policies.
Rollup types đź”—
Splunk Observability Cloud has different rollup types:
Type |
Effect |
---|---|
|
Summarize data points into a single data point. The summary data point has a chart resolution that is coarser than the native resolution for original data points. For example, if the incoming data points have a native resolution of ten seconds, and the chart has a one day resolution, Splunk Observability Cloud rolls up the data to a one day resolution. If the chart resolution is the same as the native resolution of the incoming data, these rollups don’t have any effect. |
Count per second (rate) |
Converts data points that represent a count of events or occurrences in the last time period to a count per second. This rollup helps you compare counter metrics for different time periods. For example, if you have two metric time series, where one contains counts over the last ten seconds and another contains counts over the last five seconds, using the rate rollup helps you compare the two MTS. |
Delta |
Calculates change in values for a cumulative counter. Delta returns a data point that’s the difference between the incoming data in the current interval and the data in the previous interval. The Delta rollup helps you see trends in cumulative counter metrics. A line plot of a cumulative count MTS always has a non-negative slope. A line plot of the delta rollup for the MTS shows negative slopes where the cumulative count is growing more slowly. |
Lag and Count |
|
When you’re building a chart, you can accept the default rollup type or choose a different rollup type to control the chart appearance when it displays coarser-resolution data over a longer time window.
To change the rollup being used in a chart, see Set options in the plot configuration panel.
Splunk Observability Cloud has the following rollup functions:
Sum: (default for counter metrics): Returns the sum of all data points in the MTS reporting interval
Average (default for gauge metrics): Returns the average value of all data points in the MTS reporting interval
Min: Returns the minimum data point value seen in the MTS reporting interval
Count: Returns the total number of data points in the MTS reporting interval
Max: Returns the maximum value seen in the MTS reporting interval
Latest: Returns the value of the last data point received in the MTS reporting interval
Lag: Returns the average time in milliseconds each data point’s timestamp and the time that Splunk Observability Cloud receives it.
Rate:
Rate/sec: For counter metrics, rate is the data point value normalized to one second. For example, if the MTS reporting interval is one millisecond, the rate is data point value multiplied by 1000.
Delta: For cumulative counter metrics, the rate is the difference between the data point for the current time interval and the data point for the previous time interval. The Delta rollup is always non-negative; if the value of a cumulative counter data point is smaller than the previous value, the delta is the new value, not the negative difference.
Sum and Count đź”—
Sum adds up the values of all the MTS in the reporting interval. Count indicates how many individual MTS there are. If there are data with 4 MTS different only in the purpose dimension:
48 CUSTOM
28 AUTO_DETECT
17 SLO_ALERTING
2 NAMED_TOKEN
When you add (sum) them you get 95 (48 + 28 + 17 + 2). When you count them you get 4 because this is how many individual MTS we have. If you added a filter purpose=CUSTOM, the sum would be 48 and count would be 1.
Interpret the effect of rollups on chart plots đź”—
When you interpret the data in a chart, consider following elements:
The chart’s resolution. See Chart data resolution
The rollup setting
Whether Splunk Observability Cloud has applied the rollup to the data
Whether you’ve applied any other analytics functions to the data
Example: rollups without analytics đź”—
The following table provides examples of interpreting data in a chart. The Interpretation column describes the original meaning of the metric, its rollup setting, and its chart resolution.
Metric |
Rollup |
Chart Resolution |
Interpretation |
---|---|---|---|
|
Average |
10s |
The average CPU utilization observed during a ten second interval for each MTS |
|
Rate/sec |
1h |
The average rate of bits transmitted per second during a one hour interval |
|
Delta |
2m |
The number of transmission errors during a two minute interval |
Example: rollups with analytics đź”—
Rollups and SignalFlow analytics functions are similar, but they have different purposes and affect charts differently. When you apply analytics functions to a chart, you change the meaning of the data in the chart. Rollup functions are always applied to the data first and affect the data before Splunk Observability Cloud applies the analytics functions.
Note
The “Average” rollup type and the “Mean” analytics function both calculate an average; they have different names.
When you interpret a chart that has both rollups and analytics functions:
Consider the inherent meaning of the data points
Consider the effect of the rollup and resolution in effect
Consider the effect of the analytics functions; analytics aggregation functions apply across every MTS in the chart, while rollups are applied to each MTS. For example:
Metric |
Rollup |
Analytics function (aggregation) |
Chart Resolution |
Interpretation |
---|---|---|---|---|
|
Average |
none |
1m |
The average CPU utilization observed per minute for each host.
If there are fifty hosts, the chart contains fifty MTS and displays fifty separate plots.
Each data point in each plot represents the average of the |
|
Average |
Mean |
1m |
The average CPU utilization observed per minute across all hosts. The Average rollup and the Mean analytics function combine as an average of averages. The chart contains one plot, and each data point represents the average of all the MTS observed for the previous one minute. |
|
Average |
Max |
1m |
The maximum CPU utilization observed per minute across all hosts. The average rollup and the maximum analytics function combine as a maximum of averages. The chart contains one plot, and each data point represents the maximum of all the averages of the MTS observed for the previous one minute. Compare this plot interpretation with the one for max rollup and max analytics aggregation, as shown in the following row. |
|
Max |
Max |
1m |
The maximum CPU utilization values observed per minute across all hosts. The maximum rollup and the maximum analytics function combine as a maximum of maximums. The chart contains one plot, and each data point represents the maximum of all the maximums of the MTS observed for the previous one minute. |
To learn more about the difference between aggregation and transformation functions, see Aggregate and transform data.
Example: rollups and resolutions đź”—
The following table contains some examples of the plots that appear when you use combinations of rollups and resolutions, and Splunk Observability Cloud applies the rollup.
Metric |
Type |
Rollup |
Resolution |
Interpretation |
---|---|---|---|---|
|
Gauge |
Average |
10s |
The average percent CPU used over ten seconds |
|
Cumulative counter |
Delta |
1m |
The average rate of transmitted bits per second over one minute |
|
Cumulative counter |
Delta |
2m |
The total number of transmission errors that occurred over two minutes |
|
Count |
Average |
1h |
The average number of successful logins measured over one hour |
|
Count |
Sum |
1h |
The total number of successful logins measured over one hour |
Interactions between rollups and analytics functions đź”—
Rollups and analytics functions provide similar results, because they are both ways to perform statistical analysis on data. They affect charts differently, and Splunk Observability Cloud uses them for different tasks. Also, some rollups have the same name as an analytical function, such as Sum or Max.
The following table describes the difference between rollups and analytical functions:
Rollups |
Analytics functions |
|
---|---|---|
Usage |
Rollups combine data points from the same MTS into a single data point that Splunk Observability Cloud displays or stores. |
Analytics functions perform statistical, transformation, combination, selection, or aggregation computations on data points. The resulting number of data points depends on the function. |
Number |
Splunk Observability Cloud has fewer than ten types of rollup. |
Splunk Observability Cloud has more than twenty analytics functions. |
Requirement |
You can only decide which rollup to use in a chart. Splunk Observability Cloud applies the rollup when necessary. |
You can decide whether or not to use analytics functions on your data. |
Order of operations |
If Splunk Observability Cloud has to apply a rollup, it’s always applied to your chart before any analytics functions you specify. |
You decide the order in which Splunk Observability Cloud applies analytics functions to a chart. |
Timing |
Splunk Observability Cloud automatically applies rollups, depending on the chart resolution required. |
Splunk Observability Cloud always applies analytics functions, regardless of the resolution of the chart. |
Visible effects |
In most cases, the effects of a rollup aren’t visible until you change the time range of the chart. A longer time range can cause Splunk Observability Cloud to apply a rollup. A shorter time range can cause Splunk Observability Cloud to remove a rollup if Splunk Observability Cloud can display the data data at its native resolution. |
When you apply an analytics function, you immediately see the effect in the chart. |
How rollups, resolution, and analytics functions affect chart data đź”—
The following table shows you the results of some combinations of rollups, resolutions, and analytics aggregation functions. Use these examples to help you build charts that contain the information you need.
Note
Both the “Average” rollup type and the “Mean” analytics function perform the same type of computation, although they have different names.
Metric |
Type |
Rollup |
Aggregated analytics function |
Resolution |
Data point meaning |
---|---|---|---|---|---|
|
Gauge |
Average |
Mean |
1h |
Average CPU utilization per hour |
|
Gauge |
Average |
Max |
1h |
Highest average CPU utilization per hour |
|
Gauge |
Max |
Max |
1h |
The maximum CPU utilization observed per hour |
|
Counter |
Rate/sec |
Mean |
1h |
Mean request rate per second over one hour |
|
Counter |
Rate/sec |
Max |
1h |
Highest average request rate per second over one hour |
|
Counter |
Sum |
Sum |
1h |
Total number of requests per hour |
|
Counter |
Sum |
Max |
1h |
The highest total number of requests per hour |