Splunk® Machine Learning Toolkit

User Guide

Acrobat logo Download manual as PDF


This documentation does not apply to the most recent version of Splunk® Machine Learning Toolkit. For documentation on the most recent version, go to the latest release.
Acrobat logo Download topic as PDF

Detect Categorical Outliers

The Detect Categorical Outliers assistant identifies data that indicate interesting or unusual events. This assistant allows non-numeric and multi-dimensional data, such as string identifiers and IP addresses. To detect categorical outliers, input data and select the fields for which to look for unusual combinations or a coincidence of rare values. When multiple fields have rare values, the result is an outlier. The image below illustrates results from the showcase example in the Splunk Machine Learning Toolkit with Bitcoin data.

This image shows the number of categorical outliers and a corresponding table with user information from bitcoin transactions.

Algorithm

The Detect Categorical Outliers assistant uses the probabilistic measures algorithm.

Workflow

To detect categorical outliers, input data and select the fields to analyze.

  1. Run a search.
  2. Select the fields you want to analyze.
  3. The list populates every time you run a search.

  4. Click Detect Outliers.

Interpret and validate

After you detect outliers, review your results and the corresponding tables. Results often have a few outliers.

Result Definition
Outliers This result shows the number of events flagged as outliers.
Total Events This result shows the total number of events that were evaluated.
Data and Outliers This table lists the events that marked as outliers, and the corresponding reason that the event is marked as an outlier.

Deploy categorical outlier detection

  1. Next to Detect Outliers, click Open in Search.
  2. A search query opens using all of the data, not just the training set data.

  3. Next to Open in Search, click Show SPL to see the search query that was used to detect outliers.
  4. You can use this same query on a different data set.

  5. Click the Schedule Alert button in a panel to set up an alert when the number of outliers outside both the upper and lower thresholds exceeds a specified value.
  6. After you save the alert, you can access it from the Scheduled Jobs > Alerts menu.
  7. Click any title to go to a new Search tab.
  8. The search bar contains a search query to replicate the outlier detection calculations.

Last modified on 11 April, 2018
PREVIOUS
Detect Numeric Outliers
  NEXT
Forecast Time Series

This documentation applies to the following versions of Splunk® Machine Learning Toolkit: 2.4.0, 3.0.0, 3.1.0


Was this documentation topic helpful?


You must be logged into splunk.com in order to post comments. Log in now.

Please try to keep this discussion focused on the content covered in this documentation topic. If you have a more general question about Splunk functionality or are experiencing a difficulty with Splunk, consider posting a question to Splunkbase Answers.

0 out of 1000 Characters