Lookups enrich your data by adding field-value combinations from lookup datasets. The uses lookups to match field-value combinations in your data with field-value combinations in external lookup files. If those field-value combinations are found in your lookup file, the corresponding field-value combinations from the file are appended to your data.
Types of lookups
There are two types of lookups:
- CSV lookups
- KV Store lookups
|Lookup type||Data source||Description|
|CSV||A CSV file||Populates your events with fields pulled from CSV files. Each column in a CSV table is interpreted as the potential values of a field.
|KV Store||A Splunk Enterprise KV Store collection||Matches fields in your events to fields in a KV Store collection and outputs corresponding fields in that collection to your events. In order to use the KV Store lookup, you must first create a KV Store collection. See Use configuration files to create a KV Store collection in the Splunk>Dev documentation.
The currently supports lookups to KV Store collections up to 10GB in size or 6.5 million records, depending on whichever is lower. If you are performing lookups to a distributed Splunk Enterprise environment, make sure you have an appropriately sized Splunk Enterprise environment capable of handling many requests per second. See Troubleshoot lookups to the Splunk Enterprise KV Store for more information.
Summarize records with the stats function
Upload a CSV file to the to enrich data with a lookup
This documentation applies to the following versions of Splunk® Data Stream Processor: 1.3.0, 1.3.1