How Splunk Enterprise Security processes and merges asset and identity data

Splunk Enterprise Security takes the asset and identity data that you add as lookups and generates combined lookup files. Splunk Enterprise Security uses the generated lookup files to correlate asset and identity data with events using automatic lookups. The following steps describe this process at a high level.

1. You collect asset and identity data from data sources using an add-on and a custom search or manually with a CSV file. See Extract asset and identity data in Splunk Enterprise Security.
2. The Splunk Enterprise Security identity manager modular input updates settings in the transforms.conf stanza identity_lookup_expanded.
3. You format the data as a lookup, using a search or manually with a CSV file. See Format an asset or identity list as a lookup.
4. You configure the list as a lookup table, definition, and input. See Configure a new asset or identity list.
5. You create an identity lookup configuration. See Add asset and identity data to Splunk Enterprise Security.
6. The Splunk Enterprise Security identity manager modular input detects two things:
• Changed size of the CSV source file.
• Changed update time of the CSV source file.
7. The Splunk Enterprise Security identity manager modular input updates the macros used to identify the input sources based on the currently activated stanzas in inputs.conf.
8. The Splunk Enterprise Security identity manager modular input dispatches custom dynamic searches if it identifies changes that require the asset and identity lists to be merged.
9. The custom search dispatches a merge process to merge all configured and activated asset and identity lists.
10. The custom searches concatenate the lookup tables referenced by the identity manager input, generate new fields, and output the concatenated asset and identity lists into target lookup table files: asset_lookup_by_str, asset_lookup_by_cidr, identity_lookup_expanded.
11. You verify that the data looks as expected. See Verify that your asset or identity data was added to Splunk Enterprise Security.

The merging of identity and asset lookups does not validate or de-duplicate input. Errors from the identity manager modular input are logged in identity_manager.log. This log does not show data errors.