Deserialize and preview data from Amazon Kinesis
If you are creating a pipeline to ingest data from Kinesis using the Read from Amazon Kinesis
source function, read the following to deserialize and preview your data:
- Kinesis sends your data in Base64 encoding. The
read_kinesis
source function decodes the Base64 encoding. You do not need to use the base64_decode function in your pipeline. - The data you send appears in the value field of your record, and not the body field.
- In the Preview Results tab, your data appears to be Base64 encoded.
- Depending on your data source, you might need to deserialize your data from an encoding scheme other than Base64 to preview it in the Preview Results tab. You must include how you want to deserialize your data in your pipeline definition. For example, if you send JSON, then use the
deserialize_json_object
function. - If you send text and want to view it in the Preview Results tab, add an eval function to your pipeline after your source function. Enter the following DSL in the configuration panel of your
eval
function:as(deserialize-json-object(get("value")), "body");
About Splunk Data Stream Processor regular expressions | Deserialize and send Azure Event Hubs data from a DSP pipeline |
This documentation applies to the following versions of Splunk® Data Stream Processor: 1.0.1
Feedback submitted, thanks!