Send data from Splunk DSP to Kafka without authentication
You can use the Apache Kafka Connector (No Authentication) with a Write to Kafka sink function to send data from the Splunk Data Stream Processor (DSP) to an Apache or Confluent Kafka server that does not require SSL/TLS authentication. For information about sending data to SSL-enabled Kafka servers instead, see Send data from Splunk DSP to Kafka using SSL.
You need a Universal license to send data from DSP to a Kafka server. See Licensing for the Splunk Data Stream Processor.
To use a connector, you must create a connection. You can reuse the Kafka connection for both the Read from Kafka source function and the Write to Kafka sink function.
Prerequisites
You must have at least one Kafka server running one of the following Kafka versions:
- Apache Kafka version 10 or higher
- Confluent Kafka version 3.0 or higher
Configure a Kafka connection without authentication in the Data Stream Processor UI
Create a connection in the Data Stream Processor UI.
If you are editing a connection that's being used by an active pipeline, you must reactivate that pipeline after making your changes.
- Navigate to the Data Stream Processor UI. From the Data Management page, select the Connections tab.
- Click Create New Connection.
- Select Apache Kafka Connector (No Authentication) and then click Next.
- Complete the following fields:
Field Description Connection Name The connection name. Description (Optional) A description of your connection. Brokers A comma-separated list of your Kafka brokers. You must enter at least one broker. Enter each broker using the format <scheme>://<host>:<port>
. - Click Save.
You can now use your Kafka connection with a Write to Kafka sink function to send data to an Apache or Confluent Kafka server.
Send data from Splunk DSP to Kafka using SSL | Monitor your pipeline with data preview and real-time metrics |
This documentation applies to the following versions of Splunk® Data Stream Processor: 1.1.0
Feedback submitted, thanks!