Splunk® Data Stream Processor

Connect to Data Sources and Destinations with DSP

DSP 1.2.1 is impacted by the CVE-2021-44228 and CVE-2021-45046 security vulnerabilities from Apache Log4j. To fix these vulnerabilities, you must upgrade to DSP 1.2.4. See Upgrade the Splunk Data Stream Processor to 1.2.4 for upgrade instructions.

On October 30, 2022, all 1.2.x versions of the Splunk Data Stream Processor will reach its end of support date. See the Splunk Software Support Policy for details.
This documentation does not apply to the most recent version of Splunk® Data Stream Processor. For documentation on the most recent version, go to the latest release.

Create a DSP connection to send data to Google Cloud Storage

To send data from a data pipeline in the to a Google Cloud Storage bucket, you must first create a connection using the Connector for Google Cloud Storage. You can then use the connection in the Send to Google Cloud Storage sink function to send data from your pipeline to your Cloud Storage bucket.

Prerequisites

Before you can create the Google Cloud Storage connection, you must have the following:

  • A Google Cloud service account that has the storage.objects.create permission.
  • A JSON file containing the credentials of your Google Cloud service account.

If you don't have the required permission or the credentials file, ask your Google Cloud Platform administrator for assistance. For information about managing permissions and roles, search for "Identity and Access Management" in the Google Cloud storage documentation. For information about creating the credentials file, search for "Creating service account keys" in the Google Cloud Identity and Access Management (IAM) documentation.

Steps

  1. In the , select the Connections tab and then click Create Connection.
  2. Select Connector for Google Cloud Storage and then click Next.
  3. Complete the following fields:
    Field Description
    Connection Name A unique name for your Google Cloud Storage connection.
    Description (Optional) A description of your connection.
    Service Account Credentials JSON The JSON file containing the credentials of your Google Cloud service account.

    Any credentials that you upload are transmitted securely by HTTPS, encrypted, and securely stored in a secrets manager.

  4. Click Save.

    If you're editing a connection that's being used by an active pipeline, you must reactivate that pipeline after making your changes. When you reactivate a pipeline, you must select where you want to resume data ingestion. See Using activation checkpoints to activate your pipeline in the Use the Data Stream Processor manual for more information.

You can now use your connection in a Google Cloud Storage sink function at the end of your data pipeline to send data to a Cloud Storage bucket. For instructions on how to build a data pipeline, see the Building a pipeline chapter in the Use the manual. For information about the sink function, see Send data to Google Cloud Storage in the Function Reference manual.

Last modified on 26 February, 2022
Connecting Google Cloud Storage to your DSP pipeline as a data destination   Connecting Microsoft 365 to your DSP pipeline

This documentation applies to the following versions of Splunk® Data Stream Processor: 1.2.1, 1.2.2-patch02, 1.2.4, 1.2.5

Acrobat logo Download manual
Acrobat logo Download this page

Was this topic useful?







You must be logged into splunk.com in order to post comments. Log in now.

Please try to keep this discussion focused on the content covered in this documentation topic. If you have a more general question about Splunk functionality or are experiencing a difficulty with Splunk, consider posting a question to Splunkbase Answers.

0 out of 1000 Characters