Configure Cloud BigQuery Billing inputs for the Splunk Add-on for Google Cloud Platform

Google has deprecated regular file export of your Cloud Billing data to CSV and JSON. To export your Cloud Billing data for analysis, use Cloud Billing export to BigQuery.

Configure Cloud BigQuery Billing inputs for the Splunk Add-on for Google Cloud Platform using Splunk Web or via configuration file, using the information in the inputs parameters table below. For ease-of-use, configure your inputs for Cloud Billing via Splunk Web.

Configure Cloud BigQuery Billing inputs using Splunk Web

1. Click Create New Input in the Inputs tab, and then choose Google Cloud BigQuery Billing.
2. Enter the Name, Credentials, Project, BigQuery Dataset, BigQuery Table, Start Date, Interval and Index using the information in the inputs parameter table.

Google Cloud BigQuery Billing generates billing report at 00:00 every day at UTC−07:00 timezone.

For more information, see the Export Cloud Billing data to BigQuery topic in the Google Cloud documentation.

Configure Cloud BigQuery Billing inputs using the configuration file

1. Create a file named google_cloud_billing_inputs.conf under $SPLUNK_HOME/etc/apps/Splunk_TA_google-cloudplatform/local.
2. Create stanzas using the following template. Use the google_cloud_billing_inputs.conf.spec file in $SPLUNK_HOME/etc/apps/Splunk_TA_google-cloudplatform/README as a reference).

   [<name>]
   google_credentials_name = <value>
   google_project = <value>
   google_bq_dataset = <value>
   google_bq_table = <value>
   ingestion_start = <value>
   index = <value>
   polling_interval = <value>
   

3. Save the file and return to your Splunk instance.

Restart your Splunk platform after making changes to configuration (.conf) files.

Input Parameters

Each attribute in the following table corresponds to a field in Splunk Web.

Attribute	Corresponding field in Splunk Web	Description
name	Name	Enter a unique name of the Google Cloud BigQuery Billing input
google_credentials_name	Credentials	The stanza name defined in google_cloud_credentials.conf
google_project	Project	Google project ID
google_bq_dataset	BigQuery Dataset	Google BigQuery dataset name
google_bq_table	BigQuery Table	Google BigQuery table name
polling_interval	Interval	Data collection interval in seconds. The default is 3600 seconds.
ingestion_start	Start Date	The add-on starts collecting data with a date later than this. Note: Google Cloud Billing generates a billing report at 00:00 every day at UTC−07:00 timezone.
index	Index	The index in which to store Google Cloud billing data.