Configure an intermediate forwarder
This topic provides instructions on how to set up an intermediate forwarder tier.
Intermediate forwarding is where a forwarder receives data from one or more forwarders and then sends that data on to another indexer. This kind of setup is useful when, for example, you have many hosts in different geographical regions and you want to send data from those forwarders to a central host in that region before forwarding the data to an indexer. All forwarder types can act as an intermediate forwarder.
For instructions on how to set up intermediate forwarding on a universal forwarder, see Configure an intermediate forwarder in the Universal Forwarder manual.
Set up intermediate forwarding with Splunk Web
1. In Splunk Web, log into the Splunk instance that you want to configure as an intermediate forwarder.
2. In the system bar, choose Settings > Forwarding and receiving.
3. Under "Receive data", click Add new. The "Receive data > Add New" page loads.
4. In the Listen on this port field, enter the port number that the instance should listen on for incoming forwarder connections.
5. Click Save. The forwarder starts listening on the specified port and Splunk Web displays the "Receive data" page.
6. Under "Receive data", click Forwarding and receiving. Splunk Web displays the "Forwarding and receiving" page again.
7. Under "Forward data", on the "Configure forwarding" line, click Add New. The "Forward data > Add New" page loads.
8. In the "Host" field, enter the host name or IP address and port of the indexer that should receive the forwarded data.
Note: Do not use the port you specified earlier for this instance unless you configured the same port number on the receiver.
9. Click Save. Splunk Web saves the configuration and the forwarder attempts to connect to the specified host and port.
10. Restart the forwarder. From the system bar, click Settings > Server controls.
11. Click Restart Splunk.
Repeat these instructions on additional hosts to set up a tier of intermediate forwarders.
Set up intermediate forwarding with configuration files
1. Open a command or shell prompt on the host you want to act as an intermediate forwarder.
inputs.conf to configure the forwarder to receive data, as described in Configure data collection on forwarders with inputs.conf.
3. Configure the forwarder to send data to the receiving indexer, as described in "Configure forwarders with outputs.conf."
4. (Optional) Edit
inputs.conf on the intermediate forwarder to configure any local data inputs.
5. Restart the forwarder.
Repeat these steps to add more forwarders to the tier.
Configure forwarders to use the intermediate forwarding tier
To set up additional forwarders to send their data to the intermediate forwarding tier:
1. If you have not already, install the universal forwarder.
2. Configure the forwarder to send data to the intermediate forwarder.
3. (Optional) Configure local data inputs on the forwarder.
4. Restart the forwarder.
Test the configuration
To confirm that the intermediate tier works properly:
1. Using Splunk Web, log into the receiving indexer.
2. Open the Search and Reporting app.
3. Run a search that contains a reference to one of the hosts that you configured to send data to the intermediate forwarder. For example:
host=<name or ip address of forwarder> index=_internal
If you do not see events, then the host has not been configured properly. See Troubleshoot forwarder/receiver connection for possible solutions.
Configure a forwarder to use a SOCKS proxy
Protect against loss of in-flight data
This documentation applies to the following versions of Splunk® Enterprise: 6.4.0, 6.4.1, 6.4.2, 6.4.3, 6.4.4, 6.4.5, 6.4.6, 6.4.7, 6.4.8, 6.4.9, 6.4.10, 6.4.11, 6.5.0, 6.5.1, 6.5.1612 (Splunk Cloud only), 6.5.2, 6.5.3, 6.5.4, 6.5.5, 6.5.6, 6.5.7, 6.5.8, 6.5.9, 6.5.10, 6.6.0, 6.6.1, 6.6.2, 6.6.3, 6.6.4, 6.6.5, 6.6.6, 6.6.7, 6.6.8, 6.6.9, 6.6.10, 6.6.11, 6.6.12, 7.0.0, 7.0.1, 7.0.2, 7.0.3, 7.0.4, 7.0.5, 7.0.6, 7.0.7, 7.0.8, 7.0.9, 7.0.10, 7.0.11, 7.0.13, 7.1.0, 7.1.1, 7.1.2, 7.1.3, 7.1.4, 7.1.5, 7.1.6, 7.1.7, 7.1.8, 7.1.9, 7.1.10, 7.2.0, 7.2.1, 7.2.2, 7.2.3, 7.2.4, 7.2.5, 7.2.6, 7.2.7, 7.2.8, 7.2.9, 7.3.0, 7.3.1, 7.3.2, 7.3.3, 7.3.4, 8.0.0, 8.0.1