Splunk® Hadoop Connect

Deploy and Use Splunk Hadoop Connect

Download manual as PDF

Download topic as PDF

System requirements

Before you deploy Splunk Hadoop Connect, verify that your environment meets the following system requirements.

Operating system

Splunk Hadoop Connect runs on any *nix platform on which both the Splunk platform and Hadoop File System Command-Line Interface (Hadoop CLI) run.

Note: Splunk Hadoop Connect does not support installation on the Windows platform.

For information about supported operating systems for the Splunk platform, see "Supported Operating Systems" in the Installation Manual. For information about supported operating systems for Hadoop CLI, see the documentation for your Hadoop distribution and version.

Splunk Enterprise version

You can run Splunk Hadoop Connect on Splunk Enterprise versions 5.0 through 6.4 and also Splunk Enterprise version 7.3.

For Hadoop-related functionality on Splunk Enterprise versions between 6.4 and 7.3, or Splunk Enterprise version 8.0 or later, use Splunk Analytics for Hadoop.

Hadoop distribution

Splunk Hadoop Connect has been tested on the following Hadoop distributions and versions:

  • Apache Hadoop
    • 1.0.2
    • 1.0.3
    • 1.0.4
    • 1.2.0
    • 2.0.0
    • 2.0.5-alpha (with Namenode HA turned on)
  • Cloudera Distribution Including Apache Hadoop
    • CDH3u4
    • CDH4
    • CDH4.2
    • CDH4.3
    • CDH4.4
    • CDH5.3
  • Hortonworks Data Platform (HDP) 1.0
  • Hortonworks Data Platform (HDP) 1.1
  • Hortonworks Data Platform (HDP) 1.3.1

Local export has been tested against mount points running MapR MapR-FS

Other versions and mount points might work, but have not been verified.

Software dependencies

Splunk Hadoop Connect requires that you install the following additional software packages on the Splunk instance on which the app runs:

  • Hadoop client utilities (Hadoop CLI).
  • Oracle Java Development Kit (JDK) v1.6u31 or higher (Required for Hadoop CLI).
  • Kerberos client utilities (to connect to clusters that require Kerberos authentication).

Make sure that you run the correct Hadoop client utilities for your Hadoop distribution and version.

Last modified on 07 February, 2020
How Splunk Hadoop Connect fits into your Splunk deployment
Download and install Splunk Hadoop Connect

This documentation applies to the following versions of Splunk® Hadoop Connect: 1.2, 1.2.1, 1.2.2, 1.2.3, 1.2.4, 1.2.5

Was this documentation topic helpful?

Enter your email address, and someone from the documentation team will respond to you:

Please provide your comments here. Ask a question or make a suggestion.

You must be logged into splunk.com in order to post comments. Log in now.

Please try to keep this discussion focused on the content covered in this documentation topic. If you have a more general question about Splunk functionality or are experiencing a difficulty with Splunk, consider posting a question to Splunkbase Answers.

0 out of 1000 Characters