Step 6: Configure an HDFS provider

We will now give Hunk the information it needs to work with your Hadoop directory. For more detailed information about setting up a provider, see Add or edit an HDFS provider in this manual.

1. In Hunk Web, select Manager > Virtual Indexes in the menu bar.

2. Click the Provider tab (if it is not already selected) and click New Provider.

The New Provider page appears:

3. Give your provider a Name. For our example, the name is "PonyProvider".

4. Select a Provider Family, if you are using our example, the option is "Hadoop".

5. In the Java Home field, provide the path to your Java instance. The path in our example is /usr/java/jdk1.6.0_31. (You can run ls /usr/java to verify your version for this example.)

6. In the Hadoop Home field, provide the path to your Hadoop client directory. In our example we are using /usr/lib/hadoop.

7. In the Hadoop Version field, tell Hunk which version of Hadoop you are using. Our example uses Hadoop 2.x, (MRv1). For this example, select YARN as your type.

8. In the JobTracker field, provide that host and port to where the JobTracker resides. In our example, this is localhost:8021. For this example, leave this field blank.

9. In the File System field, provide the URI to the default file system. In our example, this URI is: hdfs://localhost:8020.

10. For HDFS working directory provide the path in HDFS that you want Hunk to use as a working directory. For our example, this is /user/root/splunkmr.

11. Since we are using YARN (Hortonworks for Sandbox 2.0), for this example add the following new settings in the Additional Settings section:

• vix.yarn.resourcemanager.address= <namenode>:8050
• vix.yarn.resourcemanager.scheduler.address= <namenode>:8030

12. Click Save.