Step 1: Set up a Hadoop Virtual Machine instance

The easiest way to get started sampling searches in Hunk is to install a Virtual Machine that comes preconfigured with Hadoop.

For this tutorial we are using the Hortonworks Sandbox 2.0, which can be downloaded here. This tutorial includes configuring Hunk to work with YARN. See "System and Software requirements" for the full list of supported Hadoop distributions and versions.

Set up your Virtual Machine instance, following the instructions as described in the Hortonworks documentation.

Considerations when using Hortonworks Sandbox 2.0 and virtual box

If you are using Hortonworks Sandbox 2.0, there are a few things to keep in mind.

You may need to increase YARN memory

You might need to assign more memory to Yarn that is defined by default. We recommend that YARN have at least 5120 MB assigned to it (how much you are able to assign to it depends on how much memory is assigned to your VM). You can do this by editing the following property in yarn-site.xml:

<name>yarn.nodemanager.resource.memory-mb</name> <value>5120</value>

You may need to set a static IP in your virtual box

Depending on the version of Virtual Box you are running your Sandbox on, you might need to set a static IP. Here is one way to add a static IP, but it may not work for every environment and system configuration. We recommend that you consult the Virtual Box documentation for more information.

1. In the Virtual Box, select Preferences > Network.

2. Select the adapter 2 tab and enable the host-only adapter by clicking Enable Network Adapter.

3. Select "Host-Only Adapter" in the Attached to field then choose the available network (this is the network that was automatically created when you installed the Virtual Box).