Install Hunk on Amazon Web Services using a license

Hunk is available on the Amazon Web Services Marketplace (AWS) as an Amazon Machine Image (AMI).

The Hunk AMI is a Linux x64 server instance that comes pre-installed with Hunk. It's public and free, though EC2 hourly fees may apply and are detailed on the AMI page.

How do I get it?

Setting up Hunk in the Hunk AMI is easy:

1. Go to the AWS Marketplace and create a Hunk EC2 instance. The Hunk AMI can be accessed Here.

2. Create an Amazon Elastic MapReduce (EMR) cluster for your data. Note that Hunk works with data in HDFS or Amazon Simple Storage Service (S3).

3. Configure Hunk to analyze your data. This means setting up a provider and virtual index that points to your directories in HDFS or S3.

• To configure Hunk using the configuration files, see:
  • Set up a provider and virtual index in the configuration file.

• To configure Hunk in the User Interface see:
  • Add or edit a provider
  • Add or edit a virtual index

Recommendations for your instance

When setting up your Hunk AMI instance, keep in mind the following:

• You should create an instance with enough resources to accommodate your expected workload and search concurrency. For instance, a c3.2xlarge (high-CPU instance) provides a good starting point.

• Make sure that the Hunk instance can freely communicate with all of your EMR cluster nodes. To do this, you can edit your Security Groups in the EC2 Management page to make sure traffic is allowed to and from all ports.

• If you are using S3 for your data directories, we recommend that you set up your Hunk working directory in HDFS. This improves processing speed and allows you to keep your directory read-only, if desired.

The Hunk AMI directory structure and permissions

The Hunk directory lives under /opt. These directories are recursively owned by user and group hadoop.

• /opt/hadoop contains the Hadoop libraries. For now, only vanilla Apache hadoop 1.0.3 and 2.2.0 are located here.

• /opt/java is where a modern version of Java resides. The latest installed in the AMI is Java 1.7 U45.

• /opt/hunk contains the actual Hunk installation.

Learn more

To learn more about configuring and using Hunk, see Meet Hunk in this manual. To learn a little more about working with the AMI, you can also check out this blog entry.