Hunk®(Legacy)

Hunk User Manual

Acrobat logo Download manual as PDF


Acrobat logo Download topic as PDF

Required configuration variables for YARN

If you are using YARN, you must add resource manager settings to the configuration variable settings:

  • vix.mapreduce.framework.name = yarn
  • vix.yarn.resourcemanager.address= <namenode>:<port>
  • vix.yarn.resourcemanager.scheduler.address= <namenode>:<port>

If you installed Hortonworks for Sandbox 2.0, add the following settings/port:

  • vix.yarn.resourcemanager.address= <namenode>:8050
  • vix.yarn.resourcemanager.scheduler.address= <namenode>:8030

If you are using the Cloudera VM for Yarn, add the following settings/port:

  • vix.yarn.resourcemanager.address = <your namenode>:8032
  • vix.yarn.resourcemanager.scheduler.address = <your namenode>:8030

If your cluster does not use the default configuration values you must add your configurations to the search head. (For example, if the value of property yarn.application.classpath in yarn-site.xml is different than the value in yarn-default.xml on the cluster.)

To update your search head, either:

  • Set the value in yarn-site.xml of the Hadoop CLI on the search head
  • Set the value in provider to vix.yarn.application.classpath variable

YARN for High Availabilty

For YARN using HA (High Availability), you must add the following variables:

  1. HA - YARN [CDH5.3 YARN(MR2 Included)]
Setting: Use it to:
vix.yarn.resourcemanager.ha.rm-ids comma separated list of resource manager ids, in this example: rm57,rm40
vix.yarn.resourcemanager.address.rm57 The address of the applications manager interface in the ResourceManager. In this example hunk-piv-cent65x64-003.sv.splunk.com:8032
vix.yarn.resourcemanager.address.rm40 The address of the applications manager interface in the ResourceManager, for rm40: In this example, #hunk-piv-cent65x64-004.sv.splunk.com:8032
vix.yarn.resourcemanager.scheduler.address.rm57 The address of the scheduler interface in the ResourceManagerfor rm57. In this example, hunk-piv-cent65x64-003.sv.splunk.com:8030</code?
vix.yarn.resourcemanager.scheduler.address.rm40 The address of the scheduler interface in the ResourceManager rm40. In this example: hunk-piv-cent65x64-004.sv.splunk.com:8030
vix.yarn.resourcemanager.ha.enabled Set to true
vix.yarn.resourcemanager.cluster-id Cluster ID used when ResourceManager is Highly Available.> # yarnRM
vix.yarn.application.classpath $HADOOP_CLIENT_CONF_DIR,$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_YARN_HOME/*,$HADOOP_YARN_HOME/lib/*
vix.mapreduce.application.classpath = $HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*
Last modified on 22 September, 2015
PREVIOUS
Virtual archive index configuration variables
  NEXT
Providers

This documentation applies to the following versions of Hunk®(Legacy): 6.0, 6.0.1, 6.0.2, 6.0.3, 6.1, 6.1.1, 6.1.2, 6.1.3, 6.2, 6.2.1, 6.2.2, 6.2.3, 6.2.4, 6.2.5, 6.2.6, 6.2.7, 6.2.8, 6.2.9, 6.2.10, 6.2.11, 6.2.12, 6.2.13, 6.3.0, 6.3.1, 6.3.2, 6.3.3, 6.3.4, 6.3.5, 6.3.6, 6.3.7, 6.3.8, 6.3.9, 6.3.10, 6.3.11, 6.3.12, 6.3.13, 6.4.0, 6.4.1, 6.4.2, 6.4.3, 6.4.4, 6.4.5, 6.4.6, 6.4.7, 6.4.8, 6.4.9, 6.4.10, 6.4.11


Was this documentation topic helpful?


You must be logged into splunk.com in order to post comments. Log in now.

Please try to keep this discussion focused on the content covered in this documentation topic. If you have a more general question about Splunk functionality or are experiencing a difficulty with Splunk, consider posting a question to Splunkbase Answers.

0 out of 1000 Characters