
Required configuration variables for YARN
If you are using YARN, you must add resource manager settings to the configuration variable settings:
- vix.mapreduce.framework.name = yarn
- vix.yarn.resourcemanager.address= <namenode>:<port>
- vix.yarn.resourcemanager.scheduler.address= <namenode>:<port>
If you installed Hortonworks for Sandbox 2.0, add the following settings/port:
- vix.yarn.resourcemanager.address= <namenode>:8050
- vix.yarn.resourcemanager.scheduler.address= <namenode>:8030
If you are using the Cloudera VM for Yarn, add the following settings/port:
- vix.yarn.resourcemanager.address = <your namenode>:8032
- vix.yarn.resourcemanager.scheduler.address = <your namenode>:8030
If your cluster does not use the default configuration values you must add your configurations to the search head. (For example, if the value of property yarn.application.classpath
in yarn-site.xml
is different than the value in yarn-default.xml
on the cluster.)
To update your search head, either:
- Set the value in
yarn-site.xml
of the Hadoop CLI on the search head - Set the value in provider to
vix.yarn.application.classpath
variable
YARN for High Availabilty
For YARN using HA (High Availability), you must add the following variables:
- HA - YARN [CDH5.3 YARN(MR2 Included)]
Setting: | Use it to: |
---|---|
vix.yarn.resourcemanager.ha.rm-ids
|
comma separated list of resource manager ids, in this example: rm57,rm40
|
vix.yarn.resourcemanager.address.rm57
|
The address of the applications manager interface in the ResourceManager. In this example hunk-piv-cent65x64-003.sv.splunk.com:8032
|
vix.yarn.resourcemanager.address.rm40
|
The address of the applications manager interface in the ResourceManager, for rm40: In this example, #hunk-piv-cent65x64-004.sv.splunk.com:8032
|
vix.yarn.resourcemanager.scheduler.address.rm57
|
The address of the scheduler interface in the ResourceManagerfor rm57. In this example, hunk-piv-cent65x64-003.sv.splunk.com:8030</code?
|
vix.yarn.resourcemanager.scheduler.address.rm40
|
The address of the scheduler interface in the ResourceManager rm40. In this example: hunk-piv-cent65x64-004.sv.splunk.com:8030
|
vix.yarn.resourcemanager.ha.enabled
|
Set to true |
vix.yarn.resourcemanager.cluster-id
|
Cluster ID used when ResourceManager is Highly Available.> # yarnRM |
vix.yarn.application.classpath
|
$HADOOP_CLIENT_CONF_DIR,$HADOOP_CONF_DIR,$HADOOP_COMMON_HOME/*,$HADOOP_COMMON_HOME/lib/*,$HADOOP_HDFS_HOME/*,$HADOOP_HDFS_HOME/lib/*,$HADOOP_YARN_HOME/*,$HADOOP_YARN_HOME/lib/* |
vix.mapreduce.application.classpath
|
= $HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/* |
PREVIOUS Virtual archive index configuration variables |
NEXT Providers |
This documentation applies to the following versions of Hunk®(Legacy): 6.0, 6.0.1, 6.0.2, 6.0.3, 6.1, 6.1.1, 6.1.2, 6.1.3, 6.2, 6.2.1, 6.2.2, 6.2.3, 6.2.4, 6.2.5, 6.2.6, 6.2.7, 6.2.8, 6.2.9, 6.2.10, 6.2.11, 6.2.12, 6.2.13, 6.3.0, 6.3.1, 6.3.2, 6.3.3, 6.3.4, 6.3.5, 6.3.6, 6.3.7, 6.3.8, 6.3.9, 6.3.10, 6.3.11, 6.3.12, 6.3.13, 6.4.0, 6.4.1, 6.4.2, 6.4.3, 6.4.4, 6.4.5, 6.4.6, 6.4.7, 6.4.8, 6.4.9, 6.4.10, 6.4.11
Feedback submitted, thanks!