Required configuration variables for YARN

Splunk Analytics for Hadoop reaches End of Life on January 31, 2025.

If you are using YARN, you must add resource manager settings to the configuration variable settings:

• vix.mapreduce.framework.name = yarn
• vix.yarn.resourcemanager.address= <namenode>:<port>
• vix.yarn.resourcemanager.scheduler.address= <namenode>:<port>

If you installed Hortonworks for Sandbox 2.0, add the following settings/port:

• vix.yarn.resourcemanager.address= <namenode>:8050
• vix.yarn.resourcemanager.scheduler.address= <namenode>:8030

If you are using the Cloudera VM for Yarn, add the following settings/port:

• vix.yarn.resourcemanager.address = <your namenode>:8032
• vix.yarn.resourcemanager.scheduler.address = <your namenode>:8030

If your cluster does not use the default configuration values you must add your configurations to the search head. (For example, if the value of property yarn.application.classpath in yarn-site.xml is different than the value in yarn-default.xml on the cluster.)

To update your search head, either:

• Set the value in yarn-site.xml of the Hadoop CLI on the search head
• Set the value in provider to vix.yarn.application.classpath variable

YARN for High Availabilty

For YARN using HA (High Availability), you must add the following variables:

1. HA - YARN [CDH5.3 YARN(MR2 Included)]

Setting:	Use it to:
vix.yarn.resourcemanager.ha.rm-ids	comma separated list of resource manager ids, in this example: rm57,rm40
vix.yarn.resourcemanager.address.rm57	The address of the applications manager interface in the ResourceManager. In this example test-piv-cent65x64-003.sv.splunk.com:8032
vix.yarn.resourcemanager.address.rm40	The address of the applications manager interface in the ResourceManager, for rm40: In this example, #test-piv-cent65x64-004.sv.splunk.com:8032
vix.yarn.resourcemanager.scheduler.address.rm57	The address of the scheduler interface in the ResourceManagerfor rm57. In this example, test-piv-cent65x64-003.sv.splunk.com:8030
vix.yarn.resourcemanager.scheduler.address.rm40	The address of the scheduler interface in the ResourceManager rm40. In this example: test-piv-cent65x64-004.sv.splunk.com:8030
vix.yarn.resourcemanager.ha.enabled	Set to true
vix.yarn.resourcemanager.cluster-id	Cluster ID used when ResourceManager is Highly Available.> # yarnRM
vix.yarn.application.classpath	$HADOOP_CLIENT_CONF_DIR, $HADOOP_CONF_DIR, $HADOOP_COMMON_HOME/*, $HADOOP_COMMON_HOME/lib/*, $HADOOP_HDFS_HOME/*, $HADOOP_HDFS_HOME/lib/*, $HADOOP_YARN_HOME/*, $HADOOP_YARN_HOME/lib/*
vix.mapreduce.application.classpath	= $HADOOP_MAPRED_HOME/*,$HADOOP_MAPRED_HOME/lib/*