Browse Source

MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.

Akira Ajisaka 8 years ago
parent
commit
22befbd585

+ 1 - 0
hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md

@@ -156,6 +156,7 @@ This section deals with important parameters to be specified in the given config
 | `yarn.nodemanager.remote-app-log-dir` | */logs* | HDFS directory where the application logs are moved on application completion. Need to set appropriate permissions. Only applicable if log-aggregation is enabled. |
 | `yarn.nodemanager.remote-app-log-dir-suffix` | *logs* | Suffix appended to the remote log dir. Logs will be aggregated to ${yarn.nodemanager.remote-app-log-dir}/${user}/${thisParam} Only applicable if log-aggregation is enabled. |
 | `yarn.nodemanager.aux-services` | mapreduce\_shuffle | Shuffle service that needs to be set for Map Reduce applications. |
+| `yarn.nodemanager.env-whitelist` | Environment properties to be inherited by containers from NodeManagers | For mapreduce application in addition to the default values HADOOP\_MAPRED_HOME should to be added. Property value should JAVA\_HOME,HADOOP\_COMMON\_HOME,HADOOP\_HDFS\_HOME,HADOOP\_CONF\_DIR,CLASSPATH\_PREPEND\_DISTCACHE,HADOOP\_YARN\_HOME,HADOOP\_MAPRED\_HOME |
 
   * Configurations for History Server (Needs to be moved elsewhere):
 

+ 4 - 8
hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm

@@ -190,14 +190,6 @@ The following instructions assume that 1. ~ 4. steps of [the above instructions]
                 <name>mapreduce.framework.name</name>
                 <value>yarn</value>
             </property>
-            <property>
-                <name>mapreduce.admin.user.env</name>
-                <value>HADOOP_MAPRED_HOME=$HADOOP_COMMON_HOME</value>
-            </property>
-            <property>
-                <name>yarn.app.mapreduce.am.env</name>
-                <value>HADOOP_MAPRED_HOME=$HADOOP_COMMON_HOME</value>
-            </property>
         </configuration>
 
     `etc/hadoop/yarn-site.xml`:
@@ -207,6 +199,10 @@ The following instructions assume that 1. ~ 4. steps of [the above instructions]
                 <name>yarn.nodemanager.aux-services</name>
                 <value>mapreduce_shuffle</value>
             </property>
+            <property>
+                <name>yarn.nodemanager.env-whitelist</name>
+                <value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME</value>
+            </property>
         </configuration>
 
 2.  Start ResourceManager daemon and NodeManager daemon: