Prechádzať zdrojové kódy

HADOOP-18764. fs.azure.buffer.dir to be under Yarn container path on yarn applications (#5737)

Changing fs.azure.buffer.dir for azure so things clean up better in long-lived yarn clusters.

Contributed by: Mehakmeet Singh
Mehakmeet Singh 1 rok pred
rodič
commit
5db7107b77

+ 4 - 2
hadoop-common-project/hadoop-common/src/main/resources/core-default.xml

@@ -2165,9 +2165,11 @@ The switch to turn S3A auditing on or off.
 
   <property>
     <name>fs.azure.buffer.dir</name>
-    <value>${hadoop.tmp.dir}/abfs</value>
+    <value>${env.LOCAL_DIRS:-${hadoop.tmp.dir}}/abfs</value>
     <description>Directory path for buffer files needed to upload data blocks
-      in AbfsOutputStream.</description>
+      in AbfsOutputStream.
+      Yarn container path will be used as default value on yarn applications,
+      otherwise fall back to hadoop.tmp.dir </description>
   </property>
 
 <property>