浏览代码

HADOOP-18764. fs.azure.buffer.dir to be under Yarn container path on yarn applications (#5788)

Changing fs.azure.buffer.dir for azure so things clean up better in long-lived yarn clusters.

Contributed by: Mehakmeet Singh
Mehakmeet Singh 1 年之前
父节点
当前提交
b0377379af
共有 1 个文件被更改,包括 4 次插入2 次删除
  1. 4 2
      hadoop-common-project/hadoop-common/src/main/resources/core-default.xml

+ 4 - 2
hadoop-common-project/hadoop-common/src/main/resources/core-default.xml

@@ -2133,9 +2133,11 @@ The switch to turn S3A auditing on or off.
 
   <property>
     <name>fs.azure.buffer.dir</name>
-    <value>${hadoop.tmp.dir}/abfs</value>
+    <value>${env.LOCAL_DIRS:-${hadoop.tmp.dir}}/abfs</value>
     <description>Directory path for buffer files needed to upload data blocks
-      in AbfsOutputStream.</description>
+      in AbfsOutputStream.
+      Yarn container path will be used as default value on yarn applications,
+      otherwise fall back to hadoop.tmp.dir </description>
   </property>
 
 <property>