Browse Source

HADOOP-3813. Fix task-output clean-up on HDFS to use the recursive FileSystem.delete rather than the FileUtil.fullyDelete. Contributed by Amareshwari Sri Ramadasu.

git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@679601 13f79535-47bb-0310-9956-ffa450edef68
Arun Murthy 17 năm trước cách đây
mục cha
commit
7baaf7018e
2 tập tin đã thay đổi với 5 bổ sung2 xóa
  1. 4 0
      CHANGES.txt
  2. 1 2
      src/mapred/org/apache/hadoop/mapred/JobInProgress.java

+ 4 - 0
CHANGES.txt

@@ -962,6 +962,10 @@ Release 0.17.2 - Unreleased
     HADOOP-3370. Ensure that the TaskTracker.runningJobs data-structure is
     correctly cleaned-up on task completion. (Zheng Shao via acmurthy) 
 
+    HADOOP-3813. Fix task-output clean-up on HDFS to use the recursive 
+    FileSystem.delete rather than the FileUtil.fullyDelete. (Amareshwari
+    Sri Ramadasu via acmurthy)  
+
 Release 0.17.1 - 2008-06-23
 
   INCOMPATIBLE CHANGES

+ 1 - 2
src/mapred/org/apache/hadoop/mapred/JobInProgress.java

@@ -34,7 +34,6 @@ import java.util.Vector;
 import org.apache.commons.logging.Log;
 import org.apache.commons.logging.LogFactory;
 import org.apache.hadoop.fs.FileSystem;
-import org.apache.hadoop.fs.FileUtil;
 import org.apache.hadoop.fs.LocalFileSystem;
 import org.apache.hadoop.fs.Path;
 import org.apache.hadoop.mapred.JobHistory.Values;
@@ -1667,7 +1666,7 @@ class JobInProgress {
         Path tmpDir = new Path(outputPath, MRConstants.TEMP_DIR_NAME);
         FileSystem fileSys = tmpDir.getFileSystem(conf);
         if (fileSys.exists(tmpDir)) {
-          FileUtil.fullyDelete(fileSys, tmpDir);
+          fileSys.delete(tmpDir, true);
         }
       }
     } catch (IOException e) {