소스 검색

MAPREDUCE-5315. DistCp reports success even on failure. (mithun and jlowe via daryn)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491914 13f79535-47bb-0310-9956-ffa450edef68
Daryn Sharp 12 년 전
부모
커밋
723ef662a9
2개의 변경된 파일6개의 추가작업 그리고 2개의 파일을 삭제
  1. 3 0
      hadoop-mapreduce-project/CHANGES.txt
  2. 3 2
      hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCp.java

+ 3 - 0
hadoop-mapreduce-project/CHANGES.txt

@@ -1114,6 +1114,9 @@ Release 0.23.9 - UNRELEASED
     MAPREDUCE-5308. Shuffling to memory can get out-of-sync when fetching
     multiple compressed map outputs (Nathan Roberts via jlowe)
 
+    MAPREDUCE-5315.  DistCp reports success even on failure. (mithun and jlowe
+    via daryn)
+
 Release 0.23.8 - 2013-06-05
 
   INCOMPATIBLE CHANGES

+ 3 - 2
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCp.java

@@ -162,8 +162,9 @@ public class DistCp extends Configured implements Tool {
     job.getConfiguration().set(DistCpConstants.CONF_LABEL_DISTCP_JOB_ID, jobID);
     
     LOG.info("DistCp job-id: " + jobID);
-    if (inputOptions.shouldBlock()) {
-      job.waitForCompletion(true);
+    if (inputOptions.shouldBlock() && !job.waitForCompletion(true)) {
+      throw new IOException("DistCp failure: Job " + jobID + " has failed: "
+          + job.getStatus().getFailureInfo());
     }
     return job;
   }