Ver Fonte

HADOOP-1281. Kill map-tasks when the parent TaskInProgress has been completed by another (possibly speculative) map-task. This ensures that map-slots are not needlessly held-up.

git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk@597109 13f79535-47bb-0310-9956-ffa450edef68
Arun Murthy há 18 anos atrás
pai
commit
357d1a2184
2 ficheiros alterados com 5 adições e 2 exclusões
  1. 4 0
      CHANGES.txt
  2. 1 2
      src/java/org/apache/hadoop/mapred/TaskInProgress.java

+ 4 - 0
CHANGES.txt

@@ -115,6 +115,10 @@ Trunk (unreleased changes)
     HADOOP-2078. An zero size file may have no blocks associated with it.
     (Konstantin Shvachko via dhruba)
 
+    HADOOP-1281. Kill map-tasks when the parent TaskInProgress has been 
+    completed by another (possibly speculative) map-task. This ensures that 
+    map-slots are not needlessly held-up. (acmurthy)
+
 
 Release 0.15.1 - 2007-11-27
 

+ 1 - 2
src/java/org/apache/hadoop/mapred/TaskInProgress.java

@@ -330,8 +330,7 @@ class TaskInProgress {
         (job.getStatus().getRunState() != JobStatus.RUNNING)) {
       tasksReportedClosed.add(taskid);
       return true;
-    } else if (!isMapTask() && isComplete() && 
-               !tasksReportedClosed.contains(taskid)){
+    } else if (isComplete() && !tasksReportedClosed.contains(taskid)) {
       tasksReportedClosed.add(taskid);
       return true; 
     } else {