|
|
@@ -1,6 +1,6 @@
|
|
|
Hadoop MapReduce Change Log
|
|
|
|
|
|
-Trunk (unreleased changes)
|
|
|
+Trunk (Unreleased)
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
@@ -126,83 +126,29 @@ Trunk (unreleased changes)
|
|
|
|
|
|
MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen)
|
|
|
|
|
|
-Branch-2 ( Unreleased changes )
|
|
|
+Release 2.0.3-alpha - Unreleased
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
- MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process
|
|
|
- command-line. (ahmed via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4417. add support for encrypted shuffle (tucu)
|
|
|
-
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
- MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved
|
|
|
- (Jason Lowe via bobby)
|
|
|
-
|
|
|
- MAPREDUCE-4511. Add IFile readahead (ahmed via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached
|
|
|
- (rkanter via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-2786. Add compression option for TestDFSIO.
|
|
|
- (Plamen Jeliazkov via shv)
|
|
|
+ OPTIMIZATIONS
|
|
|
|
|
|
BUG FIXES
|
|
|
|
|
|
- MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in
|
|
|
- YarnConfiguration. (ahmed via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager
|
|
|
- and JobHistoryServer ports. (ahmed via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4407. Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist
|
|
|
- package. (ahmed via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4465. Update description of yarn.nodemanager.address property.
|
|
|
- (bowang via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4342. Distributed Cache gives inconsistent result if cache files
|
|
|
- get deleted from tasktracker. (mayank_bansal via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default
|
|
|
- already exists!. (ahmed.radwan via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration.
|
|
|
- (ahmed.radwan via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name
|
|
|
- for compatibility reasons is creating incorrect counter name.
|
|
|
- (Jarek Jarcec Cecho via tomwhite)
|
|
|
-
|
|
|
- MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the
|
|
|
- classpath (rkanter via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4577. HDFS-3672 broke
|
|
|
- TestCombineFileInputFormat.testMissingBlocks() test. (atm)
|
|
|
-
|
|
|
- MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu)
|
|
|
-
|
|
|
- MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies.
|
|
|
- (tucu via tomwhite)
|
|
|
-
|
|
|
- MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in
|
|
|
- MR2. (tomwhite)
|
|
|
-
|
|
|
- MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby)
|
|
|
-
|
|
|
- MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu)
|
|
|
-
|
|
|
-Release 2.1.0-alpha - Unreleased
|
|
|
+Release 2.0.2-alpha - Unreleased
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
|
|
|
|
NEW FEATURES
|
|
|
|
|
|
+ MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process
|
|
|
+ command-line. (ahmed via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4417. add support for encrypted shuffle (tucu)
|
|
|
+
|
|
|
MAPREDUCE-4355. Add RunningJob.getJobStatus() (kkambatl via tucu)
|
|
|
|
|
|
MAPREDUCE-3451. Port Fair Scheduler to MR2 (pwendell via tucu)
|
|
|
@@ -212,6 +158,17 @@ Release 2.1.0-alpha - Unreleased
|
|
|
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
+ MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved
|
|
|
+ (Jason Lowe via bobby)
|
|
|
+
|
|
|
+ MAPREDUCE-4511. Add IFile readahead (ahmed via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached
|
|
|
+ (rkanter via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-2786. Add compression option for TestDFSIO.
|
|
|
+ (Plamen Jeliazkov via shv)
|
|
|
+
|
|
|
MAPREDUCE-4440. Changed SchedulerApp and SchedulerNode to be a minimal
|
|
|
interface to allow schedulers to maintain their own. (acmurthy)
|
|
|
|
|
|
@@ -256,10 +213,53 @@ Release 2.1.0-alpha - Unreleased
|
|
|
MAPREDUCE-4638. MR AM supplies MapReduce jars in classpath rather than
|
|
|
rely on YARN. (acmurthy)
|
|
|
|
|
|
- OPTIMIZATIONS
|
|
|
-
|
|
|
BUG FIXES
|
|
|
|
|
|
+ MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in
|
|
|
+ YarnConfiguration. (ahmed via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager
|
|
|
+ and JobHistoryServer ports. (ahmed via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4407. Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist
|
|
|
+ package. (ahmed via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4465. Update description of yarn.nodemanager.address property.
|
|
|
+ (bowang via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4342. Distributed Cache gives inconsistent result if cache files
|
|
|
+ get deleted from tasktracker. (mayank_bansal via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default
|
|
|
+ already exists!. (ahmed.radwan via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration.
|
|
|
+ (ahmed.radwan via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name
|
|
|
+ for compatibility reasons is creating incorrect counter name.
|
|
|
+ (Jarek Jarcec Cecho via tomwhite)
|
|
|
+
|
|
|
+ MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the
|
|
|
+ classpath (rkanter via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4577. HDFS-3672 broke
|
|
|
+ TestCombineFileInputFormat.testMissingBlocks() test. (atm)
|
|
|
+
|
|
|
+ MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies.
|
|
|
+ (tucu via tomwhite)
|
|
|
+
|
|
|
+ MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in
|
|
|
+ MR2. (tomwhite)
|
|
|
+
|
|
|
+ MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby)
|
|
|
+
|
|
|
+ MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu)
|
|
|
+
|
|
|
MAPREDUCE-4148. MapReduce should not have a compile-time dependency on
|
|
|
HDFS. (tomwhite)
|
|
|
|
Arun Murthy