|
@@ -14,6 +14,10 @@ Trunk (Unreleased)
|
|
|
MAPREDUCE-4887. Add RehashPartitioner, to smooth distributions
|
|
|
with poor implementations of Object#hashCode(). (Radim Kolar via cutting)
|
|
|
|
|
|
+ HADOOP-8562. Enhancements to support Hadoop on Windows Server and Windows
|
|
|
+ Azure environments. (See breakdown of tasks below for subtasks and
|
|
|
+ contributors)
|
|
|
+
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for
|
|
@@ -71,6 +75,9 @@ Trunk (Unreleased)
|
|
|
MAPREDUCE-4735. Make arguments in TestDFSIO case insensitive.
|
|
|
(Brandon Li via suresh)
|
|
|
|
|
|
+ MAPREDUCE-5014. Extend Distcp to accept a custom CopyListing.
|
|
|
+ (Srikanth Sundarrajan via amareshwari)
|
|
|
+
|
|
|
BUG FIXES
|
|
|
|
|
|
MAPREDUCE-4272. SortedRanges.Range#compareTo is not spec compliant.
|
|
@@ -155,8 +162,29 @@ Trunk (Unreleased)
|
|
|
MAPREDUCE-5012. Typo in javadoc for IdentityMapper class. (Adam Monsen
|
|
|
via suresh)
|
|
|
|
|
|
- MAPREDUCE-5006. Fix failing streaming tests due to MAPREDUCE-4994.
|
|
|
- (Sandy Ryza via tomwhite)
|
|
|
+ MAPREDUCE-5078. TestMRAppMaster fails on Windows due to mismatched path
|
|
|
+ separators. (Chris Nauroth via sseth)
|
|
|
+
|
|
|
+ BREAKDOWN OF HADOOP-8562 SUBTASKS
|
|
|
+
|
|
|
+ MAPREDUCE-4739. Some MapReduce tests fail to find winutils.
|
|
|
+ (Chris Nauroth via suresh)
|
|
|
+
|
|
|
+ MAPREDUCE-4780. MapReduce distribution build fails on Windows.
|
|
|
+ (Chris Nauroth via suresh)
|
|
|
+
|
|
|
+ MAPREDUCE-4790. MapReduce build script would be more readable using abspath.
|
|
|
+ (Chris Nauroth via suresh)
|
|
|
+
|
|
|
+ MAPREDUCE-4869. Fix TestMapReduceChildJVM. (Chris Nauroth via acmurthy)
|
|
|
+
|
|
|
+ MAPREDUCE-4870. Fix TestMRJobsWithHistoryService. (Chris Nauroth via acmurthy)
|
|
|
+
|
|
|
+ MAPREDUCE-4983. Fixed various platform specific assumptions in various tests,
|
|
|
+ so that they can pass on Windows too. (Chris Nauroth via vinodkv)
|
|
|
+
|
|
|
+ HADOOP-9372. Fix bad timeout annotations on tests.
|
|
|
+ (Arpit Agarwal via suresh)
|
|
|
|
|
|
Release 2.0.5-alpha - UNRELEASED
|
|
|
|
|
@@ -196,6 +224,15 @@ Release 2.0.4-beta - UNRELEASED
|
|
|
MAPREDUCE-5033. mapred shell script should respect usage flags
|
|
|
(--help -help -h). (Andrew Wang via atm)
|
|
|
|
|
|
+ MAPREDUCE-4892. Modify CombineFileInputFormat to not skew input slits'
|
|
|
+ allocation on small clusters. (Bikas Saha via vinodkv)
|
|
|
+
|
|
|
+ MAPREDUCE-4990. Construct debug strings conditionally in
|
|
|
+ ShuffleHandler.Shuffle#sendMapOutput(). (kkambatl via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4875. coverage fixing for org.apache.hadoop.mapred
|
|
|
+ (Aleksey Gorshkov via bobby)
|
|
|
+
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
BUG FIXES
|
|
@@ -222,6 +259,36 @@ Release 2.0.4-beta - UNRELEASED
|
|
|
MAPREDUCE-5008. Merger progress miscounts with respect to EOF_MARKER.
|
|
|
(Sandy Ryza via tomwhite)
|
|
|
|
|
|
+ MAPREDUCE-4693. History server should include counters for failed tasks.
|
|
|
+ (Xuan Gong via sseth)
|
|
|
+
|
|
|
+ MAPREDUCE-4896. mapred queue -info spits out ugly exception when queue does
|
|
|
+ not exist. (sandyr via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-3685. Fix bugs in MergeManager to ensure compression codec is
|
|
|
+ appropriately used and that on-disk segments are correctly sorted on
|
|
|
+ file-size. (Anty Rao and Ravi Prakash via acmurthy)
|
|
|
+
|
|
|
+ MAPREDUCE-4571. TestHsWebServicesJobs fails on jdk7. (tgraves via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-4716. TestHsWebServicesJobsQuery.testJobsQueryStateInvalid
|
|
|
+ fails with jdk7. (tgraves via tucu)
|
|
|
+
|
|
|
+ MAPREDUCE-5075. DistCp leaks input file handles since ThrottledInputStream
|
|
|
+ does not close the wrapped InputStream. (Chris Nauroth via szetszwo)
|
|
|
+
|
|
|
+ MAPREDUCE-3872. Fix an event handling races in ContainerLauncherImpl.
|
|
|
+ (Robert Kanter via sseth)
|
|
|
+
|
|
|
+ MAPREDUCE-5083. MiniMRCluster should use a random component when creating an
|
|
|
+ actual cluster (Siddharth Seth via hitesh)
|
|
|
+
|
|
|
+ MAPREDUCE-5062. Fix MR AM to read max-retries from the RM. (Zhijie Shen via
|
|
|
+ vinodkv)
|
|
|
+
|
|
|
+ MAPREDUCE-5077. Remove mapreduce.util.ResourceCalculatorPlugin and related
|
|
|
+ code. (Karthik Kambatla via sseth)
|
|
|
+
|
|
|
MAPREDUCE-5117. Changed MRClientProtocolPBClientImpl to be closeable and thus
|
|
|
fix failures in renewal of HistoryServer's delegations tokens. (Siddharth
|
|
|
Seth via vinodkv)
|
|
@@ -232,6 +299,9 @@ Release 2.0.4-beta - UNRELEASED
|
|
|
MAPREDUCE-5138. Fix LocalDistributedCacheManager after YARN-112. (Omkar Vinit
|
|
|
Joshi via vinodkv)
|
|
|
|
|
|
+ MAPREDUCE-5006. Fix failing streaming tests due to MAPREDUCE-4994.
|
|
|
+ (Sandy Ryza via tomwhite)
|
|
|
+
|
|
|
Release 2.0.3-alpha - 2013-02-06
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
@@ -762,6 +832,12 @@ Release 0.23.7 - UNRELEASED
|
|
|
MAPREDUCE-4989. JSONify DataTables input data for Attempts page (Ravi
|
|
|
Prakash via jlowe)
|
|
|
|
|
|
+ MAPREDUCE-5027. Shuffle does not limit number of outstanding connections
|
|
|
+ (Robert Parker via jeagles)
|
|
|
+
|
|
|
+ MAPREDUCE-4972. Coverage fixing for org.apache.hadoop.mapreduce.jobhistory
|
|
|
+ (Aleksey Gorshkov via bobby)
|
|
|
+
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
MAPREDUCE-4946. Fix a performance problem for large jobs by reducing the
|
|
@@ -781,6 +857,28 @@ Release 0.23.7 - UNRELEASED
|
|
|
MAPREDUCE-5009. Killing the Task Attempt slated for commit does not clear
|
|
|
the value from the Task commitAttempt member (Robert Parker via jeagles)
|
|
|
|
|
|
+ MAPREDUCE-4871. AM uses mapreduce.jobtracker.split.metainfo.maxsize but
|
|
|
+ mapred-default has mapreduce.job.split.metainfo.maxsize (Jason Lowe via
|
|
|
+ jeagles)
|
|
|
+
|
|
|
+ MAPREDUCE-4794. DefaultSpeculator generates error messages on normal
|
|
|
+ shutdown (Jason Lowe via jeagles)
|
|
|
+
|
|
|
+ MAPREDUCE-5043. Fetch failure processing can cause AM event queue to
|
|
|
+ backup and eventually OOM (Jason Lowe via bobby)
|
|
|
+
|
|
|
+ MAPREDUCE-5023. History Server Web Services missing Job Counters (Ravi
|
|
|
+ Prakash via tgraves)
|
|
|
+
|
|
|
+ MAPREDUCE-5060. Fetch failures that time out only count against the first
|
|
|
+ map task (Robert Joseph Evans via jlowe)
|
|
|
+
|
|
|
+ MAPREDUCE-5042. Reducer unable to fetch for a map task that was recovered
|
|
|
+ (Jason Lowe via bobby)
|
|
|
+
|
|
|
+ MAPREDUCE-5053. java.lang.InternalError from decompression codec cause
|
|
|
+ reducer to fail (Robert Parker via jeagles)
|
|
|
+
|
|
|
MAPREDUCE-4991. coverage for gridmix (Aleksey Gorshkov via tgraves)
|
|
|
|
|
|
MAPREDUCE-5007. fix coverage org.apache.hadoop.mapreduce.v2.hs (Aleksey
|