Hadoop 0.20.204.0 Release Notes

These release notes include new developer and user-facing incompatibilities, features, and major improvements.

Changes since Hadoop 0.20.203.0

Key Summary Component/s
MAPREDUCE-2558 Add queue-level metrics 0.20-security branch jobtracker
MAPREDUCE-2555 JvmInvalidate errors in the gridmix TT logs tasktracker
MAPREDUCE-2529 Recognize Jetty bug 1342 and handle it tasktracker
MAPREDUCE-2524 Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffle tasktracker
MAPREDUCE-2514 ReinitTrackerAction class name misspelled RenitTrackerAction in task tracker log tasktracker
MAPREDUCE-2495 The distributed cache cleanup thread has no monitoring to check to see if it has died for some reason distributed-cache
MAPREDUCE-2490 Log blacklist debug count jobtracker
MAPREDUCE-2479 Backport MAPREDUCE-1568 to hadoop security branch tasktracker
MAPREDUCE-2456 Show the reducer taskid and map/reduce tasktrackers for "Failed fetch notification #_ for task attempt..." log messages jobtracker
MAPREDUCE-2451 Log the reason string of healthcheck script jobtracker
MAPREDUCE-2447 Set JvmContext sooner for a task - MR2429  
MAPREDUCE-2443 Fix FI build - broken after MR-2429 test
MAPREDUCE-2429 Check jvmid during task status report tasktracker
MAPREDUCE-2418 Errors not shown in the JobHistory servlet (specifically Counter Limit Exceeded)  
MAPREDUCE-2415 Distribute TaskTracker userlogs onto multiple disks task-controller, tasktracker
MAPREDUCE-2413 TaskTracker should handle disk failures at both startup and runtime task-controller, tasktracker
MAPREDUCE-2411 When you submit a job to a queue with no ACLs you get an inscrutible NPE  
MAPREDUCE-2409 Distributed Cache does not differentiate between file /archive for files with the same path distributed-cache
MAPREDUCE-118 Job.getJobID() will always return null client
HDFS-2057 Wait time to terminate the threads causing unit tests to take longer time data-node
HDFS-2044 TestQueueProcessingStatistics failing automatic test due to timing issues test
HDFS-2023 Backport of NPE for File.list and File.listFiles data-node
HDFS-1878 TestHDFSServerPorts unit test failure - race condition in FSNamesystem.close() causes NullPointerException without serious consequence name-node
HDFS-1836 Thousand of CLOSE_WAIT socket hdfs client
HDFS-1822 Editlog opcodes overlap between 20 security and later releases name-node
HDFS-1773 Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude lists name-node
HDFS-1767 Namenode should ignore non-initial block reports from datanodes when in safemode during startup data-node
HDFS-1758 Web UI JSP pages thread safety issue tools
HDFS-1750 fs -ls hftp://file not working  
HDFS-1692 In secure mode, Datanode process doesn't exit when disks fail. data-node
HDFS-1592 Datanode startup doesn't honor volumes.tolerated  
HDFS-1541 Not marking datanodes dead When namenode in safemode name-node
HDFS-1445 HDFS-1443 Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file data-node
HDFS-1377 Quota bug for partial blocks allows quotas to be violated name-node
HDFS-1258 Clearing namespace quota on "/" corrupts FS image name-node
HDFS-1189 Quota counts missed between clear quota and set quota name-node
HADOOP-7398 create a mechanism to suppress the HADOOP_HOME deprecated warning  
HADOOP-7373 Tarball deployment doesn't work with {start,stop}-{dfs,mapred}  
HADOOP-7364 TestMiniMRDFSCaching fails if test.build.dir is set to something other than build/test test
HADOOP-7356 RPM packages broke bin/hadoop script for hadoop 0.20.205  
HADOOP-7330 The metrics source mbean implementation should return the attribute value instead of the object metrics
HADOOP-7277 Add Eclipse launch tasks for the 0.20-security branch build
HADOOP-7274 CLONE - IOUtils.readFully and IOUtils.skipFully have typo in exception creation's message util
HADOOP-7248 Have a way to automatically update Eclipse .classpath file when new libs are added to the classpath through Ivy for 0.20-* based sources build
HADOOP-7232 Fix javadoc warnings documentation
HADOOP-7144 Expose JMX with something like JMXProxyServlet  
HADOOP-6255 Create an rpm integration project  

Changes Since Hadoop 0.20.2