|
|
@@ -16,47 +16,34 @@ Apache Hadoop ${project.version}
|
|
|
================================
|
|
|
|
|
|
Apache Hadoop ${project.version} is a minor release in the 2.x.y release
|
|
|
-line, building upon the previous stable release 2.4.1.
|
|
|
+line, building upon the previous stable release 2.9.2.
|
|
|
|
|
|
Here is a short overview of the major features and improvements.
|
|
|
|
|
|
-* Common
|
|
|
-
|
|
|
- * Authentication improvements when using an HTTP proxy server. This is
|
|
|
- useful when accessing WebHDFS via a proxy server.
|
|
|
-
|
|
|
- * A new Hadoop metrics sink that allows writing directly to Graphite.
|
|
|
-
|
|
|
- * [Specification work](./hadoop-project-dist/hadoop-common/filesystem/index.html)
|
|
|
- related to the Hadoop Compatible Filesystem (HCFS) effort.
|
|
|
-
|
|
|
* HDFS
|
|
|
|
|
|
- * Support for POSIX-style filesystem extended attributes. See the
|
|
|
- [user documentation](./hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html)
|
|
|
- for more details.
|
|
|
-
|
|
|
- * Using the OfflineImageViewer, clients can now browse an fsimage via
|
|
|
- the WebHDFS API.
|
|
|
+ * Consistent reads from standby node. This allows better load balancing on HDFS
|
|
|
+ clusters, especially those with a high read/write operation ratio. See
|
|
|
+ [HDFS-12943](https://jira.apache.org/jira/browse/HDFS-12943) and
|
|
|
+ [HDFS-14204](https://jira.apache.org/jira/browse/HDFS-14204) for more details.
|
|
|
|
|
|
- * The NFS gateway received a number of supportability improvements and
|
|
|
- bug fixes. The Hadoop portmapper is no longer required to run the gateway,
|
|
|
- and the gateway is now able to reject connections from unprivileged ports.
|
|
|
+ * Improvements related to rolling upgrade support from 2.x to 3.x.
|
|
|
|
|
|
- * The SecondaryNameNode, JournalNode, and DataNode web UIs have been
|
|
|
- modernized with HTML5 and Javascript.
|
|
|
+ * NameNode port based selective encryption. This allows enforcing different security
|
|
|
+ constraints for different types of traffic. See [HDFS-13541](https://issues.apache.org/jira/browse/HDFS-13541)
|
|
|
+ for more details.
|
|
|
|
|
|
* YARN
|
|
|
|
|
|
- * YARN's REST APIs now support write/modify operations. Users can submit and
|
|
|
- kill applications through REST APIs.
|
|
|
-
|
|
|
- * The timeline store in YARN, used for storing generic and
|
|
|
- application-specific information for applications, supports authentication
|
|
|
- through Kerberos.
|
|
|
+ * Support for user-defined countable resource types beyond CPU and memory. This was
|
|
|
+ ported from the 3.x.y release line. See [YARN-3926](https://issues.apache.org/jira/browse/YARN-3926),
|
|
|
+ [YARN-8200](https://issues.apache.org/jira/browse/YARN-8200),
|
|
|
+ and the [YARN resource model documentation](./hadoop-yarn/hadoop-yarn-site/ResourceProfiles.html) for
|
|
|
+ more information.
|
|
|
|
|
|
- * The Fair Scheduler supports dynamic hierarchical user queues, user queues
|
|
|
- are created dynamically at runtime under any specified parent-queue.
|
|
|
+ * Native support for GPUs as a schedulable resource type. This builds on the above, and was also ported
|
|
|
+ from the 3.x.y release line. See [YARN-6223](https://issues.apache.org/jira/browse/YARN-6223) and
|
|
|
+ [YARN-8200](https://issues.apache.org/jira/browse/YARN-8200) for more information.
|
|
|
|
|
|
Getting Started
|
|
|
===============
|
Jonathan Hung