|
@@ -15,7 +15,7 @@
|
|
|
Apache Hadoop ${project.version}
|
|
Apache Hadoop ${project.version}
|
|
|
================================
|
|
================================
|
|
|
|
|
|
|
|
-Apache Hadoop ${project.version} is an update to the Hadoop 3.3.x release branch.
|
|
|
|
|
|
|
+Apache Hadoop ${project.version} is an update to the Hadoop 3.4.x release branch.
|
|
|
|
|
|
|
|
Overview of Changes
|
|
Overview of Changes
|
|
|
===================
|
|
===================
|
|
@@ -23,6 +23,29 @@ Overview of Changes
|
|
|
Users are encouraged to read the full set of release notes.
|
|
Users are encouraged to read the full set of release notes.
|
|
|
This page provides an overview of the major changes.
|
|
This page provides an overview of the major changes.
|
|
|
|
|
|
|
|
|
|
+DataNode FsDatasetImpl Fine-Grained Locking via BlockPool
|
|
|
|
|
+----------------------------------------
|
|
|
|
|
+[HDFS-15180](https://issues.apache.org/jira/browse/HDFS-15180) Split FsDatasetImpl datasetLock via blockpool to solve the issue of heavy FsDatasetImpl datasetLock
|
|
|
|
|
+When there are many namespaces in a large cluster.
|
|
|
|
|
+
|
|
|
|
|
+YARN Federation improvements
|
|
|
|
|
+----------------------------------------
|
|
|
|
|
+[YARN-5597](https://issues.apache.org/jira/browse/YARN-5597) brings many improvements, including the following:
|
|
|
|
|
+
|
|
|
|
|
+1. YARN Router now boasts a full implementation of all relevant interfaces including the ApplicationClientProtocol, ResourceManagerAdministrationProtocol, and RMWebServiceProtocol.
|
|
|
|
|
+2. Enhanced support for Application cleanup and automatic offline mechanisms for SubCluster are now facilitated by the YARN Router.
|
|
|
|
|
+3. Code optimization for Router and AMRMProxy was undertaken, coupled with improvements to previously pending functionalities.
|
|
|
|
|
+4. Audit logs and Metrics for Router received upgrades.
|
|
|
|
|
+5. A boost in cluster security features was achieved, with the inclusion of Kerberos support.
|
|
|
|
|
+6. The page function of the router has been enhanced.
|
|
|
|
|
+
|
|
|
|
|
+Upgrade AWS SDK to V2
|
|
|
|
|
+----------------------------------------
|
|
|
|
|
+[HADOOP-18073](https://issues.apache.org/jira/browse/HADOOP-18073)
|
|
|
|
|
+The S3A connector now uses the V2 AWS SDK. This is a significant change at the source code level.
|
|
|
|
|
+Any applications using the internal extension/override points in the filesystem connector are likely to break.
|
|
|
|
|
+Consult the document aws\_sdk\_upgrade for the full details.
|
|
|
|
|
+
|
|
|
Azure ABFS: Critical Stream Prefetch Fix
|
|
Azure ABFS: Critical Stream Prefetch Fix
|
|
|
----------------------------------------
|
|
----------------------------------------
|
|
|
|
|
|
slfan1989