|
@@ -5,23 +5,6 @@ Trunk (unreleased changes)
|
|
|
HDFS-395. DFS Scalability: Incremental block reports. (Tomasz Nykiel
|
|
|
via hairong)
|
|
|
|
|
|
- HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http
|
|
|
- access to HDFS. (szetszwo)
|
|
|
-
|
|
|
- HDFS-2317. Support read access to HDFS in webhdfs. (szetszwo)
|
|
|
-
|
|
|
- HDFS-2338. Add configuration option to enable/disable webhdfs.
|
|
|
- (jitendra via szetszwo)
|
|
|
-
|
|
|
- HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation
|
|
|
- tokens. (szetszwo)
|
|
|
-
|
|
|
- HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs.
|
|
|
- (szetszwo)
|
|
|
-
|
|
|
- HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
|
|
|
- (szetszwo)
|
|
|
-
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
HADOOP-7524 Change RPC to allow multiple protocols including multuple
|
|
@@ -45,12 +28,6 @@ Trunk (unreleased changes)
|
|
|
HDFS-2351 Change Namenode and Datanode to register each of their protocols
|
|
|
seperately. (Sanjay Radia)
|
|
|
|
|
|
- HDFS-2356. Support case insensitive query parameter names in webhdfs.
|
|
|
- (szetszwo)
|
|
|
-
|
|
|
- HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to
|
|
|
- hdfs-site.xml. (szetszwo)
|
|
|
-
|
|
|
HDFS-2355. Federation: enable using the same configuration file across
|
|
|
all the nodes in the cluster. (suresh)
|
|
|
|
|
@@ -58,9 +35,6 @@ Trunk (unreleased changes)
|
|
|
|
|
|
HDFS-2158. Add JournalSet to manage the set of journals. (jitendra)
|
|
|
|
|
|
- HDFS-2395. Add a root element in the JSON responses of webhdfs.
|
|
|
- (szetszwo)
|
|
|
-
|
|
|
HDFS-2459. Separate datatypes for JournalProtocol. (suresh)
|
|
|
|
|
|
HDFS-2480. Separate datatypes for NamenodeProtocol. (suresh)
|
|
@@ -72,16 +46,11 @@ Trunk (unreleased changes)
|
|
|
HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be
|
|
|
fetched. (tucu)
|
|
|
|
|
|
- HDFS-2427. Change the default permission in webhdfs to 755 and add range
|
|
|
- check/validation for all parameters. (szetszwo)
|
|
|
-
|
|
|
HDFS-2489. Move Finalize and Register to separate file out of
|
|
|
DatanodeCommand.java. (suresh)
|
|
|
|
|
|
HDFS-2488. Separate datatypes for InterDatanodeProtocol. (suresh)
|
|
|
|
|
|
- HDFS-2501. Add version prefix and root methods to webhdfs. (szetszwo)
|
|
|
-
|
|
|
BUG FIXES
|
|
|
HDFS-2287. TestParallelRead has a small off-by-one bug. (todd)
|
|
|
|
|
@@ -94,12 +63,6 @@ Trunk (unreleased changes)
|
|
|
|
|
|
HDFS-2314. MRV1 test compilation broken after HDFS-2197 (todd)
|
|
|
|
|
|
- HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK
|
|
|
- version < 1.6.0_26. (Abhijit Suresh Shingate via szetszwo)
|
|
|
-
|
|
|
- HDFS-2333. Change DFSOutputStream back to package private, otherwise,
|
|
|
- there are two SC_START_IN_CTOR findbugs warnings. (szetszwo)
|
|
|
-
|
|
|
HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector,
|
|
|
IOExceptions of stream closures can mask root exceptions. (Uma Maheswara
|
|
|
Rao G via szetszwo)
|
|
@@ -107,61 +70,23 @@ Trunk (unreleased changes)
|
|
|
HDFS-46. Change default namespace quota of root directory from
|
|
|
Integer.MAX_VALUE to Long.MAX_VALUE. (Uma Maheswara Rao G via szetszwo)
|
|
|
|
|
|
- HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction.
|
|
|
- (szetszwo)
|
|
|
-
|
|
|
HDFS-2373. Commands using webhdfs and hftp print unnecessary debug
|
|
|
info on the console with security enabled. (Arpit Gupta via suresh)
|
|
|
|
|
|
- HDFS-2361. hftp is broken, fixed username checks in JspHelper. (jitendra)
|
|
|
-
|
|
|
HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to
|
|
|
not include multiple methods of the same name. (cutting)
|
|
|
|
|
|
- HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use
|
|
|
- the renewer parameter. (szetszwo)
|
|
|
-
|
|
|
- HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. (jitendra)
|
|
|
-
|
|
|
- HDFS-2404. webhdfs liststatus json response is not correct. (suresh)
|
|
|
-
|
|
|
HDFS-2349. Corruption detected during block transfers between DNs
|
|
|
should log a WARN instead of INFO. (harsh)
|
|
|
|
|
|
- HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in
|
|
|
- webhdfs responses. (szetszwo)
|
|
|
-
|
|
|
- HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException
|
|
|
- to IllegalArgumentException and response it as http BAD_REQUEST in webhdfs.
|
|
|
- (szetszwo)
|
|
|
-
|
|
|
- HDFS-2424. Added a root element "HdfsFileStatuses" for the response
|
|
|
- of webhdfs listStatus. (szetszwo)
|
|
|
-
|
|
|
- MAPREDUCE-2764. Fix renewal of dfs delegation tokens. (Owen via jitendra)
|
|
|
-
|
|
|
- HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing
|
|
|
- file or creating a file without specifying the replication parameter.
|
|
|
- (szetszwo)
|
|
|
-
|
|
|
HDFS-2188. Make FSEditLog create its journals from a list of URIs rather
|
|
|
than NNStorage. (Ivan Kelly via jitendra)
|
|
|
|
|
|
- HDFS-2453. Fix http response code for partial content in webhdfs, added
|
|
|
- getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem
|
|
|
- and cleared content type in ExceptionHandler. (szetszwo)
|
|
|
-
|
|
|
HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol.
|
|
|
(sanjay)
|
|
|
|
|
|
HDFS-2497 Fix TestBackupNode failure. (suresh)
|
|
|
|
|
|
- HDFS-2411. The the auth to local mappings are not being respected, with
|
|
|
- webhdfs enabled. (jitendra)
|
|
|
-
|
|
|
- HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods.
|
|
|
- (Uma Maheswara Rao G via szetszwo)
|
|
|
-
|
|
|
Release 0.23.0 - Unreleased
|
|
|
|
|
|
INCOMPATIBLE CHANGES
|
|
@@ -468,6 +393,23 @@ Release 0.23.0 - Unreleased
|
|
|
HDFS-2202. Add a new DFSAdmin command to set balancer bandwidth of
|
|
|
datanodes without restarting. (Eric Payne via szetszwo)
|
|
|
|
|
|
+ HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http
|
|
|
+ access to HDFS. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2317. Support read access to HDFS in webhdfs. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2338. Add configuration option to enable/disable webhdfs.
|
|
|
+ (jitendra via szetszwo)
|
|
|
+
|
|
|
+ HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation
|
|
|
+ tokens. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs.
|
|
|
+ (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
|
|
|
+ (szetszwo)
|
|
|
+
|
|
|
IMPROVEMENTS
|
|
|
|
|
|
HDFS-1875. MiniDFSCluster hard-codes dfs.datanode.address to localhost
|
|
@@ -863,6 +805,20 @@ Release 0.23.0 - Unreleased
|
|
|
HDFS-2485. Improve code layout and constants in UnderReplicatedBlocks
|
|
|
(stevel)
|
|
|
|
|
|
+ HDFS-2356. Support case insensitive query parameter names in webhdfs.
|
|
|
+ (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to
|
|
|
+ hdfs-site.xml. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2395. Add a root element in the JSON responses of webhdfs.
|
|
|
+ (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2427. Change the default permission in webhdfs to 755 and add range
|
|
|
+ check/validation for all parameters. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2501. Add version prefix and root methods to webhdfs. (szetszwo)
|
|
|
+
|
|
|
OPTIMIZATIONS
|
|
|
|
|
|
HDFS-1458. Improve checkpoint performance by avoiding unnecessary image
|
|
@@ -1198,6 +1154,50 @@ Release 0.23.0 - Unreleased
|
|
|
HDFS-2467. HftpFileSystem uses incorrect compare for finding delegation
|
|
|
tokens. (omalley)
|
|
|
|
|
|
+ HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK
|
|
|
+ version < 1.6.0_26. (Abhijit Suresh Shingate via szetszwo)
|
|
|
+
|
|
|
+ HDFS-2333. Change DFSOutputStream back to package private, otherwise,
|
|
|
+ there are two SC_START_IN_CTOR findbugs warnings. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction.
|
|
|
+ (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2361. hftp is broken, fixed username checks in JspHelper. (jitendra)
|
|
|
+
|
|
|
+ HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use
|
|
|
+ the renewer parameter. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. (jitendra)
|
|
|
+
|
|
|
+ HDFS-2404. webhdfs liststatus json response is not correct. (suresh)
|
|
|
+
|
|
|
+ HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in
|
|
|
+ webhdfs responses. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException
|
|
|
+ to IllegalArgumentException and response it as http BAD_REQUEST in webhdfs.
|
|
|
+ (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2424. Added a root element "HdfsFileStatuses" for the response
|
|
|
+ of webhdfs listStatus. (szetszwo)
|
|
|
+
|
|
|
+ MAPREDUCE-2764. Fix renewal of dfs delegation tokens. (Owen via jitendra)
|
|
|
+
|
|
|
+ HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing
|
|
|
+ file or creating a file without specifying the replication parameter.
|
|
|
+ (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2453. Fix http response code for partial content in webhdfs, added
|
|
|
+ getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem
|
|
|
+ and cleared content type in ExceptionHandler. (szetszwo)
|
|
|
+
|
|
|
+ HDFS-2411. The the auth to local mappings are not being respected, with
|
|
|
+ webhdfs enabled. (jitendra)
|
|
|
+
|
|
|
+ HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods.
|
|
|
+ (Uma Maheswara Rao G via szetszwo)
|
|
|
+
|
|
|
BREAKDOWN OF HDFS-1073 SUBTASKS
|
|
|
|
|
|
HDFS-1521. Persist transaction ID on disk between NN restarts.
|