Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299417 13f79535-47bb-0310-9956-ffa450edef68

hadoop-common-project/hadoop-common/CHANGES.txt

@@ -9,11 +9,6 @@ Trunk (unreleased changes)
 
   NEW FEATURES
     
-    HADOOP-7454. Common side of High Availability Framework (HDFS-1623)
-    Contributed by Todd Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G,
-    Bikas Saha, Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li,
-    Sanjay Radia, Mingjie Lai, and Gregory Chanan
-
     HADOOP-8135. Add ByteBufferReadable interface to FSDataInputStream. (Henry
     Robinson via atm)
 
@@ -109,58 +104,6 @@ Trunk (unreleased changes)
 
     HADOOP-7761. Improve the performance of raw comparisons. (todd)
 
-  BREAKDOWN OF HADOOP-7454 SUBTASKS
-
-    HADOOP-7455. HA: Introduce HA Service Protocol Interface. (suresh)
-    
-    HADOOP-7774. HA: Administrative CLI to control HA daemons. (todd)
-    
-    HADOOP-7896. HA: if both NNs are in Standby mode, client needs to try failing
-    back and forth several times with sleeps. (atm)
-    
-    HADOOP-7922. Improve some logging for client IPC failovers and
-    StandbyExceptions (todd)
-    
-    HADOOP-7921. StandbyException should extend IOException (todd)
-    
-    HADOOP-7928. HA: Client failover policy is incorrectly trying to fail over all
-    IOExceptions (atm)
-    
-    HADOOP-7925. Add interface and update CLI to query current state to
-    HAServiceProtocol (eli via todd)
-    
-    HADOOP-7932. Make client connection retries on socket time outs configurable.
-    (Uma Maheswara Rao G via todd)
-    
-    HADOOP-7924. FailoverController for client-based configuration (eli)
-    
-    HADOOP-7961. Move HA fencing to common. (eli)
-    
-    HADOOP-7970. HAServiceProtocol methods must throw IOException.  (Hari Mankude
-    via suresh).
-    
-    HADOOP-7992. Add ZKClient library to facilitate leader election.  (Bikas Saha
-    via suresh).
-    
-    HADOOP-7983. HA: failover should be able to pass args to fencers. (eli)
-    
-    HADOOP-7938. HA: the FailoverController should optionally fence the active
-    during failover. (eli)
-    
-    HADOOP-7991. HA: the FailoverController should check the standby is ready
-    before failing over. (eli)
-    
-    HADOOP-8038. Add 'ipc.client.connect.max.retries.on.timeouts' entry in
-    core-default.xml file. (Uma Maheswara Rao G via atm)
-    
-    HADOOP-8041. Log a warning when a failover is first attempted (todd)
-    
-    HADOOP-8068. void methods can swallow exceptions when going through failover
-    path (todd)
-    
-    HADOOP-8116. RetriableCommand is using RetryPolicy incorrectly after
-    HADOOP-7896. (atm)
-
 Release 0.23.3 - UNRELEASED 
 
   INCOMPATIBLE CHANGES
@@ -175,6 +118,11 @@ Release 0.23.3 - UNRELEASED
     HADOOP-7875. Add helper class to unwrap protobuf ServiceException.
     (suresh)
 
+    HADOOP-7454. Common side of High Availability Framework (HDFS-1623)
+    Contributed by Todd Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G,
+    Bikas Saha, Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li,
+    Sanjay Radia, Mingjie Lai, and Gregory Chanan
+
   IMPROVEMENTS
 
     HADOOP-7524. Change RPC to allow multiple protocols including multuple
@@ -278,6 +226,58 @@ Release 0.23.3 - UNRELEASED
     HADOOP-8154. DNS#getIPs shouldn't silently return the local host
     IP for bogus interface names. (eli)
 
+  BREAKDOWN OF HADOOP-7454 SUBTASKS
+
+    HADOOP-7455. HA: Introduce HA Service Protocol Interface. (suresh)
+    
+    HADOOP-7774. HA: Administrative CLI to control HA daemons. (todd)
+    
+    HADOOP-7896. HA: if both NNs are in Standby mode, client needs to try failing
+    back and forth several times with sleeps. (atm)
+    
+    HADOOP-7922. Improve some logging for client IPC failovers and
+    StandbyExceptions (todd)
+    
+    HADOOP-7921. StandbyException should extend IOException (todd)
+    
+    HADOOP-7928. HA: Client failover policy is incorrectly trying to fail over all
+    IOExceptions (atm)
+    
+    HADOOP-7925. Add interface and update CLI to query current state to
+    HAServiceProtocol (eli via todd)
+    
+    HADOOP-7932. Make client connection retries on socket time outs configurable.
+    (Uma Maheswara Rao G via todd)
+    
+    HADOOP-7924. FailoverController for client-based configuration (eli)
+    
+    HADOOP-7961. Move HA fencing to common. (eli)
+    
+    HADOOP-7970. HAServiceProtocol methods must throw IOException.  (Hari Mankude
+    via suresh).
+    
+    HADOOP-7992. Add ZKClient library to facilitate leader election.  (Bikas Saha
+    via suresh).
+    
+    HADOOP-7983. HA: failover should be able to pass args to fencers. (eli)
+    
+    HADOOP-7938. HA: the FailoverController should optionally fence the active
+    during failover. (eli)
+    
+    HADOOP-7991. HA: the FailoverController should check the standby is ready
+    before failing over. (eli)
+    
+    HADOOP-8038. Add 'ipc.client.connect.max.retries.on.timeouts' entry in
+    core-default.xml file. (Uma Maheswara Rao G via atm)
+    
+    HADOOP-8041. Log a warning when a failover is first attempted (todd)
+    
+    HADOOP-8068. void methods can swallow exceptions when going through failover
+    path (todd)
+    
+    HADOOP-8116. RetriableCommand is using RetryPolicy incorrectly after
+    HADOOP-7896. (atm)
+
 Release 0.23.2 - UNRELEASED 
 
   INCOMPATIBLE CHANGES

hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

@@ -11,11 +11,6 @@ Trunk (unreleased changes)
     HDFS-234. Integration with BookKeeper logging system. (Ivan Kelly 
     via jitendra)
 
-    HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd
-    Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha,
-    Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay
-    Radia, Mingjie Lai, and Gregory Chanan
-
   IMPROVEMENTS
 
     HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants ->
@@ -94,6 +89,201 @@ Trunk (unreleased changes)
 
     HDFS-2966 TestNameNodeMetrics tests can fail under load. (stevel)
 
+Release 0.23.3 - UNRELEASED 
+
+  INCOMPATIBLE CHANGES
+
+    HDFS-2676. Remove Avro RPC. (suresh)
+
+  NEW FEATURES
+
+    HDFS-2978. The NameNode should expose name dir statuses via JMX. (atm)
+
+    HDFS-395.  DFS Scalability: Incremental block reports. (Tomasz Nykiel
+    via hairong)
+
+    HDFS-2517. Add protobuf service for JounralProtocol. (suresh)
+
+    HDFS-2518. Add protobuf service for NamenodeProtocol. (suresh)
+
+    HDFS-2520. Add protobuf service for InterDatanodeProtocol. (suresh)
+
+    HDFS-2519. Add protobuf service for DatanodeProtocol. (suresh)
+
+    HDFS-2581. Implement protobuf service for JournalProtocol. (suresh)
+
+    HDFS-2618. Implement protobuf service for NamenodeProtocol. (suresh)
+
+    HDFS-2629. Implement protobuf service for InterDatanodeProtocol. (suresh)
+
+    HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. (suresh)
+
+    HDFS-2642. Protobuf translators for DatanodeProtocol. (jitendra)
+
+    HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, 
+    ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. (suresh)
+
+    HDFS-2661. Enable protobuf RPC for DatanodeProtocol. (jitendra)
+
+    HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings 
+    protocol to protocol buffers. (jitendra)
+
+    HDFS-2880. Protobuf changes in DatanodeProtocol to add multiple storages.
+    (suresh)
+
+    HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple 
+    storages. (suresh)
+
+    HDFS-2430. The number of failed or low-resource volumes the NN can tolerate
+    should be configurable. (atm)
+
+    HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd
+    Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha,
+    Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay
+    Radia, Mingjie Lai, and Gregory Chanan
+
+  IMPROVEMENTS
+
+    HDFS-2018. Move all journal stream management code into one place.
+    (Ivan Kelly via jitendra)
+
+    HDFS-2223. Untangle depencencies between NN components (todd)
+
+    HDFS-2351. Change Namenode and Datanode to register each of their protocols
+    seperately (sanjay)
+
+    HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm)
+ 
+    HDFS-2181. Separate HDFS Client wire protocol data types (sanjay)
+
+    HDFS-2459. Separate datatypes for Journal Protocol. (suresh)
+
+    HDFS-2480. Separate datatypes for NamenodeProtocol. (suresh)
+
+    HDFS-2489. Move Finalize and Register to separate file out of
+    DatanodeCommand.java. (suresh)
+
+    HDFS-2488. Separate datatypes for InterDatanodeProtocol. (suresh)
+
+    HDFS-2496. Separate datatypes for DatanodeProtocol. (suresh)
+
+    HDFS-2479. HDFS Client Data Types in Protocol Buffers (sanjay)
+
+    HADOOP-7862. Hdfs changes to work with HADOOP-7862: Move the support for
+    multiple protocols to lower layer so that Writable, PB and Avro can all
+    use it. (sanjay)
+
+    HDFS-2597. ClientNameNodeProtocol in Protocol Buffers. (sanjay)
+
+    HDFS-2651. ClientNameNodeProtocol Translators for Protocol Buffers. (sanjay)
+
+    HDFS-2650. Replace @inheritDoc with @Override. (Hari Mankude via suresh).
+
+    HDFS-2669. Enable protobuf rpc for ClientNamenodeProtocol. (sanjay)
+
+    HDFS-2801. Provide a method in client side translators to check for a 
+    methods supported in underlying protocol. (jitendra)
+
+    HDFS-2895. Remove Writable wire protocol types and translators to
+    complete transition to protocol buffers. (suresh)
+
+    HDFS-2992. Edit log failure trace should include transaction ID of
+    error.  (Colin Patrick McCabe via eli)
+
+    HDFS-2507. Allow saveNamespace operations to be canceled. (todd)
+
+    HDFS-2410. Further cleanup of hardcoded configuration keys and values.
+    (suresh)
+
+    HDFS-208. name node should warn if only one dir is listed in dfs.name.dir.
+    (Uma Maheswara Rao G via eli)
+
+    HDFS-3003. Remove getHostPortString() from NameNode, replace it with
+    NetUtils.getHostPortString(). (Brandon Li via atm)
+
+    HDFS-3014. FSEditLogOp and its subclasses should have toString() method.
+    (Sho Shimauchi via atm)
+
+    HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. (atm)
+
+    HDFS-2158. Add JournalSet to manage the set of journals. (jitendra)
+
+    HDFS-2334. Add Closeable to JournalManager. (Ivan Kelly via jitendra)
+
+    HDFS-1580. Add interface for generic Write Ahead Logging mechanisms.
+    (Ivan Kelly via jitendra)
+
+    HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout (eli)
+
+    HDFS-3021. Use generic type to declare FSDatasetInterface.  (szetszwo)
+
+    HDFS-3056.  Add a new interface RollingLogs for DataBlockScanner logging.
+    (szetszwo)
+
+  OPTIMIZATIONS
+
+    HDFS-3024. Improve performance of stringification in addStoredBlock (todd)
+
+    HDFS-2477. Optimize computing the diff between a block report and the
+    namenode state. (Tomasz Nykiel via hairong)
+
+    HDFS-2495. Increase granularity of write operations in ReplicationMonitor
+    thus reducing contention for write lock. (Tomasz Nykiel via hairong)
+
+    HDFS-2476. More CPU efficient data structure for under-replicated,
+    over-replicated, and invalidated blocks. (Tomasz Nykiel via todd)
+
+  BUG FIXES
+
+    HDFS-2481. Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol.
+    (sanjay)
+
+    HDFS-2497. Fix TestBackupNode failure. (suresh)
+
+    HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459.
+    (suresh)
+
+    HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a
+    reference to rpcProxyWithoutRetry (atm)
+
+    HDFS-2532. TestDfsOverAvroRpc timing out in trunk (Uma Maheswara Rao G
+    via todd)
+
+    HDFS-2666. Fix TestBackupNode failure. (suresh)
+
+    HDFS-2663. Optional protobuf parameters are not handled correctly. (suresh)
+
+    HDFS-2694. Removal of Avro broke non-PB NN services. (atm)
+
+    HDFS-2687. Tests failing with ClassCastException post protobuf RPC
+    changes. (suresh)
+
+    HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk
+    (Uma Maheswara Rao G via todd)
+
+    HDFS-2739. SecondaryNameNode doesn't start up. (jitendra)
+
+    HDFS-2768. BackupNode stop can not close proxy connections because
+    it is not a proxy instance. (Uma Maheswara Rao G via eli)
+
+    HDFS-2968. Protocol translator for BlockRecoveryCommand broken when
+    multiple blocks need recovery. (todd)
+
+    HDFS-3020. Fix editlog to automatically sync when buffer is full. (todd)
+
+    HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. (todd via atm)
+
+    HDFS-2285. BackupNode should reject requests to modify namespace.
+    (shv and Uma Maheswara Rao)
+
+    HDFS-2764. TestBackupNode is racy. (atm)
+
+    HDFS-2188. Make FSEditLog create its journals from a list of URIs rather 
+    than NNStorage. (Ivan Kelly via jitendra)
+
+    HDFS-1765. Block Replication should respect under-replication
+    block priority. (Uma Maheswara Rao G via eli)
+
   BREAKDOWN OF HDFS-1623 SUBTASKS
 
     HDFS-2179. Add fencing framework and mechanisms for NameNode HA. (todd)
@@ -410,196 +600,6 @@ Trunk (unreleased changes)
     
     HDFS-3039. Address findbugs and javadoc warnings on branch. (todd via atm)
 
-Release 0.23.3 - UNRELEASED 
-
-  INCOMPATIBLE CHANGES
-
-    HDFS-2676. Remove Avro RPC. (suresh)
-
-  NEW FEATURES
-
-    HDFS-2978. The NameNode should expose name dir statuses via JMX. (atm)
-
-    HDFS-395.  DFS Scalability: Incremental block reports. (Tomasz Nykiel
-    via hairong)
-
-    HDFS-2517. Add protobuf service for JounralProtocol. (suresh)
-
-    HDFS-2518. Add protobuf service for NamenodeProtocol. (suresh)
-
-    HDFS-2520. Add protobuf service for InterDatanodeProtocol. (suresh)
-
-    HDFS-2519. Add protobuf service for DatanodeProtocol. (suresh)
-
-    HDFS-2581. Implement protobuf service for JournalProtocol. (suresh)
-
-    HDFS-2618. Implement protobuf service for NamenodeProtocol. (suresh)
-
-    HDFS-2629. Implement protobuf service for InterDatanodeProtocol. (suresh)
-
-    HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. (suresh)
-
-    HDFS-2642. Protobuf translators for DatanodeProtocol. (jitendra)
-
-    HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, 
-    ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. (suresh)
-
-    HDFS-2661. Enable protobuf RPC for DatanodeProtocol. (jitendra)
-
-    HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings 
-    protocol to protocol buffers. (jitendra)
-
-    HDFS-2880. Protobuf changes in DatanodeProtocol to add multiple storages.
-    (suresh)
-
-    HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple 
-    storages. (suresh)
-
-    HDFS-2430. The number of failed or low-resource volumes the NN can tolerate
-    should be configurable. (atm)
-
-  IMPROVEMENTS
-
-    HDFS-2018. Move all journal stream management code into one place.
-    (Ivan Kelly via jitendra)
-
-    HDFS-2223. Untangle depencencies between NN components (todd)
-
-    HDFS-2351. Change Namenode and Datanode to register each of their protocols
-    seperately (sanjay)
-
-    HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm)
- 
-    HDFS-2181. Separate HDFS Client wire protocol data types (sanjay)
-
-    HDFS-2459. Separate datatypes for Journal Protocol. (suresh)
-
-    HDFS-2480. Separate datatypes for NamenodeProtocol. (suresh)
-
-    HDFS-2489. Move Finalize and Register to separate file out of
-    DatanodeCommand.java. (suresh)
-
-    HDFS-2488. Separate datatypes for InterDatanodeProtocol. (suresh)
-
-    HDFS-2496. Separate datatypes for DatanodeProtocol. (suresh)
-
-    HDFS-2479. HDFS Client Data Types in Protocol Buffers (sanjay)
-
-    HADOOP-7862. Hdfs changes to work with HADOOP-7862: Move the support for
-    multiple protocols to lower layer so that Writable, PB and Avro can all
-    use it. (sanjay)
-
-    HDFS-2597. ClientNameNodeProtocol in Protocol Buffers. (sanjay)
-
-    HDFS-2651. ClientNameNodeProtocol Translators for Protocol Buffers. (sanjay)
-
-    HDFS-2650. Replace @inheritDoc with @Override. (Hari Mankude via suresh).
-
-    HDFS-2669. Enable protobuf rpc for ClientNamenodeProtocol. (sanjay)
-
-    HDFS-2801. Provide a method in client side translators to check for a 
-    methods supported in underlying protocol. (jitendra)
-
-    HDFS-2895. Remove Writable wire protocol types and translators to
-    complete transition to protocol buffers. (suresh)
-
-    HDFS-2992. Edit log failure trace should include transaction ID of
-    error.  (Colin Patrick McCabe via eli)
-
-    HDFS-2507. Allow saveNamespace operations to be canceled. (todd)
-
-    HDFS-2410. Further cleanup of hardcoded configuration keys and values.
-    (suresh)
-
-    HDFS-208. name node should warn if only one dir is listed in dfs.name.dir.
-    (Uma Maheswara Rao G via eli)
-
-    HDFS-3003. Remove getHostPortString() from NameNode, replace it with
-    NetUtils.getHostPortString(). (Brandon Li via atm)
-
-    HDFS-3014. FSEditLogOp and its subclasses should have toString() method.
-    (Sho Shimauchi via atm)
-
-    HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. (atm)
-
-    HDFS-2158. Add JournalSet to manage the set of journals. (jitendra)
-
-    HDFS-2334. Add Closeable to JournalManager. (Ivan Kelly via jitendra)
-
-    HDFS-1580. Add interface for generic Write Ahead Logging mechanisms.
-    (Ivan Kelly via jitendra)
-
-    HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout (eli)
-
-    HDFS-3021. Use generic type to declare FSDatasetInterface.  (szetszwo)
-
-    HDFS-3056.  Add a new interface RollingLogs for DataBlockScanner logging.
-    (szetszwo)
-
-  OPTIMIZATIONS
-
-    HDFS-3024. Improve performance of stringification in addStoredBlock (todd)
-
-    HDFS-2477. Optimize computing the diff between a block report and the
-    namenode state. (Tomasz Nykiel via hairong)
-
-    HDFS-2495. Increase granularity of write operations in ReplicationMonitor
-    thus reducing contention for write lock. (Tomasz Nykiel via hairong)
-
-    HDFS-2476. More CPU efficient data structure for under-replicated,
-    over-replicated, and invalidated blocks. (Tomasz Nykiel via todd)
-
-  BUG FIXES
-
-    HDFS-2481. Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol.
-    (sanjay)
-
-    HDFS-2497. Fix TestBackupNode failure. (suresh)
-
-    HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459.
-    (suresh)
-
-    HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a
-    reference to rpcProxyWithoutRetry (atm)
-
-    HDFS-2532. TestDfsOverAvroRpc timing out in trunk (Uma Maheswara Rao G
-    via todd)
-
-    HDFS-2666. Fix TestBackupNode failure. (suresh)
-
-    HDFS-2663. Optional protobuf parameters are not handled correctly. (suresh)
-
-    HDFS-2694. Removal of Avro broke non-PB NN services. (atm)
-
-    HDFS-2687. Tests failing with ClassCastException post protobuf RPC
-    changes. (suresh)
-
-    HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk
-    (Uma Maheswara Rao G via todd)
-
-    HDFS-2739. SecondaryNameNode doesn't start up. (jitendra)
-
-    HDFS-2768. BackupNode stop can not close proxy connections because
-    it is not a proxy instance. (Uma Maheswara Rao G via eli)
-
-    HDFS-2968. Protocol translator for BlockRecoveryCommand broken when
-    multiple blocks need recovery. (todd)
-
-    HDFS-3020. Fix editlog to automatically sync when buffer is full. (todd)
-
-    HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. (todd via atm)
-
-    HDFS-2285. BackupNode should reject requests to modify namespace.
-    (shv and Uma Maheswara Rao)
-
-    HDFS-2764. TestBackupNode is racy. (atm)
-
-    HDFS-2188. Make FSEditLog create its journals from a list of URIs rather 
-    than NNStorage. (Ivan Kelly via jitendra)
-
-    HDFS-1765. Block Replication should respect under-replication
-    block priority. (Uma Maheswara Rao G via eli)
-
 Release 0.23.2 - UNRELEASED 
 
   INCOMPATIBLE CHANGES