CHANGES_HDFS-5535.txt 4.4 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119
  1. HDFS-5535 subtasks:
  2. HDFS-5496. Make replication queue initialization asynchronous. (Vinay via
  3. jing9)
  4. HDFS-5645. Support upgrade marker in editlog streams. (szetszwo)
  5. HDFS-5752. Add a new DFSAdmin command to query, start and finalize rolling
  6. upgrade. (szetszwo)
  7. HDFS-5786. Support QUERY and FINALIZE actions of rolling upgrade. (szetszwo)
  8. HDFS-5753. Add new Namenode startup options for downgrade and rollback using
  9. upgrade marker. (szetszwo)
  10. HDFS-5835. Add a new option for starting Namenode when rolling upgrade is
  11. in progress. (szetszwo)
  12. HDFS-5754. Split LayoutVerion into NameNodeLayoutVersion and
  13. DataNodeLayoutVersion. (Brandon Li via szetszwo)
  14. HDFS-5848. Add rolling upgrade status to heartbeat response. (szetszwo)
  15. HDFS-5890. Avoid NPE in Datanode heartbeat. (Vinay via brandonli)
  16. HDFS-5869. When starting rolling upgrade or NN restarts, NN should create
  17. a checkpoint right before the upgrade marker. (szetszwo)
  18. HDFS-5874. Should not compare DataNode current layout version with that of
  19. NameNode in DataStrorage. (brandonli)
  20. HDFS-5889. When starting rolling upgrade, create a fs image for rollback
  21. so that the standby namenode can create checkpoints during upgrade.
  22. (szetszwo & jing9)
  23. HDFS-5535. Add BlockPoolSliceStorage 'trash' to handle block deletions
  24. during rolling upgrades. (Arpit Agarwal)
  25. HDFS-5494. Merge Protobuf-based-FSImage code from trunk - fix build
  26. break after the merge. (Jing Zhao via Arpit Agarwal)
  27. HDFS-5585. Provide admin commands for data node upgrade (kihwal)
  28. HDFS-5920. Support rollback of rolling upgrade in NameNode and JournalNodes.
  29. (jing9)
  30. HDFS-5945. Add rolling upgrade information to fsimage; and disallow upgrade
  31. and rolling upgrade to be started simultaneously. (szetszwo & jing9)
  32. HDFS-5966. Fix rollback of rolling upgrade in NameNode HA setup. (jing9
  33. via szetszwo)
  34. HDFS-5974. Fix compilation error, NameNodeLayoutVersion and
  35. DataNodeLayoutVersion after merge from trunk. (szetszwo)
  36. HDFS-5963. TestRollingUpgrade#testSecondaryNameNode causes subsequent
  37. tests to fail. (szetszwo via Arpit Agarwal)
  38. HDFS-5976. Create unit tests for downgrade and finalize rolling upgrade.
  39. (Haohui Mai via Arpit Agarwal)
  40. HDFS-5980. Rollback does not need to load edits. (jing9 via szetszwo)
  41. HDFS-5984. Fix TestEditLog and TestStandbyCheckpoints. (jing9 via szetszwo)
  42. HDFS-5985. SimulatedFSDataset#disableAndPurgeTrashStorage should not throw
  43. UnsupportedOperationException. (jing9 via kihwal)
  44. HDFS-5987. Fix findbugs warnings in Rolling Upgrade branch. (seztszwo via
  45. Arpit Agarwal)
  46. HDFS-5992. Fix NPE in MD5FileUtils and update editsStored for
  47. TestOfflineEditsViewer. (szetszwo)
  48. HDFS-5994. Fix TestDataNodeRollingUpgrade. (Arpit Agarwal via szetszwo)
  49. HDFS-5999. Do not create rollback fsimage when it already exists. (jing9)
  50. HDFS-6005. Simplify Datanode rollback and downgrade. (Suresh Srinivas via
  51. Arpit Agarwal)
  52. HDFS-6004. Change DFSAdmin for rolling upgrade commands. (szetszwo via
  53. Arpit Agarwal)
  54. HDFS-5583. Make DN send an OOB Ack on shutdown before restarting. (kihwal)
  55. HDFS-5778. Add rolling upgrade user document. (szetszwo)
  56. HDFS-6003. Add the new -rollingUpgrade startup option to the namenode
  57. usage message. (Vinayakumar B via szetszwo)
  58. HDFS-6014. Fix findbug warnings introduced by HDFS-5583. (kihwal)
  59. HDFS-6015. Fix TestBlockRecovery
  60. #testRaceBetweenReplicaRecoveryAndFinalizeBlock. (kihwal)
  61. HDFS-5924. Utilize OOB upgrade message processing for writes. (kihwal)
  62. HDFS-5498. Improve datanode startup time. (kihwal)
  63. HDFS-6000. Avoid saving namespace when starting rolling upgrade. (jing9)
  64. HDFS-6017. Query the status of rolling upgrade in the preparation stage in
  65. TestRollingUpgrade and TestRollingUpgradeRollback. (Haohui Mai via
  66. Arpit Agarwal)
  67. HDFS-6020. Fix the five findbugs warnings. (kihwal)
  68. HDFS-6019. Standby NN might not checkpoint when processing the rolling
  69. upgrade marker. (Haohui Mai via jing9)
  70. HDFS-6023. Test whether the standby NN continues to checkpoint after the
  71. prepare stage. (Haohui Mai via jing9)
  72. HDFS-6024. Test whether the NN will reject the downgrade if it has a
  73. fsimage from a newer release. (Haohui Mai via jing9)
  74. HDFS-6026. Fix TestDFSUpgrade and TestDataNodeRollingUpgrade.
  75. (jing9 via szetszwo)