CHANGES_HDFS-2832.txt 2.5 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475
  1. BREAKDOWN OF HDFS-2832 ENABLE SUPPORT FOR HETEROGENEOUS STORAGES IN HDFS
  2. IMPROVEMENTS:
  3. HDFS-4985. Add storage type to the protocol and expose it in block report
  4. and block locations. (Arpit Agarwal)
  5. HDFS-5115. Make StorageID a UUID. (Arpit Agarwal)
  6. HDFS-5000. DataNode configuration should allow specifying storage type.
  7. (Arpit Agarwal)
  8. HDFS-4987. Namenode changes to track multiple storages per datanode.
  9. (szetszwo)
  10. HDFS-5154. Fix TestBlockManager and TestDatanodeDescriptor after HDFS-4987.
  11. (Junping Du via szetszwo)
  12. HDFS-5009. Include storage information in the LocatedBlock. (szetszwo)
  13. HDFS-5134. Move blockContentsStale, heartbeatedSinceFailover and
  14. firstBlockReport from DatanodeDescriptor to DatanodeStorageInfo; and
  15. fix a synchronization problem in DatanodeStorageInfo. (szetszwo)
  16. HDFS-5157. Add StorageType to FsVolume. (Junping Du via szetszwo)
  17. HDFS-4990. Change BlockPlacementPolicy to choose storages instead of
  18. datanodes. (szetszwo)
  19. HDFS-5232. Protocol changes to transmit StorageUuid. (Arpit Agarwal)
  20. HDFS-5233. Use Datanode UUID to identify Datanodes. (Arpit Agarwal)
  21. HDFS-5222. Move block schedule information from DatanodeDescriptor to
  22. DatanodeStorageInfo. (szetszwo)
  23. HDFS-4988. Datanode must support all the volumes as individual storages.
  24. (Arpit Agarwal)
  25. HDFS-5377. Heartbeats from Datandode should include one storage report
  26. per storage directory. (Arpit Agarwal)
  27. HDFS-5398. NameNode changes to process storage reports per storage
  28. directory. (Arpit Agarwal)
  29. HDFS-5390. Send one incremental block report per storage directory.
  30. (Arpit Agarwal)
  31. HDFS-5401. Fix NPE in Directory Scanner. (Arpit Agarwal)
  32. HDFS-5417. Fix storage IDs in PBHelper and UpgradeUtilities. (szetszwo)
  33. HDFS-5214. Fix NPEs in BlockManager and DirectoryScanner. (Arpit Agarwal)
  34. HDFS-5435. File append fails to initialize storageIDs. (Junping Du via
  35. Arpit Agarwal)
  36. HDFS-5437. Fix TestBlockReport and TestBPOfferService failures. (Arpit
  37. Agarwal)
  38. HDFS-5447. Fix TestJspHelper. (Arpit Agarwal)
  39. HDFS-5452. Fix TestReplicationPolicy and TestBlocksScheduledCounter.
  40. HDFS-5448. Datanode should generate its ID on first registration. (Arpit
  41. Agarwal)
  42. HDFS-5448. Fix break caused by previous checkin for HDFS-5448. (Arpit
  43. Agarwal)
  44. HDFS-5455. NN should update storageMap on first heartbeat. (Arpit Agarwal)
  45. HDFS-5457. Fix TestDatanodeRegistration, TestFsck and TestAddBlockRetry.
  46. (Contributed bt szetszwo)