CHANGES.txt 8.1 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257
  1. Hadoop YARN Change Log
  2. Release 2.0.3-alpha - Unreleased
  3. INCOMPATIBLE CHANGES
  4. NEW FEATURES
  5. YARN-145. Add a Web UI to the fair share scheduler. (Sandy Ryza via tomwhite)
  6. IMPROVEMENTS
  7. YARN-78. Changed UnManagedAM application to use YarnClient. (Bikas Saha via
  8. vinodkv)
  9. YARN-93. Fixed RM to propagate diagnostics from applications that have
  10. finished but failed (Jason Lowe via vinodkv).
  11. YARN-28. Fixed TestCompositeService to not depend on test-order and thus
  12. made it pass on JDK7 (Thomas Graves via vinodkv).
  13. YARN-82. Change the default local and log dirs to be based on
  14. hadoop.tmp.dir and yarn.log.dir. (Hemanth Yamijala via sseth)
  15. YARN-53. Added the missing getGroups API to ResourceManager. (Bo Wang via
  16. vinodkv)
  17. YARN-116. Add the ability to change the RM include/exclude file without
  18. a restart. (xieguiming and Harsh J via sseth)
  19. YARN-23. FairScheduler: FSQueueSchedulable#updateDemand() - potential
  20. redundant aggregation. (kkambatl via tucu)
  21. YARN-127. Move RMAdmin tool to its correct location - the client module.
  22. (vinodkv)
  23. YARN-40. Provided support for missing YARN commands (Devaraj K and Vinod
  24. Kumar Vavilapalli via vinodkv)
  25. YARN-33. Change LocalDirsHandlerService to validate the configured local and
  26. log dirs. (Mayank Bansal via sseth)
  27. YARN-94. Modify DistributedShell to point to main-class by default, clean up
  28. the help message, and hard-code the AM class. (Hitesh Shah via vinodkv)
  29. YARN-146. Add unit tests for computing fair share in the fair scheduler.
  30. (Sandy Ryza via tomwhite)
  31. HADOOP-8911. CRLF characters in source and text files.
  32. (Raja Aluri via suresh)
  33. YARN-136. Make ClientToAMTokenSecretManager part of RMContext (Vinod Kumar
  34. Vavilapalli via sseth)
  35. OPTIMIZATIONS
  36. BUG FIXES
  37. YARN-131. Fix incorrect ACL properties in capacity scheduler documentation.
  38. (Ahmed Radwan via sseth)
  39. YARN-102. Move the apache header to the top of the file in MemStore.java.
  40. (Devaraj K via sseth)
  41. YARN-134. ClientToAMSecretManager creates keys without checking for
  42. validity of the appID. (Vinod Kumar Vavilapalli via sseth)
  43. YARN-30. Fixed tests verifying web-services to work on JDK7. (Thomas Graves
  44. via vinodkv)
  45. YARN-150. Fixes AppRejectedTransition does not unregister a rejected
  46. app-attempt from the ApplicationMasterService (Bikas Saha via sseth)
  47. YARN-140. Add capacity-scheduler-default.xml to provide a default set of
  48. configurations for the capacity scheduler. (ahmed via tucu)
  49. YARN-179. Fix some unit test failures. (Vinod Kumar Vavilapalli via sseth)
  50. YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via
  51. YARN-140. (Siddharth Seth via vinodkv)
  52. Release 2.0.2-alpha - 2012-09-07
  53. YARN-9. Rename YARN_HOME to HADOOP_YARN_HOME. (vinodkv via acmurthy)
  54. NEW FEATURES
  55. YARN-1. Promote YARN to be a sub-project of Apache Hadoop. (acmurthy)
  56. IMPROVEMENTS
  57. YARN-29. Add a yarn-client module. (Vinod Kumar Vavilapalli via sseth)
  58. YARN-10. Fix DistributedShell module to not have a dependency on
  59. hadoop-mapreduce-client-core. (Hitesh Shah via vinodkv)
  60. YARN-80. Add support for delaying rack-local containers in
  61. CapacityScheduler. (acmurthy)
  62. YARN-137. Change the default YARN scheduler to be the CapacityScheduler.
  63. (sseth via acmurthy)
  64. OPTIMIZATIONS
  65. BUG FIXES
  66. YARN-13. Fix pom versions for YARN in branch-2 (todd)
  67. MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. (Andy Isaacson
  68. via atm)
  69. YARN-12. Fix findbugs warnings in FairScheduler. (Junping Du via acmurthy)
  70. YARN-22. Fix ContainerLogs to work if the log-dir is specified as a URI.
  71. (Mayank Bansal via sseth)
  72. YARN-37. Change TestRMAppTransitions to use the DrainDispatcher.
  73. (Mayank Bansal via sseth)
  74. YARN-79. Implement close on all clients to YARN so that RPC clients don't
  75. throw exceptions on shut-down. (Vinod Kumar Vavilapalli)
  76. YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that
  77. NMs don't get NPEs on startup errors. (Devaraj K via vinodkv)
  78. YARN-15. Updated default classpath for YARN applications to reflect split of
  79. YARN into a sub-project. (Arun C Murthy via vinodkv)
  80. YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE
  81. event at RUNNING state. (Siddharth Seth via vinodkv)
  82. YARN-138. Ensure default values for minimum/maximum container sizes is
  83. sane. (harsh & sseth via acmurthy)
  84. Release 0.23.5 - UNRELEASED
  85. INCOMPATIBLE CHANGES
  86. NEW FEATURES
  87. IMPROVEMENTS
  88. YARN-161. Fix multiple compiler warnings for unchecked operations in YARN
  89. common. (Chris Nauroth via vinodkv)
  90. YARN-43. Fix TestResourceTrackerService to not depend on test order and thus
  91. pass on JDK7. (Thomas Graves via vinodkv)
  92. YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass
  93. on JDK7. (vinodkv)
  94. OPTIMIZATIONS
  95. BUG FIXES
  96. YARN-163. Retrieving container log via NM webapp can hang with multibyte
  97. characters in log (jlowe via bobby)
  98. YARN-174. Modify NodeManager to pass the user's configuration even when
  99. rebooting. (vinodkv)
  100. YARN-177. CapacityScheduler - adding a queue while the RM is running has
  101. wacky results (acmurthy vai tgraves)
  102. YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby)
  103. YARN-180. Capacity scheduler - containers that get reserved create
  104. container token to early (acmurthy and bobby)
  105. YARN-139. Interrupted Exception within AsyncDispatcher leads to user
  106. confusion. (Vinod Kumar Vavilapalli via jlowe)
  107. YARN-165. RM should point tracking URL to RM web page for app when AM fails
  108. (jlowe via bobby)
  109. YARN-159. RM web ui applications page should be sorted to display last app
  110. first (tgraves via bobby)
  111. YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via
  112. bobby)
  113. YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the
  114. dispatcher. (Thomas Graves via vinodkv)
  115. YARN-202. Log Aggregation generates a storm of fsync() for namenode
  116. (Kihwal Lee via bobby)
  117. YARN-201. Fix CapacityScheduler to be less conservative for starved
  118. off-switch requests. (jlowe via acmurthy)
  119. Release 0.23.4 - UNRELEASED
  120. INCOMPATIBLE CHANGES
  121. NEW FEATURES
  122. IMPROVEMENTS
  123. Change package of YarnClient to org.apache.hadoop. (Bikas Saha via vinodkv)
  124. YARN-108. FSDownload can create cache directories with the wrong
  125. permissions (Jason Lowe via bobby)
  126. YARN-57. Allow process-tree based resource calculation et al. to be
  127. pluggable to support it on multiple platforms. (Radim Kolar via acmurthy)
  128. OPTIMIZATIONS
  129. BUG FIXES
  130. YARN-88. DefaultContainerExecutor can fail to set proper permissions.
  131. (Jason Lowe via sseth)
  132. YARN-106. Nodemanager needs to set permissions of local directories (jlowe
  133. via bobby)
  134. Release 0.23.3
  135. INCOMPATIBLE CHANGES
  136. NEW FEATURES
  137. IMPROVEMENTS
  138. OPTIMAZATIONS
  139. BUG FIXES
  140. YARN-14. Symlinks to peer distributed cache files no longer work
  141. (Jason Lowe via bobby)
  142. YARN-25. remove old aggregated logs (Robert Evans via tgraves)
  143. YARN-27. Failed refreshQueues due to misconfiguration prevents further
  144. refreshing of queues (Arun Murthy via tgraves)
  145. MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles)
  146. YARN-39. RM-NM secret-keys should be randomly generated and rolled every
  147. so often. (vinodkv and sseth via sseth)
  148. YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to
  149. pass tests on jdk7. (Thomas Graves via vinodkv)
  150. YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state
  151. (Jason Lowe via bobby)
  152. YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and
  153. thus causes all containers to be rejected. (vinodkv)
  154. YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
  155. YARN-68. NodeManager will refuse to shutdown indefinitely due to container
  156. log aggregation (daryn via bobby)
  157. YARN-87. NM ResourceLocalizationService does not set permissions of local
  158. cache directories (Jason Lowe via tgraves)