CHANGES.txt 8.5 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282
  1. Hadoop YARN Change Log
  2. Release 0.23.7 - UNRELEASED
  3. INCOMPATIBLE CHANGES
  4. NEW FEATURES
  5. IMPROVEMENTS
  6. YARN-133 Update web services docs for RM clusterMetrics (Ravi Prakash via
  7. kihwal)
  8. YARN-286. Add a YARN ApplicationClassLoader. (tomwhite)
  9. OPTIMIZATIONS
  10. YARN-357. App submission should not be synchronized (daryn)
  11. BUG FIXES
  12. YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan
  13. Gong via tgraves)
  14. YARN-364. AggregatedLogDeletionService can take too long to delete logs
  15. (jlowe)
  16. YARN-29. Add a yarn-client module (Vinod Kumar Vavilapalli via tgraves)
  17. YARN-83. Change package of YarnClient to include apache (Bikas Saha via
  18. tgraves)
  19. YARN-40. Provide support for missing yarn commands (Devaraj K via tgraves)
  20. YARN-355. Fixes a bug where RM app submission could jam under load.
  21. (Daryn Sharp via sseth)
  22. YARN-150. AppRejectedTransition does not unregister app from master service
  23. and scheduler (Bikas Shah via tgraves)
  24. YARN-362. Unexpected extra results when using webUI table search (Ravi
  25. Prakash via jlowe)
  26. Release 0.23.6 - 2013-02-06
  27. INCOMPATIBLE CHANGES
  28. NEW FEATURES
  29. IMPROVEMENTS
  30. YARN-285. Added a temporary plugin interface for RM to be able to redirect to
  31. JobHistory server for apps that it no longer tracks. Contributed by
  32. Derek Dagit.
  33. OPTIMIZATIONS
  34. BUG FIXES
  35. YARN-204. test coverage for org.apache.hadoop.tools (Aleksey Gorshkov via
  36. bobby)
  37. YARN-251. Proxy URI generation fails for blank tracking URIs (Tom White
  38. via jlowe)
  39. YARN-72. NM should handle cleaning up containers when it shuts down.
  40. (Sandy Ryza via tomwhite)
  41. YARN-258. RM web page UI shows Invalid Date for start and finish times
  42. (Ravi Prakash via jlowe)
  43. YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping
  44. string properly (Ravi Prakash via jlowe)
  45. YARN-223. Change processTree interface to work better with native code
  46. (Radim Kolar via tgraves)
  47. YARN-280. RM does not reject app submission with invalid tokens
  48. (Daryn Sharp via tgraves)
  49. YARN-225. Proxy Link in RM UI thows NPE in Secure mode
  50. (Devaraj K via bobby)
  51. YARN-293. Node Manager leaks LocalizerRunner object for every Container
  52. (Robert Joseph Evans via jlowe)
  53. YARN-50. Implement renewal / cancellation of Delegation Tokens
  54. (Siddharth Seth via tgraves)
  55. YARN-320. RM should always be able to renew its own tokens.
  56. (Daryn Sharp via sseth)
  57. YARN-325. RM CapacityScheduler can deadlock when getQueueInfo() is
  58. called and a container is completing (Arun C Murthy via tgraves)
  59. YARN-334. Maven RAT plugin is not checking all source files (tgraves)
  60. YARN-170. NodeManager stop() gets called twice on shutdown (Sandy Ryza
  61. via tgraves)
  62. YARN-354. WebAppProxyServer exits immediately after startup (Liang Xie via
  63. jlowe)
  64. Release 0.23.5 - 2012-11-28
  65. INCOMPATIBLE CHANGES
  66. NEW FEATURES
  67. IMPROVEMENTS
  68. YARN-138. Ensure default values for minimum/maximum container sizes is
  69. sane. (harsh & sseth via acmurthy)
  70. YARN-137. Change the default YARN scheduler to be the CapacityScheduler.
  71. (sseth via acmurthy)
  72. YARN-116. Add the ability to change the RM include/exclude file without
  73. a restart. (xieguiming and Harsh J via sseth)
  74. YARN-28. Fixed TestCompositeService to not depend on test-order and thus
  75. made it pass on JDK7 (Thomas Graves via vinodkv).
  76. YARN-161. Fix multiple compiler warnings for unchecked operations in YARN
  77. common. (Chris Nauroth via vinodkv)
  78. YARN-43. Fix TestResourceTrackerService to not depend on test order and thus
  79. pass on JDK7. (Thomas Graves via vinodkv)
  80. YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass
  81. on JDK7. (vinodkv)
  82. YARN-186. Coverage fixing LinuxContainerExecutor (Aleksey Gorshkov via
  83. bobby)
  84. YARN-216. Remove jquery theming support. (Robert Joseph Evans via jlowe)
  85. YARN-80. Add support for delaying rack-local containers in
  86. CapacityScheduler. (acmurthy)
  87. OPTIMIZATIONS
  88. BUG FIXES
  89. YARN-131. Fix incorrect ACL properties in capacity scheduler documentation.
  90. (Ahmed Radwan via sseth)
  91. YARN-163. Retrieving container log via NM webapp can hang with multibyte
  92. characters in log (jlowe via bobby)
  93. YARN-102. Move the apache header to the top of the file in MemStore.java.
  94. (Devaraj K via sseth)
  95. YARN-174. Modify NodeManager to pass the user's configuration even when
  96. rebooting. (vinodkv)
  97. YARN-177. CapacityScheduler - adding a queue while the RM is running has
  98. wacky results (acmurthy vai tgraves)
  99. YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby)
  100. YARN-180. Capacity scheduler - containers that get reserved create container
  101. token to early (acmurthy and bobby)
  102. YARN-139. Interrupted Exception within AsyncDispatcher leads to user
  103. confusion. (Vinod Kumar Vavilapalli via jlowe)
  104. YARN-165. RM should point tracking URL to RM web page for app when AM fails
  105. (jlowe via bobby)
  106. YARN-159. RM web ui applications page should be sorted to display last app
  107. first (tgraves via bobby)
  108. YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via
  109. bobby)
  110. YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the
  111. dispatcher. (Thomas Graves via vinodkv)
  112. YARN-202. Log Aggregation generates a storm of fsync() for namenode
  113. (Kihwal Lee via bobby)
  114. YARN-201. Fix CapacityScheduler to be less conservative for starved
  115. off-switch requests. (jlowe via acmurthy)
  116. YARN-206. TestApplicationCleanup.testContainerCleanup occasionally fails
  117. (jlowe via bobby)
  118. YARN-212. NM state machine ignores an APPLICATION_CONTAINER_FINISHED event
  119. when it shouldn't (Nathan Roberts via jlowe)
  120. YARN-144. MiniMRYarnCluster launches RM and JHS on default ports (Robert
  121. Parker via jlowe)
  122. YARN-219. NM should aggregate logs when application finishes. (bobby)
  123. YARN-188. Coverage fixing for CapacityScheduler (Aleksey Gorshkov via
  124. bobby)
  125. YARN-214. RMContainerImpl does not handle event EXPIRE at state RUNNING
  126. (jeagles via bobby)
  127. YARN-151. Browser thinks RM main page JS is taking too long
  128. (Ravi Prakash via bobby)
  129. Release 0.23.4
  130. INCOMPATIBLE CHANGES
  131. NEW FEATURES
  132. IMPROVEMENTS
  133. OPTIMIZATIONS
  134. BUG FIXES
  135. YARN-108. FSDownload can create cache directories with the wrong
  136. permissions (Jason Lowe via bobby)
  137. YARN-88. DefaultContainerExecutor can fail to set proper permissions.
  138. (Jason Lowe via sseth)
  139. YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that
  140. NMs don't get NPEs on startup errors. (Devaraj K via vinodkv)
  141. YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE
  142. event at RUNNING state. (Siddharth Seth via vinodkv)
  143. YARN-57. Allow process-tree based resource calculation et al. to be
  144. pluggable to support it on multiple platforms. (Radim Kolar via acmurthy)
  145. YARN-93. Diagnostics missing from applications that have finished but
  146. failed (jlowe via bobby)
  147. YARN-106. Nodemanager needs to set permissions of local directories (jlowe
  148. via bobby)
  149. Release 0.23.3
  150. INCOMPATIBLE CHANGES
  151. NEW FEATURES
  152. YARN-1. Promote YARN to be a sub-project of Apache Hadoop. (acmurthy)
  153. IMPROVEMENTS
  154. BUG FIXES
  155. YARN-14. Symlinks to peer distributed cache files no longer work
  156. (Jason Lowe via bobby)
  157. YARN-25. remove old aggregated logs (Robert Evans via tgraves)
  158. YARN-27. Failed refreshQueues due to misconfiguration prevents further
  159. refreshing of queues (Arun Murthy via tgraves)
  160. MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles)
  161. MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. (Andy Isaacson
  162. via atm)
  163. YARN-39. RM-NM secret-keys should be randomly generated and rolled every
  164. so often. (vinodkv and sseth via sseth)
  165. YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to
  166. pass tests on jdk7. (Thomas Graves via vinodkv)
  167. YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state
  168. (Jason Lowe via bobby)
  169. YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
  170. YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and
  171. thus causes all containers to be rejected. (vinodkv)
  172. YARN-68. NodeManager will refuse to shutdown indefinitely due to container
  173. log aggregation (daryn via bobby)
  174. YARN-87. NM ResourceLocalizationService does not set permissions of local
  175. cache directories (Jason Lowe via tgraves)