CHANGES.txt 7.5 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241
  1. Hadoop YARN Change Log
  2. Release 0.23.6 - UNRELEASED
  3. INCOMPATIBLE CHANGES
  4. NEW FEATURES
  5. IMPROVEMENTS
  6. YARN-285. Added a temporary plugin interface for RM to be able to redirect to
  7. JobHistory server for apps that it no longer tracks. Contributed by
  8. Derek Dagit.
  9. OPTIMIZATIONS
  10. BUG FIXES
  11. YARN-204. test coverage for org.apache.hadoop.tools (Aleksey Gorshkov via
  12. bobby)
  13. YARN-251. Proxy URI generation fails for blank tracking URIs (Tom White
  14. via jlowe)
  15. YARN-72. NM should handle cleaning up containers when it shuts down.
  16. (Sandy Ryza via tomwhite)
  17. YARN-258. RM web page UI shows Invalid Date for start and finish times
  18. (Ravi Prakash via jlowe)
  19. YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping
  20. string properly (Ravi Prakash via jlowe)
  21. YARN-223. Change processTree interface to work better with native code
  22. (Radim Kolar via tgraves)
  23. YARN-280. RM does not reject app submission with invalid tokens
  24. (Daryn Sharp via tgraves)
  25. YARN-225. Proxy Link in RM UI thows NPE in Secure mode
  26. (Devaraj K via bobby)
  27. YARN-293. Node Manager leaks LocalizerRunner object for every Container
  28. (Robert Joseph Evans via jlowe)
  29. YARN-50. Implement renewal / cancellation of Delegation Tokens
  30. (Siddharth Seth via tgraves)
  31. YARN-320. RM should always be able to renew its own tokens.
  32. (Daryn Sharp via sseth)
  33. YARN-325. RM CapacityScheduler can deadlock when getQueueInfo() is
  34. called and a container is completing (Arun C Murthy via tgraves)
  35. YARN-334. Maven RAT plugin is not checking all source files (tgraves)
  36. YARN-170. NodeManager stop() gets called twice on shutdown (Sandy Ryza
  37. via tgraves)
  38. YARN-354. WebAppProxyServer exits immediately after startup (Liang Xie via
  39. jlowe)
  40. Release 0.23.5 - 2012-11-28
  41. INCOMPATIBLE CHANGES
  42. NEW FEATURES
  43. IMPROVEMENTS
  44. YARN-138. Ensure default values for minimum/maximum container sizes is
  45. sane. (harsh & sseth via acmurthy)
  46. YARN-137. Change the default YARN scheduler to be the CapacityScheduler.
  47. (sseth via acmurthy)
  48. YARN-116. Add the ability to change the RM include/exclude file without
  49. a restart. (xieguiming and Harsh J via sseth)
  50. YARN-28. Fixed TestCompositeService to not depend on test-order and thus
  51. made it pass on JDK7 (Thomas Graves via vinodkv).
  52. YARN-161. Fix multiple compiler warnings for unchecked operations in YARN
  53. common. (Chris Nauroth via vinodkv)
  54. YARN-43. Fix TestResourceTrackerService to not depend on test order and thus
  55. pass on JDK7. (Thomas Graves via vinodkv)
  56. YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass
  57. on JDK7. (vinodkv)
  58. YARN-186. Coverage fixing LinuxContainerExecutor (Aleksey Gorshkov via
  59. bobby)
  60. YARN-216. Remove jquery theming support. (Robert Joseph Evans via jlowe)
  61. YARN-80. Add support for delaying rack-local containers in
  62. CapacityScheduler. (acmurthy)
  63. OPTIMIZATIONS
  64. BUG FIXES
  65. YARN-131. Fix incorrect ACL properties in capacity scheduler documentation.
  66. (Ahmed Radwan via sseth)
  67. YARN-163. Retrieving container log via NM webapp can hang with multibyte
  68. characters in log (jlowe via bobby)
  69. YARN-102. Move the apache header to the top of the file in MemStore.java.
  70. (Devaraj K via sseth)
  71. YARN-174. Modify NodeManager to pass the user's configuration even when
  72. rebooting. (vinodkv)
  73. YARN-177. CapacityScheduler - adding a queue while the RM is running has
  74. wacky results (acmurthy vai tgraves)
  75. YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby)
  76. YARN-180. Capacity scheduler - containers that get reserved create container
  77. token to early (acmurthy and bobby)
  78. YARN-139. Interrupted Exception within AsyncDispatcher leads to user
  79. confusion. (Vinod Kumar Vavilapalli via jlowe)
  80. YARN-165. RM should point tracking URL to RM web page for app when AM fails
  81. (jlowe via bobby)
  82. YARN-159. RM web ui applications page should be sorted to display last app
  83. first (tgraves via bobby)
  84. YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via
  85. bobby)
  86. YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the
  87. dispatcher. (Thomas Graves via vinodkv)
  88. YARN-202. Log Aggregation generates a storm of fsync() for namenode
  89. (Kihwal Lee via bobby)
  90. YARN-201. Fix CapacityScheduler to be less conservative for starved
  91. off-switch requests. (jlowe via acmurthy)
  92. YARN-206. TestApplicationCleanup.testContainerCleanup occasionally fails
  93. (jlowe via bobby)
  94. YARN-212. NM state machine ignores an APPLICATION_CONTAINER_FINISHED event
  95. when it shouldn't (Nathan Roberts via jlowe)
  96. YARN-144. MiniMRYarnCluster launches RM and JHS on default ports (Robert
  97. Parker via jlowe)
  98. YARN-219. NM should aggregate logs when application finishes. (bobby)
  99. YARN-188. Coverage fixing for CapacityScheduler (Aleksey Gorshkov via
  100. bobby)
  101. YARN-214. RMContainerImpl does not handle event EXPIRE at state RUNNING
  102. (jeagles via bobby)
  103. YARN-151. Browser thinks RM main page JS is taking too long
  104. (Ravi Prakash via bobby)
  105. Release 0.23.4
  106. INCOMPATIBLE CHANGES
  107. NEW FEATURES
  108. IMPROVEMENTS
  109. OPTIMIZATIONS
  110. BUG FIXES
  111. YARN-108. FSDownload can create cache directories with the wrong
  112. permissions (Jason Lowe via bobby)
  113. YARN-88. DefaultContainerExecutor can fail to set proper permissions.
  114. (Jason Lowe via sseth)
  115. YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that
  116. NMs don't get NPEs on startup errors. (Devaraj K via vinodkv)
  117. YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE
  118. event at RUNNING state. (Siddharth Seth via vinodkv)
  119. YARN-57. Allow process-tree based resource calculation et al. to be
  120. pluggable to support it on multiple platforms. (Radim Kolar via acmurthy)
  121. YARN-93. Diagnostics missing from applications that have finished but
  122. failed (jlowe via bobby)
  123. YARN-106. Nodemanager needs to set permissions of local directories (jlowe
  124. via bobby)
  125. Release 0.23.3
  126. INCOMPATIBLE CHANGES
  127. NEW FEATURES
  128. YARN-1. Promote YARN to be a sub-project of Apache Hadoop. (acmurthy)
  129. IMPROVEMENTS
  130. BUG FIXES
  131. YARN-14. Symlinks to peer distributed cache files no longer work
  132. (Jason Lowe via bobby)
  133. YARN-25. remove old aggregated logs (Robert Evans via tgraves)
  134. YARN-27. Failed refreshQueues due to misconfiguration prevents further
  135. refreshing of queues (Arun Murthy via tgraves)
  136. MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles)
  137. MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. (Andy Isaacson
  138. via atm)
  139. YARN-39. RM-NM secret-keys should be randomly generated and rolled every
  140. so often. (vinodkv and sseth via sseth)
  141. YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to
  142. pass tests on jdk7. (Thomas Graves via vinodkv)
  143. YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state
  144. (Jason Lowe via bobby)
  145. YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
  146. YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and
  147. thus causes all containers to be rejected. (vinodkv)
  148. YARN-68. NodeManager will refuse to shutdown indefinitely due to container
  149. log aggregation (daryn via bobby)
  150. YARN-87. NM ResourceLocalizationService does not set permissions of local
  151. cache directories (Jason Lowe via tgraves)