123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282 |
- Hadoop YARN Change Log
- Release 0.23.7 - UNRELEASED
- INCOMPATIBLE CHANGES
- NEW FEATURES
- IMPROVEMENTS
- YARN-133 Update web services docs for RM clusterMetrics (Ravi Prakash via
- kihwal)
- YARN-286. Add a YARN ApplicationClassLoader. (tomwhite)
- OPTIMIZATIONS
- YARN-357. App submission should not be synchronized (daryn)
- BUG FIXES
- YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan
- Gong via tgraves)
- YARN-364. AggregatedLogDeletionService can take too long to delete logs
- (jlowe)
- YARN-29. Add a yarn-client module (Vinod Kumar Vavilapalli via tgraves)
- YARN-83. Change package of YarnClient to include apache (Bikas Saha via
- tgraves)
- YARN-40. Provide support for missing yarn commands (Devaraj K via tgraves)
- YARN-355. Fixes a bug where RM app submission could jam under load.
- (Daryn Sharp via sseth)
- YARN-150. AppRejectedTransition does not unregister app from master service
- and scheduler (Bikas Shah via tgraves)
- YARN-362. Unexpected extra results when using webUI table search (Ravi
- Prakash via jlowe)
- Release 0.23.6 - 2013-02-06
- INCOMPATIBLE CHANGES
- NEW FEATURES
- IMPROVEMENTS
- YARN-285. Added a temporary plugin interface for RM to be able to redirect to
- JobHistory server for apps that it no longer tracks. Contributed by
- Derek Dagit.
- OPTIMIZATIONS
- BUG FIXES
- YARN-204. test coverage for org.apache.hadoop.tools (Aleksey Gorshkov via
- bobby)
- YARN-251. Proxy URI generation fails for blank tracking URIs (Tom White
- via jlowe)
- YARN-72. NM should handle cleaning up containers when it shuts down.
- (Sandy Ryza via tomwhite)
- YARN-258. RM web page UI shows Invalid Date for start and finish times
- (Ravi Prakash via jlowe)
- YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping
- string properly (Ravi Prakash via jlowe)
- YARN-223. Change processTree interface to work better with native code
- (Radim Kolar via tgraves)
- YARN-280. RM does not reject app submission with invalid tokens
- (Daryn Sharp via tgraves)
- YARN-225. Proxy Link in RM UI thows NPE in Secure mode
- (Devaraj K via bobby)
- YARN-293. Node Manager leaks LocalizerRunner object for every Container
- (Robert Joseph Evans via jlowe)
- YARN-50. Implement renewal / cancellation of Delegation Tokens
- (Siddharth Seth via tgraves)
- YARN-320. RM should always be able to renew its own tokens.
- (Daryn Sharp via sseth)
- YARN-325. RM CapacityScheduler can deadlock when getQueueInfo() is
- called and a container is completing (Arun C Murthy via tgraves)
- YARN-334. Maven RAT plugin is not checking all source files (tgraves)
- YARN-170. NodeManager stop() gets called twice on shutdown (Sandy Ryza
- via tgraves)
- YARN-354. WebAppProxyServer exits immediately after startup (Liang Xie via
- jlowe)
- Release 0.23.5 - 2012-11-28
- INCOMPATIBLE CHANGES
- NEW FEATURES
- IMPROVEMENTS
- YARN-138. Ensure default values for minimum/maximum container sizes is
- sane. (harsh & sseth via acmurthy)
- YARN-137. Change the default YARN scheduler to be the CapacityScheduler.
- (sseth via acmurthy)
- YARN-116. Add the ability to change the RM include/exclude file without
- a restart. (xieguiming and Harsh J via sseth)
- YARN-28. Fixed TestCompositeService to not depend on test-order and thus
- made it pass on JDK7 (Thomas Graves via vinodkv).
- YARN-161. Fix multiple compiler warnings for unchecked operations in YARN
- common. (Chris Nauroth via vinodkv)
- YARN-43. Fix TestResourceTrackerService to not depend on test order and thus
- pass on JDK7. (Thomas Graves via vinodkv)
- YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass
- on JDK7. (vinodkv)
- YARN-186. Coverage fixing LinuxContainerExecutor (Aleksey Gorshkov via
- bobby)
- YARN-216. Remove jquery theming support. (Robert Joseph Evans via jlowe)
- YARN-80. Add support for delaying rack-local containers in
- CapacityScheduler. (acmurthy)
- OPTIMIZATIONS
- BUG FIXES
-
- YARN-131. Fix incorrect ACL properties in capacity scheduler documentation.
- (Ahmed Radwan via sseth)
- YARN-163. Retrieving container log via NM webapp can hang with multibyte
- characters in log (jlowe via bobby)
- YARN-102. Move the apache header to the top of the file in MemStore.java.
- (Devaraj K via sseth)
- YARN-174. Modify NodeManager to pass the user's configuration even when
- rebooting. (vinodkv)
- YARN-177. CapacityScheduler - adding a queue while the RM is running has
- wacky results (acmurthy vai tgraves)
- YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby)
- YARN-180. Capacity scheduler - containers that get reserved create container
- token to early (acmurthy and bobby)
- YARN-139. Interrupted Exception within AsyncDispatcher leads to user
- confusion. (Vinod Kumar Vavilapalli via jlowe)
- YARN-165. RM should point tracking URL to RM web page for app when AM fails
- (jlowe via bobby)
- YARN-159. RM web ui applications page should be sorted to display last app
- first (tgraves via bobby)
- YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via
- bobby)
- YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the
- dispatcher. (Thomas Graves via vinodkv)
- YARN-202. Log Aggregation generates a storm of fsync() for namenode
- (Kihwal Lee via bobby)
- YARN-201. Fix CapacityScheduler to be less conservative for starved
- off-switch requests. (jlowe via acmurthy)
- YARN-206. TestApplicationCleanup.testContainerCleanup occasionally fails
- (jlowe via bobby)
- YARN-212. NM state machine ignores an APPLICATION_CONTAINER_FINISHED event
- when it shouldn't (Nathan Roberts via jlowe)
- YARN-144. MiniMRYarnCluster launches RM and JHS on default ports (Robert
- Parker via jlowe)
- YARN-219. NM should aggregate logs when application finishes. (bobby)
- YARN-188. Coverage fixing for CapacityScheduler (Aleksey Gorshkov via
- bobby)
- YARN-214. RMContainerImpl does not handle event EXPIRE at state RUNNING
- (jeagles via bobby)
- YARN-151. Browser thinks RM main page JS is taking too long
- (Ravi Prakash via bobby)
- Release 0.23.4
- INCOMPATIBLE CHANGES
- NEW FEATURES
- IMPROVEMENTS
- OPTIMIZATIONS
- BUG FIXES
- YARN-108. FSDownload can create cache directories with the wrong
- permissions (Jason Lowe via bobby)
- YARN-88. DefaultContainerExecutor can fail to set proper permissions.
- (Jason Lowe via sseth)
- YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that
- NMs don't get NPEs on startup errors. (Devaraj K via vinodkv)
- YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE
- event at RUNNING state. (Siddharth Seth via vinodkv)
- YARN-57. Allow process-tree based resource calculation et al. to be
- pluggable to support it on multiple platforms. (Radim Kolar via acmurthy)
- YARN-93. Diagnostics missing from applications that have finished but
- failed (jlowe via bobby)
- YARN-106. Nodemanager needs to set permissions of local directories (jlowe
- via bobby)
- Release 0.23.3
- INCOMPATIBLE CHANGES
- NEW FEATURES
- YARN-1. Promote YARN to be a sub-project of Apache Hadoop. (acmurthy)
- IMPROVEMENTS
- BUG FIXES
- YARN-14. Symlinks to peer distributed cache files no longer work
- (Jason Lowe via bobby)
- YARN-25. remove old aggregated logs (Robert Evans via tgraves)
- YARN-27. Failed refreshQueues due to misconfiguration prevents further
- refreshing of queues (Arun Murthy via tgraves)
- MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles)
- MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. (Andy Isaacson
- via atm)
- YARN-39. RM-NM secret-keys should be randomly generated and rolled every
- so often. (vinodkv and sseth via sseth)
- YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to
- pass tests on jdk7. (Thomas Graves via vinodkv)
- YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state
- (Jason Lowe via bobby)
- YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
- YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and
- thus causes all containers to be rejected. (vinodkv)
- YARN-68. NodeManager will refuse to shutdown indefinitely due to container
- log aggregation (daryn via bobby)
- YARN-87. NM ResourceLocalizationService does not set permissions of local
- cache directories (Jason Lowe via tgraves)
|