AMBARI-666-CHANGES.txt 12 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377
  1. Ambari Change log
  2. Notes:
  3. - Committers should be listed using their login and non-committers
  4. should be listed by their full name.
  5. - Please keep the file to a max of 80 characters wide.
  6. - Put latest commits first in each section.
  7. AMBARI-666 branch (unreleased changes)
  8. INCOMPATIBLE CHANGES
  9. NEW FEATURES
  10. AMBARI-890. Add client library option to step6 (Assign slaves) of
  11. installer wizard. Also add indicator and popovers for hosts with
  12. master component. (Jaimin Jetly via yusaku)
  13. AMBARI-889. Provide cluster metric graphs on Ambari main dashboard.
  14. (Srimanth Gunturi via yusaku)
  15. AMBARI-886. Support filters in controller get* apis. (hitesh)
  16. AMBARI-880. Implement Review Page (Step 8) for the Ambari Installer
  17. Wizard. (Jaimin Jetly via yusaku)
  18. AMBARI-872. Hookup Nagios alerts section in Ambari UI to backend
  19. server. (Srimanth Gunturi via yusaku)
  20. AMBARI-871. Integrate basic set of rest APIs with ambari-web
  21. installer wizardi. (Jaimin Jetly via yusaku)
  22. AMBARI-884. Implement Dashboard/Service summary. (yusaku)
  23. AMBARI-882. Group-based DataNode/TaskTracker/RegionServer overrides.
  24. (yusaku)
  25. AMBARI-881. Implement Add Hosts Wizard. (yusaku)
  26. AMBARI-869. Util to deserialize ExecutionCommand. (jitendra)
  27. AMBARI-874. Fix hostinfo reporting at the server and add a unit test for
  28. deserilization for the host information from agent. (mahadev)
  29. AMBARI-873. Support for multiple objects' updates in controller. (hitesh)
  30. AMBARI-870. Support metric types other than string (Tom Beerbower via
  31. mahadev)
  32. AMBARI-868. Clean up site.pp generation on the agent and remove the imports
  33. in the sample site.pp. (mahadev)
  34. AMBARI-862. API query against /clusters doesn't return any data.
  35. (John Speidel via mahadev)
  36. AMBARI-866. Add ORM layer for the FSM's in the server. (mahadev)
  37. AMBARI-853. Add more complete JMX metrics. (Tom Beerbower via mahadev)
  38. AMBARI-852. Improve REST API functionality regarding query and partial
  39. response (John Speidel via mahadev)
  40. AMBARI-865. Add unit test for action queue on the agent. (mahadev)
  41. AMBARI-851. Hook up Ganglia property provider. (Tom Beerbower via mahadev)
  42. AMBARI-863. Fix mvn tests to be able to run the python tests cleanly.
  43. (mahadev)
  44. AMBARI-849. Stage planner implementation. (jitendra)
  45. AMBARI-860. Remove code that adds fake stages for testing. (jitendra)
  46. AMBARI-856. Add cluster heatmap. (yusaku)
  47. AMBARI-855. Create the skeleton for a custom data adapter in Ambari Web.
  48. (yusaku)
  49. AMBARI-854. Serve ambari-web from jetty. (Jaimin Jely via yusaku)
  50. AMBARI-850. Flatten ExecutionCommand structure. (jitendra)
  51. AMBARI-848. Various tests for FSM and Controller impl. (hitesh)
  52. AMBARI-847. Run pyunit tests from maven test target and also autogenerated
  53. openssl passphrase. (mahadev)
  54. AMBARI-845. Fix NPE in the server to be able to run the server api's.
  55. (mahadev)
  56. AMBARI-844. Mock JMX provider for manual tests. (Tom Beerbower via mahadev)
  57. AMBARI-841. Fix comparison predicates in case where resource does not have
  58. property value. (Tom Beerbower via mahadev)
  59. AMBARI-833. Add missing Path annotation to rest services for
  60. put/post/delete. (John Speidel via mahadev)
  61. AMBARI-838. HACK: Add a thread in server to inject requests for testing.
  62. (Jitendra via mahadev)
  63. AMBARI-835. Update JMXPropertyProvider. (Tom Beerbower via hitesh)
  64. AMBARI-832. Merge ambari-api with ambari-server (mahadev)
  65. AMBARI-822. Implement an agent simulator for unit testing. (jitendra)
  66. AMBARI-829. Add unit tests for ResourceProviderImpl. (Tom Beerbower via
  67. mahadev)
  68. AMBARI-831. Move manifest generation into the ambari agent directory.
  69. (mahadev)
  70. AMBARI-828. Manifest generation for various actions from the server.
  71. (mahadev)
  72. AMBARI-827. Add clusterName to the status of the commands run by the agent.
  73. (mahadev)
  74. AMBARI-824. Provide basic management functionality (create/update) in the
  75. rest api (John Speidel via mahadev)
  76. AMBARI-826. Bug in processing command reports. (jitendra)
  77. AMBARI-825. Controller layer implementation part 3. (hitesh)
  78. AMBARI-823. Fix security filter on the server agent ports and remove
  79. duplication on servlet contexts for certs signing. (mahadev)
  80. AMBARI-821. Implement basic service state update and verify flow to
  81. ActionManager. (hitesh)
  82. AMBARI-812. In API , improve partial response support to drill down n levels
  83. (John Spiedel)
  84. AMBARI-791. Add unit tests and java docs for SPI code. (Tom Beerbower)
  85. AMBARI-820. Remove JAXB dependencies in Server Agent protocol and move to
  86. POJO based jackson serializer. (mahadev)
  87. AMBARI-819. Management controller implemenation work. (hitesh)
  88. AMBARI-811. Bug fix in jaxb serialization for maps. (jitendra)
  89. AMBARI-810. Controller layer implementation part 1. (hitesh)
  90. AMBARI-807. Fix Action scheduler tests because of fsm interface changes.
  91. (jitendra)
  92. AMBARI-806. Remove State object as configs/stack version/running state are
  93. handled as standalone entities. (hitesh)
  94. AMBARI-805. Add requestId tracking objects for management spi. (hitesh)
  95. AMBARI-803. FSM initial refactoring for eventual live/desired objects. (hitesh)
  96. AMBARI-800. Hack to add a stage for testing in in-memory db. (jitendra)
  97. AMBARI-801. Fix heartbeat message from the agent which is causing NPE at the
  98. server. (mahadev)
  99. AMBARI-778. Ensure data flows across all steps in installer wizard.
  100. (Jaimin Jetly via yusaku)
  101. AMBARI-799. Prototype for management spi part 3. (hitesh)
  102. AMBARI-797. Prototype for management spi interface continued. (hitesh)
  103. AMBARI-795. Fix failing tests for AgentResource and BootStrap. (mahadev)
  104. AMBARI-793. Make MapReduce, Nagios, and Ganglia optional during cluster
  105. install. (yusaku)
  106. AMBARI-794. Add log4j properties for logging at the server. (mahadev)
  107. AMBARI-790. OK in registration response. (jitendra)
  108. AMBARI-787. Registration throws HostNotFoundException for new hosts. (jitendra)
  109. AMBARI-788. Fix server and agent startup for end to end testing. (mahadev)
  110. AMBARI-785. Action response unit test. (jitendra)
  111. AMBARI-783. Fix guice injection in the server. (mahadev)
  112. AMBARI-784. Add Resource download API on the server. (mahadev)
  113. AMBARI-781. Registration unit test. (jitendra)
  114. AMBARI-754. Heartbeat handler: Registration response should query component
  115. status. (jitendra)
  116. AMBARI-755. Heartbeat handler: Update state as reported in heartbeat.
  117. (jitendra)
  118. AMBARI-756. Heartbeat handler: Handle heartbeat timeout. (jitendra)
  119. AMBARI-767. Add bootstrap script to ssh in parallel and setup agents on a
  120. list of hosts. (mahadev)
  121. AMBARI-764. Integrate REST API (Tom Beerbower via mahadev)
  122. AMBARI-762. Implement Confirm Hosts page for Ambari installer
  123. (Jaimin Jetly via yusaku)
  124. AMBARI-763. Implement Installer Step 6 (Assign Slaves). (yusaku)
  125. AMBARI-760. Fix injection in data access objects to use guice provider.
  126. (mahadev)
  127. AMBARI-759. Add puppet scripts to the agent for configuring/installing
  128. various services and add security aspects to api's and server/agent.
  129. (mahadev)
  130. AMBARI-749. Complete Java side implementation of bootstrapping agent hosts.
  131. (mahadev)
  132. AMBARI-757. Implement Installer Step 4 (Select Services). (yusaku)
  133. AMBARI-751. Re-structure servicecomponenthost fsm layout. (hitesh)
  134. AMBARI-732. Action scheduler unit tests. (jitendra)
  135. AMBARI-739. Cluster fsm implementation. (hitesh)
  136. AMBARI-738. s/Node/Host/g. (hitesh)
  137. AMBARI-737. ServiceComponentNode FSM implementation. (hitesh)
  138. AMBARI-722. Action scheduler implementation. (jitendra)
  139. AMBARI-733. Add Jersey Resource for BootStrapping and JAXB elements for API
  140. entities. (mahadev)
  141. AMBARI-730. Add unit tests for jersey apis on the server. (mahadev)
  142. AMBARI-725. Add commandstatus/result/error objects into the rest API between
  143. server and agent. (mahadev)
  144. AMBARI-723. Implement Installer Welcome page and Install Options page
  145. (Jaimin Jetly via yusaku)
  146. AMBARI-726. ORM-based data access layer for new design (Jaimin Jetly via hitesh)
  147. AMBARI-728. Initial work on ServiceComponentNode FSM. (hitesh)
  148. AMBARI-724. Add tabs, dynamic form generation, validation errors, and info
  149. popovers for Customize Services page in Installer (yusaku)
  150. AMBARI-714. Job FSM Impl and tests. (hitesh)
  151. AMBARI-721. Remove Hardwareprofile class since its not needed anymore.
  152. (mahadev)
  153. AMBARI-720. Tweak basic styles for Installer. (yusaku)
  154. AMBARI-719. Enable Responsive Design. (yusaku)
  155. AMBARI-716. Add back TestNodeImpl and fix memory types and disk info
  156. serialization. (mahadev)
  157. AMBARI-717. Starter implementation for Installer Customize Services page.
  158. Stylize top nav and implement static footer. Stylize login page. (yusaku)
  159. AMBARI-711. Create utility functions related to localStorage for first two
  160. steps: cluster name and Install options. Also develop view logic with
  161. preliminary validations for these two steps. (Jaimin Jetly via yusaku)
  162. AMBARI-715. Integrate domain objects and Rest serialized objects. (mahadev)
  163. AMBARI-713. Initial work on Job FSM. (hitesh)
  164. AMBARI-712. Action manager skeleton. (jitendra)
  165. AMBARI-710. Basic registration and heartbeat protocol implementation between
  166. the server and the agent. (mahadev)
  167. AMBARI-709. Getting hardware info on disks/cpu/others using facter and using
  168. it during registeration. (mahadev)
  169. AMBARI-707. More work on Node FSM and additional tests/cleanup. (hitesh)
  170. AMBARI-706. Basic tests for Node FSM. (hitesh)
  171. AMBARI-705. Initial work on Node FSM. (hitesh)
  172. AMBARI-703. Heartbeat handler classes. (jitendra)
  173. AMBARI-702. Add skeleton for Ambari agent that talks to the server and
  174. collects information for host. (mahadev)
  175. AMBARI-696. Add interface for ActionManager to access live state. (hitesh)
  176. AMBARI-698. Add a simple server and artifact generation to run a server with
  177. a simple api check. (mahadev)
  178. AMBARI-697. Ambari Web (browser-based UI) skeleton. (Jaimin Jetly and yusaku)
  179. AMBARI-695. More basic class restructuring for new design. (hitesh)
  180. AMBARI-694. Class to encapsulate stage. (jitendra)
  181. AMBARI-691. More basic classes for new design. (hitesh)
  182. AMBARI-693. Classes for request objects. (jitendra)
  183. AMBARI-685. Basic classes. (hitesh via jitendra)
  184. AMBARI-676. Seperate directory for ambari-server. (jitendra)
  185. IMPROVEMENTS
  186. AMBARI-891. Initial work to refactor the Wizards in Ambari Web. (yusaku)
  187. AMBARI-883. Improve user interactions on Confirm Hosts page of the
  188. Installer. (yusaku)
  189. AMBARI-859. Tighten up the layout for the Install page of the Installer.
  190. (yusaku)
  191. AMBARI-857. Refactor Install Options page for the Install Wizard. (yusaku)
  192. OPTIMIZATIONS
  193. BUG FIXES
  194. AMBARI-885. Fix miscellaneous issues related to Ambari Web. (yusaku)
  195. AMBARI-879. Installer skips Confirm Hosts page of the wizard when testing
  196. locally without Ambari Server. (yusaku)
  197. AMBARI-878. Various tests for FSM, controller and state objects. (hitesh)
  198. AMBARI-858. Installer -> Select Services page: warning popups are no longer
  199. appearing. (yusaku)
  200. AMBARI-846. Select Masters Page: make ZooKeeper addition/removal UI more
  201. organized. (Jaimin Jetly via yusaku)
  202. AMBARI-840. Hitting browser refresh should not clear present step data that
  203. had already been persisted to local DB. (Jaimin Jetly via yusaku)
  204. AMBARI-843. Fix more null pointers for partial request objects. (hitesh)
  205. AMBARI-842. Fix null point exception during adding of hosts to cluster. (hitesh)
  206. AMBARI-839. Temporary fix for server start order. (hitesh)
  207. AMBARI-837. Fix basic injection issues for controller impl. (hitesh)
  208. AMBARI-836. Fix generation of requestId to be unique across restarts. (hitesh)
  209. AMBARI-834. Use RoleCommand instead of ServiceComponentHostEventType for HostAction
  210. in Controller. (hitesh)
  211. AMBARI-830. Various fixes and tests for controller implementation. (hitesh)
  212. AMBARI-808. Handle appropriate start/stop/install/.. events at their respective
  213. failed states. (hitesh)
  214. AMBARI-798. Fix import issue due to move of Predicate class. (hitesh)
  215. AMBARI-780. Make FSM related changes for heartbeat handler. (hitesh)
  216. AMBARI-774. Renable and fix AgentResourceTest. (mahadev)
  217. AMBARI-773. Change Host FSM as per new requirements of heartbeat handler. (hitesh)
  218. AMBARI-753. Fix broken compile as a result of re-factor of FSM layout. (hitesh)
  219. AMBARI-752. Add missing license header to TestServiceComponentHostState. (hitesh)
  220. AMBARI-718. Fix installer navigation. (yusaku)
  221. AMBARI-684. Remove non-required dependencies from pom files (hitesh via jitendra)
  222. AMBARI-680. Fix pom structure. (hitesh)