hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/index.apt.vm

~~ Licensed under the Apache License, Version 2.0 (the "License");
~~ you may not use this file except in compliance with the License.
~~ You may obtain a copy of the License at
~~
~~   http://www.apache.org/licenses/LICENSE-2.0
~~
~~ Unless required by applicable law or agreed to in writing, software
~~ distributed under the License is distributed on an "AS IS" BASIS,
~~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
~~ See the License for the specific language governing permissions and
~~ limitations under the License. See accompanying LICENSE file.

  ---
  Apache Hadoop NextGen MapReduce
  ---
  ---
  ${maven.build.timestamp}
  
MapReduce NextGen aka YARN aka MRv2

  The new architecture introduced in hadoop-0.23, divides the two major 
  functions of the JobTracker: resource management and job life-cycle management 
  into separate components.

  The new ResourceManager manages the global assignment of compute resources to 
  applications and the per-application ApplicationMaster manages the 
  application’s scheduling and coordination. 
  
  An application is either a single job in the sense of classic MapReduce jobs 
  or a DAG of such jobs. 
  
  The ResourceManager and per-machine NodeManager daemon, which manages the 
  user processes on that machine, form the computation fabric. 
  
  The per-application ApplicationMaster is, in effect, a framework specific 
  library and is tasked with negotiating resources from the ResourceManager and 
  working with the NodeManager(s) to execute and monitor the tasks.

  More details are available in the {{{./YARN.html}Architecture}} document.


Documentation Index

* YARN

  * {{{./YARN.html}YARN Architecture}}
 
  * {{{./CapacityScheduler.html}Capacity Scheduler}}
 
  * {{{./FairScheduler.html}Fair Scheduler}}
 
  * {{{./ResourceManagerRestart.htaml}ResourceManager Restart}}
 
  * {{{./ResourceManagerHA.html}ResourceManager HA}}
 
  * {{{./WebApplicationProxy.html}Web Application Proxy}}
 
  * {{{./TimelineServer.html}YARN Timeline Server}}
 
  * {{{./WritingYarnApplications.html}Writing YARN Applications}}
 
  * {{{./YarnCommands.html}YARN Commands}}
 
  * {{{hadoop-sls/SchedulerLoadSimulator.html}Scheduler Load Simulator}}
 
  * {{{./NodeManagerRestart.html}NodeManager Restart}}
 
  * {{{./DockerContainerExecutor.html}DockerContainerExecutor}}
 
  * {{{./NodeManagerCGroups.html}Using CGroups}}
 
  * {{{./SecureContainer.html}Secure Containers}}
 
  * {{{./registry/index.html}Registry}}

* YARN REST APIs

  * {{{./WebServicesIntro.html}Introduction}}

  * {{{./ResourceManagerRest.html}Resource Manager}}

  * {{{./NodeManagerRest.html}Node Manager}}