hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/index.apt.vm

~~ Licensed under the Apache License, Version 2.0 (the "License");
~~ you may not use this file except in compliance with the License.
~~ You may obtain a copy of the License at
~~
~~   http://www.apache.org/licenses/LICENSE-2.0
~~
~~ Unless required by applicable law or agreed to in writing, software
~~ distributed under the License is distributed on an "AS IS" BASIS,
~~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
~~ See the License for the specific language governing permissions and
~~ limitations under the License. See accompanying LICENSE file.

  ---
  Apache Hadoop NextGen MapReduce
  ---
  ---
  ${maven.build.timestamp}
  
MapReduce NextGen aka YARN aka MRv2

  The new architecture introduced in hadoop-0.23, divides the two major 
  functions of the JobTracker: resource management and job life-cycle management 
  into separate components.

  The new ResourceManager manages the global assignment of compute resources to 
  applications and the per-application ApplicationMaster manages the 
  application’s scheduling and coordination. 
  
  An application is either a single job in the sense of classic MapReduce jobs 
  or a DAG of such jobs. 
  
  The ResourceManager and per-machine NodeManager daemon, which manages the 
  user processes on that machine, form the computation fabric. 
  
  The per-application ApplicationMaster is, in effect, a framework specific 
  library and is tasked with negotiating resources from the ResourceManager and 
  working with the NodeManager(s) to execute and monitor the tasks.

  More details are available in the {{{./YARN.html}YARN}}
  document.

* Documentation

  * {{{./YARN.html}NextGen MapReduce}}
  
  * {{{./WritingYarnApplications.html}Writing YARN Applications}}

  * {{{./CapacityScheduler.html}Capacity Scheduler}}

  * {{{./FairScheduler.html}Fair Scheduler}}

  * {{{./WebApplicationProxy.html}Web Application Proxy}}

  * {{{./TimelineServer.html}YARN Timeline Server}}

  * {{{../../hadoop-project-dist/hadoop-common/CLIMiniCluster.html}CLI MiniCluster}}

  * {{{../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html}Backward Compatibility between Apache Hadoop 1.x and 2.x for MapReduce}}

  * {{{../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/EncryptedShuffle.html}Encrypted Shuffle}}