HADOOP-3502. Quota API needs documentation in Forrest. Contributed by Hairong Kuang.

git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@664144 13f79535-47bb-0310-9956-ffa450edef68

CHANGES.txt

@@ -151,6 +151,8 @@ Trunk (unreleased changes)
 
     HADOOP-930. Add support for native S3 files.  (tomwhite via cutting)
 
+    HADOOP-3502. Quota API needs documentation in Forrest. (hairong)
+
   IMPROVEMENTS
    
     HADOOP-2928. Remove deprecated FileSystem.getContentLength().

docs/changes.html

@@ -56,7 +56,7 @@
 </a></h2>
 <ul id="trunk_(unreleased_changes)_">
   <li><a href="javascript:toggleList('trunk_(unreleased_changes)_._incompatible_changes_')">  INCOMPATIBLE CHANGES
-</a>&nbsp;&nbsp;&nbsp;(14)
+</a>&nbsp;&nbsp;&nbsp;(18)
     <ol id="trunk_(unreleased_changes)_._incompatible_changes_">
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-2703">HADOOP-2703</a>.  The default options to fsck skips checking files
 that are being written to. The output of fsck is incompatible
@@ -106,10 +106,20 @@ CompletedJobStatusStore.<br />(enis via omaley)</li>
 recovery. The block gets a new  generation stamp.
 (Tsz Wo (Nicholas), SZE via dhruba)
 </li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-2909">HADOOP-2909</a>. Improve IPC idle connection management. Property
+ipc.client.maxidletime is removed from the default configuration,
+instead it is defined as twice of the ipc.client.connection.maxidletime.
+A connection with outstanding requests won't be treated as idle.<br />(hairong)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3459">HADOOP-3459</a>. Change in the output format of dfs -ls to more closely match
+/bin/ls. New format is: perm repl owner group size date name<br />(Mukund Madhugiri via omally)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3113">HADOOP-3113</a>. An fsync invoked on a HDFS file really really persists data! The datanode
+moves blocks in the tmp directory to the real block directory on a datanode-restart.<br />(dhruba)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3452">HADOOP-3452</a>. Change fsck to return non-zero status for a corrupt
+FileSystem.<br />(lohit vijayarenu via cdouglas)</li>
     </ol>
   </li>
   <li><a href="javascript:toggleList('trunk_(unreleased_changes)_._new_features_')">  NEW FEATURES
-</a>&nbsp;&nbsp;&nbsp;(15)
+</a>&nbsp;&nbsp;&nbsp;(22)
     <ol id="trunk_(unreleased_changes)_._new_features_">
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-3074">HADOOP-3074</a>. Provides a UrlStreamHandler for DFS and other FS,
 relying on FileSystem<br />(taton)</li>
@@ -145,10 +155,22 @@ HDFS filesystem on systems that support FUSE, e.g., Linux.<br />(Pete Wyckoff vi
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-3250">HADOOP-3250</a>. Extend FileSystem API to allow appending to files.
 (Tsz Wo (Nicholas), SZE via cdouglas)
 </li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3177">HADOOP-3177</a>. Implement Syncable interface for FileSystem.
+(Tsz Wo (Nicholas), SZE via dhruba)
+</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-1328">HADOOP-1328</a>. Implement user counters in streaming.<br />(tomwhite via
+omalley)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3187">HADOOP-3187</a>. Quotas for namespace management.<br />(Hairong Kuang via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3307">HADOOP-3307</a>. Support for Archives in Hadoop.<br />(Mahadev Konar via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3460">HADOOP-3460</a>. Add SequenceFileAsBinaryOutputFormat to permit direct
+writes of serialized data.<br />(Koji Noguchi via cdouglas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3230">HADOOP-3230</a>. Add ability to get counter values from command
+line.<br />(tomwhite via omalley)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-930">HADOOP-930</a>. Add support for native S3 files.<br />(tomwhite via cutting)</li>
     </ol>
   </li>
   <li><a href="javascript:toggleList('trunk_(unreleased_changes)_._improvements_')">  IMPROVEMENTS
-</a>&nbsp;&nbsp;&nbsp;(22)
+</a>&nbsp;&nbsp;&nbsp;(30)
     <ol id="trunk_(unreleased_changes)_._improvements_">
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-2928">HADOOP-2928</a>. Remove deprecated FileSystem.getContentLength().<br />(Lohit Vjayarenu via rangadi)</li>
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-3130">HADOOP-3130</a>. Make the connect timeout smaller for getFile.<br />(Amar Ramesh Kamat via ddas)</li>
@@ -196,10 +218,32 @@ nodes otherwise.<br />(Johan Oskarsson via rangadi)</li>
 datanode, now can report corrupt replicas received from src node to
 the namenode.<br />(Lohit Vijayarenu via rangadi)</li>
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-3434">HADOOP-3434</a>. Retain the cause of the bind failure in Server::bind.<br />(Steve Loughran via cdouglas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3429">HADOOP-3429</a>. Increases the size of the buffers used for the communication
+for Streaming jobs.<br />(Amareshwari Sriramadasu via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3486">HADOOP-3486</a>. Change default for initial block report to 0 seconds
+and document it.<br />(Sanjay Radia via omalley)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3448">HADOOP-3448</a>. Improve the text in the assertion making sure the
+layout versions are consistent in the data node.<br />(Steve Loughran
+via omalley)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-2095">HADOOP-2095</a>. Improve the Map-Reduce shuffle/merge by cutting down
+buffer-copies; changed intermediate sort/merge to use the new IFile format
+rather than SequenceFiles and compression of map-outputs is now
+implemented by compressing the entire file rather than SequenceFile
+compression. Shuffle also has been changed to use a simple byte-buffer
+manager rather than the InMemoryFileSystem.
+Configuration changes to hadoop-default.xml:
+  deprecated mapred.map.output.compression.type<br />(acmurthy)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-236">HADOOP-236</a>. JobTacker now refuses connection from a task tracker with a
+different version number.<br />(Sharad Agarwal via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3427">HADOOP-3427</a>. Improves the shuffle scheduler. It now waits for notifications
+from shuffle threads when it has scheduled enough, before scheduling more.<br />(ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-2393">HADOOP-2393</a>. Moves the handling of dir deletions in the tasktracker to
+a separate thread.<br />(Amareshwari Sriramadasu via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3501">HADOOP-3501</a>. Deprecate InMemoryFileSystem.<br />(cutting via omalley)</li>
     </ol>
   </li>
   <li><a href="javascript:toggleList('trunk_(unreleased_changes)_._optimizations_')">  OPTIMIZATIONS
-</a>&nbsp;&nbsp;&nbsp;(9)
+</a>&nbsp;&nbsp;&nbsp;(10)
     <ol id="trunk_(unreleased_changes)_._optimizations_">
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-3274">HADOOP-3274</a>. The default constructor of BytesWritable creates empty
 byte array. (Tsz Wo (Nicholas), SZE via shv)
@@ -217,10 +261,13 @@ tracker and task tracker.<br />(ddas via omalley)</li>
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-3369">HADOOP-3369</a>. Fast block processing during name-node startup.<br />(shv)</li>
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-1702">HADOOP-1702</a>. Reduce buffer copies when data is written to DFS.
 DataNodes take 30% less CPU while writing data.<br />(rangadi)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3095">HADOOP-3095</a>. Speed up split generation in the FileInputSplit,
+especially for non-HDFS file systems. Deprecates
+InputFormat.validateInput.<br />(tomwhite via omalley)</li>
     </ol>
   </li>
   <li><a href="javascript:toggleList('trunk_(unreleased_changes)_._bug_fixes_')">  BUG FIXES
-</a>&nbsp;&nbsp;&nbsp;(58)
+</a>&nbsp;&nbsp;&nbsp;(72)
     <ol id="trunk_(unreleased_changes)_._bug_fixes_">
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-2905">HADOOP-2905</a>. 'fsck -move' triggers NPE in NameNode.<br />(Lohit Vjayarenu via rangadi)</li>
       <li>Increment ClientProtocol.versionID missed by <a href="http://issues.apache.org/jira/browse/HADOOP-2585">HADOOP-2585</a>.<br />(shv)</li>
@@ -343,6 +390,35 @@ io.sort.mb.<br />(cdouglas)</li>
 single spill.<br />(omalley via cdouglas)</li>
       <li><a href="http://issues.apache.org/jira/browse/HADOOP-3454">HADOOP-3454</a>. Fix Text::find to search only valid byte ranges.<br />(Chad Whipkey
 via cdouglas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3417">HADOOP-3417</a>. Removes the static configuration variable, commandLineConfig from
+JobClient. Moves the cli parsing from JobShell to GenericOptionsParser.
+Thus removes the class org.apache.hadoop.mapred.JobShell.<br />(Amareshwari Sriramadasu via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-2132">HADOOP-2132</a>. Only RUNNING/PREP jobs can be killed.<br />(Jothi Padmanabhan via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3472">HADOOP-3472</a> MapFile.Reader getClosest() function returns incorrect results
+when before is true<br />(Todd Lipcon via Stack)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3476">HADOOP-3476</a>. Code cleanup in fuse-dfs.<br />(Peter Wyckoff via dhruba)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-2427">HADOOP-2427</a>. Ensure that the cwd of completed tasks is cleaned-up
+correctly on task-completion.<br />(Amareshwari Sri Ramadasu via acmurthy)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-2565">HADOOP-2565</a>. Remove DFSPath cache of FileStatus.
+(Tsz Wo (Nicholas), SZE via hairong)
+</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3326">HADOOP-3326</a>. Cleanup the local-fs and in-memory merge in the ReduceTask by
+spawing only one thread each for the on-disk and in-memory merge.<br />(Sharad Agarwal via acmurthy)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3493">HADOOP-3493</a>. Fix TestStreamingFailure to use FileUtil.fullyDelete to
+ensure correct cleanup.<br />(Lohit Vijayarenu via acmurthy)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3455">HADOOP-3455</a>. Fix NPE in ipc.Client in case of connection failure and
+improve its synchronization.<br />(hairong)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3240">HADOOP-3240</a>. Fix a testcase to not create files in the current directory.
+Instead the file is created in the test directory<br />(Mahadev Konar via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3496">HADOOP-3496</a>.  Fix failure in TestHarFileSystem.testArchives due to change
+in <a href="http://issues.apache.org/jira/browse/HADOOP-3095">HADOOP-3095</a>.<br />(tomwhite)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3135">HADOOP-3135</a>. Get the system directory from the JobTracker instead of from
+the conf.<br />(Subramaniam Krishnan via ddas)</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3503">HADOOP-3503</a>. Fix a race condition when client and namenode start simultaneous
+recovery of the same block.  (dhruba &amp; Tsz Wo (Nicholas), SZE)
+</li>
+      <li><a href="http://issues.apache.org/jira/browse/HADOOP-3440">HADOOP-3440</a>. Fixes DistributedCache to not create symlinks for paths which
+don't have fragments even when createSymLink is true.<br />(Abhijit Bagri via ddas)</li>
     </ol>
   </li>
 </ul>

docs/cluster_setup.html

@@ -123,6 +123,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/hdfs_design.html

@@ -125,6 +125,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/hdfs_permissions_guide.html

@@ -125,6 +125,9 @@ document.write("Last Published: " + document.lastModified);
 <div class="menupagetitle">HDFS Permissions Guide</div>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/hdfs_quota_admin_guide.html

@@ -0,0 +1,278 @@
+<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<html>
+<head>
+<META http-equiv="Content-Type" content="text/html; charset=UTF-8">
+<meta content="Apache Forrest" name="Generator">
+<meta name="Forrest-version" content="0.8">
+<meta name="Forrest-skin-name" content="pelt">
+<title>
+      Hadoop DFS Name Space Quotas Administrator Guide
+    </title>
+<link type="text/css" href="skin/basic.css" rel="stylesheet">
+<link media="screen" type="text/css" href="skin/screen.css" rel="stylesheet">
+<link media="print" type="text/css" href="skin/print.css" rel="stylesheet">
+<link type="text/css" href="skin/profile.css" rel="stylesheet">
+<script src="skin/getBlank.js" language="javascript" type="text/javascript"></script><script src="skin/getMenu.js" language="javascript" type="text/javascript"></script><script src="skin/fontsize.js" language="javascript" type="text/javascript"></script>
+<link rel="shortcut icon" href="images/favicon.ico">
+</head>
+<body onload="init()">
+<script type="text/javascript">ndeSetTextSize();</script>
+<div id="top">
+<!--+
+    |breadtrail
+    +-->
+<div class="breadtrail">
+<a href="http://www.apache.org/">Apache</a> &gt; <a href="http://hadoop.apache.org/">Hadoop</a> &gt; <a href="http://hadoop.apache.org/core/">Core</a><script src="skin/breadcrumbs.js" language="JavaScript" type="text/javascript"></script>
+</div>
+<!--+
+    |header
+    +-->
+<div class="header">
+<!--+
+    |start group logo
+    +-->
+<div class="grouplogo">
+<a href="http://hadoop.apache.org/"><img class="logoImage" alt="Hadoop" src="images/hadoop-logo.jpg" title="Apache Hadoop"></a>
+</div>
+<!--+
+    |end group logo
+    +-->
+<!--+
+    |start Project Logo
+    +-->
+<div class="projectlogo">
+<a href="http://hadoop.apache.org/core/"><img class="logoImage" alt="Hadoop" src="images/core-logo.gif" title="Scalable Computing Platform"></a>
+</div>
+<!--+
+    |end Project Logo
+    +-->
+<!--+
+    |start Search
+    +-->
+<div class="searchbox">
+<form action="http://www.google.com/search" method="get" class="roundtopsmall">
+<input value="hadoop.apache.org" name="sitesearch" type="hidden"><input onFocus="getBlank (this, 'Search the site with google');" size="25" name="q" id="query" type="text" value="Search the site with google">&nbsp; 
+                    <input name="Search" value="Search" type="submit">
+</form>
+</div>
+<!--+
+    |end search
+    +-->
+<!--+
+    |start Tabs
+    +-->
+<ul id="tabs">
+<li>
+<a class="unselected" href="http://hadoop.apache.org/core/">Project</a>
+</li>
+<li>
+<a class="unselected" href="http://wiki.apache.org/hadoop">Wiki</a>
+</li>
+<li class="current">
+<a class="selected" href="index.html">Hadoop 0.18 Documentation</a>
+</li>
+</ul>
+<!--+
+    |end Tabs
+    +-->
+</div>
+</div>
+<div id="main">
+<div id="publishedStrip">
+<!--+
+    |start Subtabs
+    +-->
+<div id="level2tabs"></div>
+<!--+
+    |end Endtabs
+    +-->
+<script type="text/javascript"><!--
+document.write("Last Published: " + document.lastModified);
+//  --></script>
+</div>
+<!--+
+    |breadtrail
+    +-->
+<div class="breadtrail">
+
+             &nbsp;
+           </div>
+<!--+
+    |start Menu, mainarea
+    +-->
+<!--+
+    |start Menu
+    +-->
+<div id="menu">
+<div onclick="SwitchMenu('menu_selected_1.1', 'skin/')" id="menu_selected_1.1Title" class="menutitle" style="background-image: url('skin/images/chapter_open.gif');">Documentation</div>
+<div id="menu_selected_1.1" class="selectedmenuitemgroup" style="display: block;">
+<div class="menuitem">
+<a href="index.html">Overview</a>
+</div>
+<div class="menuitem">
+<a href="quickstart.html">Quickstart</a>
+</div>
+<div class="menuitem">
+<a href="cluster_setup.html">Cluster Setup</a>
+</div>
+<div class="menuitem">
+<a href="hdfs_design.html">HDFS Architecture</a>
+</div>
+<div class="menuitem">
+<a href="hdfs_user_guide.html">HDFS User Guide</a>
+</div>
+<div class="menuitem">
+<a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
+</div>
+<div class="menupage">
+<div class="menupagetitle">HDFS Quotas Administrator Guide</div>
+</div>
+<div class="menuitem">
+<a href="hdfs_shell.html">FS Shell Guide</a>
+</div>
+<div class="menuitem">
+<a href="mapred_tutorial.html">Map-Reduce Tutorial</a>
+</div>
+<div class="menuitem">
+<a href="native_libraries.html">Native Hadoop Libraries</a>
+</div>
+<div class="menuitem">
+<a href="streaming.html">Streaming</a>
+</div>
+<div class="menuitem">
+<a href="hod.html">Hadoop On Demand</a>
+</div>
+<div class="menuitem">
+<a href="api/index.html">API Docs</a>
+</div>
+<div class="menuitem">
+<a href="http://wiki.apache.org/hadoop/">Wiki</a>
+</div>
+<div class="menuitem">
+<a href="http://wiki.apache.org/hadoop/FAQ">FAQ</a>
+</div>
+<div class="menuitem">
+<a href="http://hadoop.apache.org/core/mailing_lists.html">Mailing Lists</a>
+</div>
+<div class="menuitem">
+<a href="releasenotes.html">Release Notes</a>
+</div>
+<div class="menuitem">
+<a href="changes.html">All Changes</a>
+</div>
+</div>
+<div id="credit"></div>
+<div id="roundbottom">
+<img style="display: none" class="corner" height="15" width="15" alt="" src="skin/images/rc-b-l-15-1body-2menu-3menu.png"></div>
+<!--+
+  |alternative credits
+  +-->
+<div id="credit2"></div>
+</div>
+<!--+
+    |end Menu
+    +-->
+<!--+
+    |start content
+    +-->
+<div id="content">
+<div title="Portable Document Format" class="pdflink">
+<a class="dida" href="hdfs_quota_admin_guide.pdf"><img alt="PDF -icon" src="skin/images/pdfdoc.gif" class="skin"><br>
+        PDF</a>
+</div>
+<h1>
+      Hadoop DFS Name Space Quotas Administrator Guide
+    </h1>
+      
+<p>
+      HDFS allows the administrator to set quotas on individual directories. 
+      Newly created directories have no associated quota. 
+      The largest quota is Long.Max_Value. A quota of one forces a directory 
+      to remain empty.
+      </p>
+
+      
+<p>
+      The directory quota is a hard limit on the number of names in the tree 
+      rooted at that directory. File/directory creations fault if the quota 
+      would be exceeded. Quotas stick to renamed directories; the rename 
+      operation faults if operation would result in a quota violation. 
+      The attempt to set a quota faults if the directory would be in violation 
+      of the new quota.
+      </p>
+
+      
+<p>
+      Quotas are persistent with the fsimage. When starting, if the fsimage 
+      is immediately in violation of aquota (perhaps the fsimage was 
+      surreptitiously modified), startup operation fails with an error report. 
+      Setting/removing a quota creates a journal entry.
+      </p> 
+
+      
+<p>
+      The following new commands or new options are added to support quotas. 
+      The first two are administration commands.
+      </p>
+
+      
+<ul>
+      
+<li>
+      
+<strong><em>dfsadmin -setquota &lt;N&gt; &lt;directory&gt;...&lt;directory&gt;</em></strong> 
+      
+<br>
+      Set the quota <em></em> for each directory. Best effort for each directory,
+      with faults reported if <em>N</em> is not a positive long integer, 
+      the directory does not exist or it is a file, or the directory would 
+      immediately exceed the new quota.
+      </li>
+  
+      
+<li>
+      
+<strong><em>dfsadmin -clrquota &lt;directory&gt;...&lt;director&gt;</em></strong>
+<br> 
+      Remove any quota for each directory. Best effort for each directory, 
+      with faults reported if the directory does not exist or it is a file. 
+      It is not a fault if the directory has no quota.
+      </li>
+  
+      
+<li>
+      
+<strong><em>fs -count -q &lt;directory&gt;...&lt;directory&gt;</em></strong>
+<br>
+      With the <em>-q</em> option, also report the quota value set for each 
+      directory, and the available quota remaining. If the directory does not have 
+      a quota set, the reported values are <em>none</em> and <em>inf</em>.
+      </li>
+      
+</ul>
+   
+</div>
+<!--+
+    |end content
+    +-->
+<div class="clearboth">&nbsp;</div>
+</div>
+<div id="footer">
+<!--+
+    |start bottomstrip
+    +-->
+<div class="lastmodified">
+<script type="text/javascript"><!--
+document.write("Last Published: " + document.lastModified);
+//  --></script>
+</div>
+<div class="copyright">
+        Copyright &copy;
+         2007 <a href="http://www.apache.org/licenses/">The Apache Software Foundation.</a>
+</div>
+<!--+
+    |end bottomstrip
+    +-->
+</div>
+</body>
+</html>

docs/hdfs_quota_admin_guide.pdf

@@ -0,0 +1,102 @@
+%PDF-1.3
+%ª«¬­
+4 0 obj
+<< /Type /Info
+/Producer (FOP 0.20.5) >>
+endobj
+5 0 obj
+<< /Length 1627 /Filter [ /ASCII85Decode /FlateDecode ]
+ >>
+stream
+Gb!;dbAQW(&Dd46ZqQ!<d>PGl()KNqV@U$7dMTZUVC3:<ZIqjE6;_pspSAohLG\6@`U0D@+s'n)R5sk"k07XaFW5[)iWn>?Qj*H'C_h9]=m-%[0D(S/Z[!2YnN?JFQ1t1/%le4'3VP/$74Q&6qtB_L$$Wm'8pY/i#/pD!$/D,!IsA#d$j0q>$s_s1X_B:F(5sd2mlQu%8bqWeH!rNjXW<'ki6R$dnoSm]p"u:uZ=LRJa^RWQQ_r$l*Mu$06n%#>$=tls>(*8j::E(KE2fGjP`nc^9hFZOVfuZQ^+(kt":LCI!(-4m:\JdZ_j']rDa?KCE#c>=bNO2Vk!/?G"i2TA?^''"('FoerljZ8rsO;Oo/Bot"Is`(<+cBQNEF)`'cHDV/JufAV"beX=*r(LWA"LD+]TanIB11,p4L%E%1J/O'6%?H&.S[nBgm`h?F3&#]BY5l4'8n,/msUKc4HKGM)2$**XenNV*h1^LlulEVgF5;Bh>HYcjV3o=Uj.;E*!)cZuC8,TXnW=$+t]gDj$HGOIYC)g?srLC^&)_FqmH,UUA:.`EZ+Jct-QE>TSq-a_D)'_De3-mGV8U2koH1e\M?k@OH8%b0&[JZb\4*cXSh6YRl5<]OUlMD4c\e][9e.;@WdnKP0`d]q*74Gj&:<80Tp0bZ_k'*%4b:aur%*JB!V,NPg4mdL*2:>l;5X_!tH5/nhr4GR%^,=n][!.p:@"OG=4?8'MZ_ZrFC"%5>&LhT$[f%;oEtoZ5(Des.9=U_-S[lWWLc`H#-YP!>OF(t`rT)sp'e/#,X%Uo'EK+:L11kA]<Omhci`>7X-ol+)tHKPfh+pU%`G`pHFX0@oY3&d)9-Nd2Qs'/b`UPuOuZb%TXFFe5k<_K?@Q$$X&))Ilrd`K'O0D@UM'FA3:2abX2dU7`J=$F+)q8PAtq#Y($;B3P</U&#"'(tsgT/-juTSPFNj,'6XPNtfGR*Ada$abt=]6!:pd"49[;f6<j;E#<PdI,>1W#mra37\T+n#GS>9pV&1dNX<ur_8Et#Is.S!4Alks1>d-ikZ#71bS;fi'eH/0`(_AuO$Gth_FJYfKtA"kTdZ2p-b9@:LVa1rUsXss:c%u<CKN)7'P,Z=K=s`i6.U]r3:^N]CcR..5dO*i-qjc^*V)W(a"/JF]<H(_I'TFYJOs?&@I%5;$.t#7Y.H^3^gDPl3C>J?/BsTJgh]`45JGs6d5"^Ci7EDg^^4/UIi&#)3mpn8;2RU\I=T'1Vc=4WqU)"qlK@p@!3q3a_:n],Xm9X4qXK@+]%8nMVudgNbZG*1kN2<%=>^[_<TeiqVQnDi*MUWIbFtsWd/2l^3(Hk6<uBTq-sKrbbUh6;XhS_&r;c$fq=hQIq1QX4hFbA9T1Y<N9OK2<bp:3?nKpS#2H\",VRQ2U+#bd:OLS?BnV/+C1hiY1AI$:HMb$@2<d-VQ$8;ZK]E[<M,q&G7*2U4RXc$+9P0gS@n(I/1Zfg;AF(j&W=SN9b,t"nf+!H[YYF+.lDYaah8:L#'(SkcP8.`9Q%2&/tF6"o_M83fa)qMZB]&!iU)Xf:#,8;UV$A*tp-D!=,f8V=WG_=-GZ(!`KpuGK$JR&/bT@D"]$%qU\aJ:,04'\-=6iRDg%oCO~>
+endstream
+endobj
+6 0 obj
+<< /Type /Page
+/Parent 1 0 R
+/MediaBox [ 0 0 612 792 ]
+/Resources 3 0 R
+/Contents 5 0 R
+>>
+endobj
+7 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F3
+/BaseFont /Helvetica-Bold
+/Encoding /WinAnsiEncoding >>
+endobj
+8 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F5
+/BaseFont /Times-Roman
+/Encoding /WinAnsiEncoding >>
+endobj
+9 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F8
+/BaseFont /Times-BoldItalic
+/Encoding /WinAnsiEncoding >>
+endobj
+10 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F6
+/BaseFont /Times-Italic
+/Encoding /WinAnsiEncoding >>
+endobj
+11 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F1
+/BaseFont /Helvetica
+/Encoding /WinAnsiEncoding >>
+endobj
+12 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F2
+/BaseFont /Helvetica-Oblique
+/Encoding /WinAnsiEncoding >>
+endobj
+1 0 obj
+<< /Type /Pages
+/Count 1
+/Kids [6 0 R ] >>
+endobj
+2 0 obj
+<< /Type /Catalog
+/Pages 1 0 R
+ >>
+endobj
+3 0 obj
+<< 
+/Font << /F3 7 0 R /F5 8 0 R /F8 9 0 R /F1 11 0 R /F6 10 0 R /F2 12 0 R >> 
+/ProcSet [ /PDF /ImageC /Text ] >> 
+endobj
+xref
+0 13
+0000000000 65535 f 
+0000002566 00000 n 
+0000002624 00000 n 
+0000002674 00000 n 
+0000000015 00000 n 
+0000000071 00000 n 
+0000001790 00000 n 
+0000001896 00000 n 
+0000002008 00000 n 
+0000002117 00000 n 
+0000002231 00000 n 
+0000002342 00000 n 
+0000002450 00000 n 
+trailer
+<<
+/Size 13
+/Root 2 0 R
+/Info 4 0 R
+>>
+startxref
+2805
+%%EOF

docs/hdfs_shell.html

@@ -122,6 +122,9 @@ document.write("Last Published: " + document.lastModified);
 <div class="menuitem">
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
+<div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
 <div class="menupage">
 <div class="menupagetitle">FS Shell Guide</div>
 </div>

docs/hdfs_user_guide.html

@@ -125,6 +125,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/hod.html

@@ -125,6 +125,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/hod_admin_guide.html

@@ -125,6 +125,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/hod_config_guide.html

@@ -125,6 +125,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/hod_user_guide.html

@@ -125,6 +125,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/index.html

@@ -123,6 +123,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/linkmap.html

@@ -123,6 +123,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">
@@ -228,6 +231,12 @@ document.write("Last Published: " + document.lastModified);
 </li>
 </ul>
     
+<ul>
+<li>
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>&nbsp;&nbsp;___________________&nbsp;&nbsp;<em>hdfs</em>
+</li>
+</ul>
+    
 <ul>
 <li>
 <a href="hdfs_shell.html">FS Shell Guide</a>&nbsp;&nbsp;___________________&nbsp;&nbsp;<em>fs</em>

docs/linkmap.pdf

@@ -5,10 +5,10 @@
 /Producer (FOP 0.20.5) >>
 endobj
 5 0 obj
-<< /Length 1033 /Filter [ /ASCII85Decode /FlateDecode ]
+<< /Length 1076 /Filter [ /ASCII85Decode /FlateDecode ]
  >>
 stream
-Gatn&>u03/'Sc)R.rkq4GlCHY=^[1_HoKM,`\a+%,o12m&dPdn^EbFk%19'974Pa@SG2R<H2V_"c+]\Z%oWJABK:_4^N]srq\es4o7su_*TIh8_?2GpH,'(h9$;YO!;f(RAFE4R%kFpQ#9n/S=jN";h``N1/TY4bH[i]l8#+9jKT38^a*\tJ8<$l=Wi?NEg*_5j>P-/LJa""Ce(1Mb4)qN/B2VqYQ*P`\:Fmf/8QE@'@pPE6Ct[293t"=kCtNY\B(&D/_)<m(6U5!jHRb2QB]m6?-iE`+B,crI$&F!4_@X=&boDK^0Q/*_!Z3uN#7-a>*uAq1C48+8<KU'G,Es$%>::r[pPK"AG(AQ6HN<I(8X<.E5#8%b";&LWNFEiKN!s/,%$4cH.Xn>'..q[?Ahmu!4Bc/`k\*5-(VQP)b3DUBZ7k^$eFhn.,>Hk!flIiX'6+GDe%S^e6(T-i/:,0Y)5g1TG:oBo)MWdk^f=*mj`hA8ap.h'ErN0,]RHn]nc;u&39.1:DRcgJGJ_%Vj[rNQj6Z&pW$uFeJq;+L)`?]/I^5@XWQ_Zob-<#i6E.$!""O]U6$JlXotcV]lIafpU08A0'%u?I_R=QcX4qH;V+em3Gq`p;Me5t=Z8f<4d&);imRg>+=\T+@%$3s6J_1^-L4cX5kYd;'b3qR#^(Q$'OfFI'`n$FNJAkh@nM9Rfa)Yb:)&(2dJO\9l:Q$5kM;Y&9k#^Fl^2?`<RSqpX=cSkOX&1ntU-Ua:;@dLt:n&djqK!HjN5rtkN]EM7Ih9X1^(cXg1sII\a9LfoA]=jW_cD*[&*UoK209Ng'6+GDcp9nOa@qK6>%K;n4afaB54&hsNaaHDg]SYX7!.&ep9o"+MZ!GUPahd"WN-iM`9^h-)U0>8b>rh.5gTa"o4Y$3!G5Xe^#eU,G1^-LE:Y&c/nk@[.C8GUW')SMk(NplhZt5;l[PbB:N_0a]#>*N4Ue$&?.r3Bau3Ubf^:DMV1'2V20)UEH.#t'JG#@&T':@NQ.;5GZ04b+TV)(1_uOAD~>
+Gatn&>u03/'Sc)R.rkq4GlCHY=^[1_C]iC*(Lrn-iY%/+.>\/\^Rl0,A&CX55V'7NUR_)Kaa%CnE&mf7639g]%$mq3D#]Y9$uTZ*JEDcA\/jTD!lC^?\IO)U/X2Ru_#Y#jF(Of6't7t`km*O63d7`nX1j!](0VKbh@G&?b:c>Q"UJ=D:QC,Pi/h-QAZ"`N"Db4-\S]_Q*slc(9%p`!AD]u$od6$Z)6&nU'1M17Bh,2S<KlXDP$lIn#2!&eiolO'$=iePA.`Y,_Dh\jBsso`/^&;i%!KL;?@K<`q29b_6m.Mp+4AGS(]s:EJg,`=LOF]7Sc!Jq1i)^<KN;Y='oc%!d9NBP9O94R`7k<Ic0kYdpNp'!/,:leM@i)bpGL*1cnR;35r:iMdAZ-7etUUAfpL$OX)dBV*MK5?l!<q?mO3!g/ZZV$(K*2UbDqsqCU<1Qei)M),c?'e5(bs\5$@N2o.%jU-$Lu3$l[0:e&YV8da`RS;T]4BiH,!sh7S2O<;Hf($97([phmUDWHZ3BQdo9i[;gBg:=PMqRpb;5lp_H[TV$VsMl,"@!M63)<@II)(:nmsm*h$uJg6n&Vg4@P*-@c6Ma\uar4QhkMufX%fA;4H7tV$D.Q.Nu12RY:NEe@g_b0!RZO0nE;IA$,hj$mU=_U!3_Ja%/\p$-C$gD1$9O1_o;R2l&NYrs/gk45o]X,QV_&'\G_Gp!K>Lj*IYV/oK;9.<#*&cWZ,^qECp9@lWrR/V>0[L+&l<--=8fXTlDp?Tm4+,l@@VSMT\+FuU@\^s-69OJ/TB]HO#&9d4+8ql@2o]A$2a`TcR:!T=`so`qGN1N5%bfjA:q8I"f!)QRrW#=<]a[-DgdW997!-cdQSOo%G2>"38j3-46:0CC5!?kWk(O7*_MM_[C]nrb3Qaa0o*.g)F?&sdP,F]'D',+N]C+%uSU_7[6-',]WC)2=:s!*&]9jVILJ;TfK?(lAKL<nPZR0F2]UT-[!A(TE8*/lOV/A'ET-CHm6[]J4(cmGubW1!p2^38=MfPX97-0AtPYI9``u<mkAs6jhSTaDmV:j_]b7sSIrs(0sQ(S~>
 endstream
 endobj
 6 0 obj
@@ -72,17 +72,17 @@ endobj
 xref
 0 12
 0000000000 65535 f 
-0000001857 00000 n 
-0000001915 00000 n 
-0000001965 00000 n 
+0000001900 00000 n 
+0000001958 00000 n 
+0000002008 00000 n 
 0000000015 00000 n 
 0000000071 00000 n 
-0000001196 00000 n 
-0000001302 00000 n 
-0000001414 00000 n 
-0000001523 00000 n 
-0000001633 00000 n 
-0000001741 00000 n 
+0000001239 00000 n 
+0000001345 00000 n 
+0000001457 00000 n 
+0000001566 00000 n 
+0000001676 00000 n 
+0000001784 00000 n 
 trailer
 <<
 /Size 12
@@ -90,5 +90,5 @@ trailer
 /Info 4 0 R
 >>
 startxref
-2085
+2128
 %%EOF

docs/mapred_tutorial.html

@@ -123,6 +123,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menupage">

docs/native_libraries.html

@@ -123,6 +123,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/quickstart.html

@@ -123,6 +123,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

docs/streaming.html

@@ -126,6 +126,9 @@ document.write("Last Published: " + document.lastModified);
 <a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
 </div>
 <div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
 <a href="hdfs_shell.html">FS Shell Guide</a>
 </div>
 <div class="menuitem">

src/docs/src/documentation/content/xdocs/hdfs_quota_admin_guide.xml

@@ -0,0 +1,84 @@
+<?xml version="1.0"?>
+<!--
+  Copyright 2002-2004 The Apache Software Foundation
+
+  Licensed under the Apache License, Version 2.0 (the "License");
+  you may not use this file except in compliance with the License.
+  You may obtain a copy of the License at
+
+      http://www.apache.org/licenses/LICENSE-2.0
+
+  Unless required by applicable law or agreed to in writing, software
+  distributed under the License is distributed on an "AS IS" BASIS,
+  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+  See the License for the specific language governing permissions and
+  limitations under the License.
+-->
+
+<!DOCTYPE document PUBLIC "-//APACHE//DTD Documentation V2.0//EN"
+          "http://forrest.apache.org/dtd/document-v20.dtd">
+
+
+<document>
+
+  <header>
+    <title>
+      Hadoop DFS Name Space Quotas Administrator Guide
+    </title>
+  </header>
+
+  <body>
+      <p>
+      HDFS allows the administrator to set quotas on individual directories. 
+      Newly created directories have no associated quota. 
+      The largest quota is Long.Max_Value. A quota of one forces a directory 
+      to remain empty.
+      </p>
+
+      <p>
+      The directory quota is a hard limit on the number of names in the tree 
+      rooted at that directory. File/directory creations fault if the quota 
+      would be exceeded. Quotas stick to renamed directories; the rename 
+      operation faults if operation would result in a quota violation. 
+      The attempt to set a quota faults if the directory would be in violation 
+      of the new quota.
+      </p>
+
+      <p>
+      Quotas are persistent with the fsimage. When starting, if the fsimage 
+      is immediately in violation of aquota (perhaps the fsimage was 
+      surreptitiously modified), startup operation fails with an error report. 
+      Setting/removing a quota creates a journal entry.
+      </p> 
+
+      <p>
+      The following new commands or new options are added to support quotas. 
+      The first two are administration commands.
+      </p>
+
+      <ul>
+      <li>
+      <strong><em>dfsadmin -setquota &lt;N> &lt;directory>...&lt;directory></em></strong> 
+      <br />
+      Set the quota <em></em> for each directory. Best effort for each directory,
+      with faults reported if <em>N</em> is not a positive long integer, 
+      the directory does not exist or it is a file, or the directory would 
+      immediately exceed the new quota.
+      </li>
+  
+      <li>
+      <strong><em>dfsadmin -clrquota &lt;directory>...&lt;director></em></strong><br /> 
+      Remove any quota for each directory. Best effort for each directory, 
+      with faults reported if the directory does not exist or it is a file. 
+      It is not a fault if the directory has no quota.
+      </li>
+  
+      <li>
+      <strong><em>fs -count -q &lt;directory>...&lt;directory></em></strong><br />
+      With the <em>-q</em> option, also report the quota value set for each 
+      directory, and the available quota remaining. If the directory does not have 
+      a quota set, the reported values are <em>none</em> and <em>inf</em>.
+      </li>
+      </ul>
+   </body>
+</document>

src/docs/src/documentation/content/xdocs/site.xml

@@ -38,6 +38,7 @@ See http://forrest.apache.org/docs/linking.html for more info.
     <hdfs      label="HDFS Architecture"  href="hdfs_design.html" />
     <hdfs      label="HDFS User Guide"    href="hdfs_user_guide.html" />
     <hdfs      label="HDFS Permissions Guide"    href="hdfs_permissions_guide.html" />
+    <hdfs      label="HDFS Quotas Administrator Guide" href="hdfs_quota_admin_guide.html" />
     <fs        label="FS Shell Guide"     href="hdfs_shell.html" />
     <mapred    label="Map-Reduce Tutorial" href="mapred_tutorial.html" />
     <mapred    label="Native Hadoop Libraries" href="native_libraries.html" />