about.html 6.6 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173
  1. <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
  2. <html>
  3. <head>
  4. <META http-equiv="Content-Type" content="text/html; charset=UTF-8">
  5. <meta content="Apache Forrest" name="Generator">
  6. <meta name="Forrest-version" content="0.7">
  7. <meta name="Forrest-skin-name" content="pelt">
  8. <title>About Hadoop</title>
  9. <link type="text/css" href="skin/basic.css" rel="stylesheet">
  10. <link media="screen" type="text/css" href="skin/screen.css" rel="stylesheet">
  11. <link media="print" type="text/css" href="skin/print.css" rel="stylesheet">
  12. <link type="text/css" href="skin/profile.css" rel="stylesheet">
  13. <script src="skin/getBlank.js" language="javascript" type="text/javascript"></script><script src="skin/getMenu.js" language="javascript" type="text/javascript"></script><script src="skin/fontsize.js" language="javascript" type="text/javascript"></script>
  14. <link rel="shortcut icon" href="images/favicon.ico">
  15. </head>
  16. <body onload="init()">
  17. <script type="text/javascript">ndeSetTextSize();</script>
  18. <div id="top">
  19. <div class="breadtrail">
  20. <a href="http://www.apache.org/">Apache</a> &gt; <a href="http://lucene.apache.org/">Lucene</a> &gt; <a href="http://lucene.apache.org/hadoop/">Hadoop</a><script src="skin/breadcrumbs.js" language="JavaScript" type="text/javascript"></script>
  21. </div>
  22. <div class="header">
  23. <div class="grouplogo">
  24. <a href="http://lucene.apache.org/"><img class="logoImage" alt="Lucene" src="images/lucene_green_150.gif" title="Apache Lucene"></a>
  25. </div>
  26. <div class="projectlogo">
  27. <a href="http://lucene.apache.org/hadoop/"><img class="logoImage" alt="Hadoop" src="images/hadoop-logo.jpg" title="Scalable Computing Platform"></a>
  28. </div>
  29. <div class="searchbox">
  30. <form action="http://www.google.com/search" method="get" class="roundtopsmall">
  31. <input value="lucene.apache.org" name="sitesearch" type="hidden"><input onFocus="getBlank (this, 'Search the site with google');" size="25" name="q" id="query" type="text" value="Search the site with google">&nbsp;
  32. <input attr="value" name="Search" value="Search" type="submit">
  33. </form>
  34. </div>
  35. <ul id="tabs">
  36. <li class="current">
  37. <a class="base-selected" href="index.html">Main</a>
  38. </li>
  39. <li>
  40. <a class="base-not-selected" href="http://wiki.apache.org/lucene-hadoop">Wiki</a>
  41. </li>
  42. </ul>
  43. </div>
  44. </div>
  45. <div id="main">
  46. <div id="publishedStrip">
  47. <div id="level2tabs"></div>
  48. <script type="text/javascript"><!--
  49. document.write("<text>Last Published:</text> " + document.lastModified);
  50. // --></script>
  51. </div>
  52. <div class="breadtrail">
  53. &nbsp;
  54. </div>
  55. <div id="menu">
  56. <div onclick="SwitchMenu('menu_selected_1.1', 'skin/')" id="menu_selected_1.1Title" class="menutitle" style="background-image: url('skin/images/chapter_open.gif');">Project</div>
  57. <div id="menu_selected_1.1" class="selectedmenuitemgroup" style="display: block;">
  58. <div class="menuitem">
  59. <a href="index.html">News</a>
  60. </div>
  61. <div class="menupage">
  62. <div class="menupagetitle">About</div>
  63. </div>
  64. <div class="menuitem">
  65. <a href="credits.html">Credits</a>
  66. </div>
  67. <div class="menuitem">
  68. <a href="http://www.cafepress.com/hadoop/">Buy Stuff</a>
  69. </div>
  70. </div>
  71. <div onclick="SwitchMenu('menu_1.2', 'skin/')" id="menu_1.2Title" class="menutitle">Documentation</div>
  72. <div id="menu_1.2" class="menuitemgroup">
  73. <div class="menuitem">
  74. <a href="http://wiki.apache.org/lucene-hadoop/FAQ">FAQ</a>
  75. </div>
  76. <div class="menuitem">
  77. <a href="http://wiki.apache.org/lucene-hadoop/">Wiki</a>
  78. </div>
  79. <div class="menuitem">
  80. <a href="hdfs_design.html">Hadoop File System</a>
  81. </div>
  82. <div class="menuitem">
  83. <a href="api/index.html">API Docs</a>
  84. </div>
  85. </div>
  86. <div onclick="SwitchMenu('menu_1.3', 'skin/')" id="menu_1.3Title" class="menutitle">Resources</div>
  87. <div id="menu_1.3" class="menuitemgroup">
  88. <div class="menuitem">
  89. <a href="http://www.apache.org/dyn/closer.cgi/lucene/hadoop/">Download</a>
  90. </div>
  91. <div class="menuitem">
  92. <a href="mailing_lists.html">Mailing Lists</a>
  93. </div>
  94. <div class="menuitem">
  95. <a href="issue_tracking.html">Issue Tracking</a>
  96. </div>
  97. <div class="menuitem">
  98. <a href="version_control.html">Version Control</a>
  99. </div>
  100. </div>
  101. <div onclick="SwitchMenu('menu_1.4', 'skin/')" id="menu_1.4Title" class="menutitle">Related Projects</div>
  102. <div id="menu_1.4" class="menuitemgroup">
  103. <div class="menuitem">
  104. <a href="http://lucene.apache.org/java/">Lucene</a>
  105. </div>
  106. <div class="menuitem">
  107. <a href="http://lucene.apache.org/nutch/">Nutch</a>
  108. </div>
  109. </div>
  110. <div id="credit"></div>
  111. <div id="roundbottom">
  112. <img style="display: none" class="corner" height="15" width="15" alt="" src="skin/images/rc-b-l-15-1body-2menu-3menu.png"></div>
  113. <div id="credit2"></div>
  114. </div>
  115. <div id="content">
  116. <div title="Portable Document Format" class="pdflink">
  117. <a class="dida" href="about.pdf"><img alt="PDF -icon" src="skin/images/pdfdoc.gif" class="skin"><br>
  118. PDF</a>
  119. </div>
  120. <h1>About Hadoop</h1>
  121. <div id="minitoc-area">
  122. <ul class="minitoc">
  123. <li>
  124. <a href="#Overview">Overview</a>
  125. </li>
  126. </ul>
  127. </div>
  128. <a name="N1000C"></a><a name="Overview"></a>
  129. <h2 class="h3">Overview</h2>
  130. <div class="section">
  131. <p>Hadoop is a framework for running applications on large
  132. clusters of commodity hardware. The Hadoop framework
  133. transparently provides applications both reliability and data
  134. motion. Hadoop implements a computational paradigm named
  135. map/reduce, where the application is divided into many small
  136. fragments of work, each of which may be executed or reexecuted
  137. on any node in the cluster. In addition, it provides a
  138. distributed file system that stores data on the compute nodes,
  139. providing very high aggregate bandwidth across the cluster. Both
  140. map/reduce and the distributed file system are designed so that
  141. node failures are automatically handled by the framework.</p>
  142. <p>The intent is to scale Hadoop up to handling thousand of
  143. computers. Hadoop has been tested on clusters of 600
  144. nodes.</p>
  145. <p>Hadoop is a <a href="http://lucene.apache.org/java/">Lucene</a> sub-project
  146. that contains the distributed computing platform that was
  147. formerly a part of <a href="http://lucene.apache.org/nutch/">Nutch</a>. This
  148. includes the Hadoop Distributed Filesystem (HDFS) and an
  149. implementation of map/reduce.</p>
  150. <p>For more information about Hadoop, please see the <a href="http://wiki.apache.org/lucene-hadoop/">Hadoop wiki.</a>
  151. </p>
  152. </div>
  153. </div>
  154. <div class="clearboth">&nbsp;</div>
  155. </div>
  156. <div id="footer">
  157. <div class="lastmodified">
  158. <script type="text/javascript"><!--
  159. document.write("<text>Last Published:</text> " + document.lastModified);
  160. // --></script>
  161. </div>
  162. <div class="copyright">
  163. Copyright &copy;
  164. 2005 <a href="http://www.apache.org/licenses/">The Apache Software Foundation.</a>
  165. </div>
  166. </div>
  167. </body>
  168. </html>