| <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> |
| <html> |
| <head> |
| <META http-equiv="Content-Type" content="text/html; charset=UTF-8"> |
| <meta content="Apache Forrest" name="Generator"> |
| <meta name="Forrest-version" content="0.7"> |
| <meta name="Forrest-skin-name" content="pelt"> |
| <title>About Hadoop</title> |
| <link type="text/css" href="skin/basic.css" rel="stylesheet"> |
| <link media="screen" type="text/css" href="skin/screen.css" rel="stylesheet"> |
| <link media="print" type="text/css" href="skin/print.css" rel="stylesheet"> |
| <link type="text/css" href="skin/profile.css" rel="stylesheet"> |
| <script src="skin/getBlank.js" language="javascript" type="text/javascript"></script><script src="skin/getMenu.js" language="javascript" type="text/javascript"></script><script src="skin/fontsize.js" language="javascript" type="text/javascript"></script> |
| <link rel="shortcut icon" href="images/favicon.ico"> |
| </head> |
| <body onload="init()"> |
| <script type="text/javascript">ndeSetTextSize();</script> |
| <div id="top"> |
| <div class="breadtrail"> |
| <a href="http://www.apache.org/">Apache</a> > <a href="http://lucene.apache.org/">Lucene</a> > <a href="http://lucene.apache.org/hadoop/">Hadoop</a><script src="skin/breadcrumbs.js" language="JavaScript" type="text/javascript"></script> |
| </div> |
| <div class="header"> |
| <div class="grouplogo"> |
| <a href="http://lucene.apache.org/"><img class="logoImage" alt="Lucene" src="images/lucene_green_150.gif" title="Apache Lucene"></a> |
| </div> |
| <div class="projectlogo"> |
| <a href="http://lucene.apache.org/hadoop/"><img class="logoImage" alt="Hadoop" src="images/hadoop-logo.jpg" title="Scalable Computing Platform"></a> |
| </div> |
| <div class="searchbox"> |
| <form action="http://www.google.com/search" method="get" class="roundtopsmall"> |
| <input value="lucene.apache.org" name="sitesearch" type="hidden"><input onFocus="getBlank (this, 'Search the site with google');" size="25" name="q" id="query" type="text" value="Search the site with google"> |
| <input attr="value" name="Search" value="Search" type="submit"> |
| </form> |
| </div> |
| <ul id="tabs"> |
| <li class="current"> |
| <a class="base-selected" href="index.html">Main</a> |
| </li> |
| <li> |
| <a class="base-not-selected" href="http://wiki.apache.org/lucene-hadoop">Wiki</a> |
| </li> |
| </ul> |
| </div> |
| </div> |
| <div id="main"> |
| <div id="publishedStrip"> |
| <div id="level2tabs"></div> |
| <script type="text/javascript"><!-- |
| document.write("<text>Last Published:</text> " + document.lastModified); |
| // --></script> |
| </div> |
| <div class="breadtrail"> |
| |
| |
| </div> |
| <div id="menu"> |
| <div onclick="SwitchMenu('menu_selected_1.1', 'skin/')" id="menu_selected_1.1Title" class="menutitle" style="background-image: url('skin/images/chapter_open.gif');">Project</div> |
| <div id="menu_selected_1.1" class="selectedmenuitemgroup" style="display: block;"> |
| <div class="menuitem"> |
| <a href="index.html">News</a> |
| </div> |
| <div class="menupage"> |
| <div class="menupagetitle">About</div> |
| </div> |
| <div class="menuitem"> |
| <a href="credits.html">Credits</a> |
| </div> |
| <div class="menuitem"> |
| <a href="http://www.apache.org/dyn/closer.cgi/lucene/hadoop/">Download</a> |
| </div> |
| <div class="menuitem"> |
| <a href="http://www.cafepress.com/hadoop/">Buy Stuff</a> |
| </div> |
| </div> |
| <div onclick="SwitchMenu('menu_1.2', 'skin/')" id="menu_1.2Title" class="menutitle">Documentation</div> |
| <div id="menu_1.2" class="menuitemgroup"> |
| <div class="menuitem"> |
| <a href="http://wiki.apache.org/lucene-hadoop/FAQ">FAQ</a> |
| </div> |
| <div class="menuitem"> |
| <a href="http://wiki.apache.org/lucene-hadoop/">Wiki</a> |
| </div> |
| <div class="menuitem"> |
| <a href="hdfs_design.html">Hadoop File System</a> |
| </div> |
| <div class="menuitem"> |
| <a href="api/index.html">API Docs</a> |
| </div> |
| </div> |
| <div onclick="SwitchMenu('menu_1.3', 'skin/')" id="menu_1.3Title" class="menutitle">Developer</div> |
| <div id="menu_1.3" class="menuitemgroup"> |
| <div class="menuitem"> |
| <a href="mailing_lists.html">Mailing Lists</a> |
| </div> |
| <div class="menuitem"> |
| <a href="issue_tracking.html">Issue Tracking</a> |
| </div> |
| <div class="menuitem"> |
| <a href="version_control.html">Version Control</a> |
| </div> |
| <div class="menuitem"> |
| <a href="http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/">Nightly Build</a> |
| </div> |
| </div> |
| <div onclick="SwitchMenu('menu_1.4', 'skin/')" id="menu_1.4Title" class="menutitle">Related Projects</div> |
| <div id="menu_1.4" class="menuitemgroup"> |
| <div class="menuitem"> |
| <a href="http://lucene.apache.org/java/">Lucene</a> |
| </div> |
| <div class="menuitem"> |
| <a href="http://lucene.apache.org/nutch/">Nutch</a> |
| </div> |
| </div> |
| <div id="credit"></div> |
| <div id="roundbottom"> |
| <img style="display: none" class="corner" height="15" width="15" alt="" src="skin/images/rc-b-l-15-1body-2menu-3menu.png"></div> |
| <div id="credit2"></div> |
| </div> |
| <div id="content"> |
| <div title="Portable Document Format" class="pdflink"> |
| <a class="dida" href="about.pdf"><img alt="PDF -icon" src="skin/images/pdfdoc.gif" class="skin"><br> |
| PDF</a> |
| </div> |
| <h1>About Hadoop</h1> |
| <div id="minitoc-area"> |
| <ul class="minitoc"> |
| <li> |
| <a href="#Overview">Overview</a> |
| </li> |
| </ul> |
| </div> |
| |
| |
| <a name="N1000C"></a><a name="Overview"></a> |
| <h2 class="h3">Overview</h2> |
| <div class="section"> |
| <p>Hadoop is a framework for running applications on large |
| clusters of commodity hardware. The Hadoop framework |
| transparently provides applications both reliability and data |
| motion. Hadoop implements a computational paradigm named |
| map/reduce, where the application is divided into many small |
| fragments of work, each of which may be executed or reexecuted |
| on any node in the cluster. In addition, it provides a |
| distributed file system that stores data on the compute nodes, |
| providing very high aggregate bandwidth across the cluster. Both |
| map/reduce and the distributed file system are designed so that |
| node failures are automatically handled by the framework.</p> |
| <p>Hadoop has been demonstrated on clusters with 2000 nodes. |
| The current design target is 10,000 node clusters.</p> |
| <p>Hadoop is a <a href="http://lucene.apache.org/java/">Lucene</a> sub-project |
| that contains the distributed computing platform that was |
| formerly a part of <a href="http://lucene.apache.org/nutch/">Nutch</a>. This |
| includes the Hadoop Distributed Filesystem (HDFS) and an |
| implementation of map/reduce.</p> |
| <p>For more information about Hadoop, please see the <a href="http://wiki.apache.org/lucene-hadoop/">Hadoop wiki.</a> |
| </p> |
| </div> |
| |
| |
| </div> |
| <div class="clearboth"> </div> |
| </div> |
| <div id="footer"> |
| <div class="lastmodified"> |
| <script type="text/javascript"><!-- |
| document.write("<text>Last Published:</text> " + document.lastModified); |
| // --></script> |
| </div> |
| <div class="copyright"> |
| Copyright © |
| 2007 <a href="http://www.apache.org/licenses/">The Apache Software Foundation.</a> |
| </div> |
| </div> |
| </body> |
| </html> |
