| <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> |
| <!-- Generated by Apache Maven Doxia at 2016-01-26 --> |
| <html xmlns="http://www.w3.org/1999/xhtml"> |
| <head> |
| <title>Hadoop – Apache Hadoop 2.7.2</title> |
| <style type="text/css" media="all"> |
| @import url("./css/maven-base.css"); |
| @import url("./css/maven-theme.css"); |
| @import url("./css/site.css"); |
| </style> |
| <link rel="stylesheet" href="./css/print.css" type="text/css" media="print" /> |
| <meta name="Date-Revision-yyyymmdd" content="20160126" /> |
| <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> |
| </head> |
| <body class="composite"> |
| <div id="banner"> |
| <a href="https://hadoop.apache.org/" id="bannerLeft"> |
| <img src="https://hadoop.apache.org/images/hadoop-logo.jpg" alt="" /> |
| </a> |
| <a href="https://www.apache.org/" id="bannerRight"> |
| <img src="https://www.apache.org/images/asf_logo_wide.png" alt="" /> |
| </a> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="breadcrumbs"> |
| |
| <div class="xleft"> |
| <a href="https://www.apache.org/" class="externalLink">Apache</a> |
| > |
| <a href="https://hadoop.apache.org/" class="externalLink">Hadoop</a> |
| </div> |
| <div class="xright"> <a href="https://wiki.apache.org/hadoop" class="externalLink">Wiki</a> |
| | |
| <a href="https://git-wip-us.apache.org/repos/asf/hadoop.git" class="externalLink">git</a> |
| |
| | Last Published: 2016-01-26 |
| | Version: 2.7.2 |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="leftColumn"> |
| <div id="navcolumn"> |
| |
| <h5>General</h5> |
| <ul> |
| <li class="none"> |
| <strong>Overview</strong> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/SingleCluster.html">Single Node Setup</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/ClusterSetup.html">Cluster Setup</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/CommandsManual.html">Hadoop Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/FileSystemShell.html">FileSystem Shell</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/Compatibility.html">Hadoop Compatibility</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/InterfaceClassification.html">Interface Classification</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/filesystem/index.html">FileSystem Specification</a> |
| </li> |
| </ul> |
| <h5>Common</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/CLIMiniCluster.html">CLI Mini Cluster</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/NativeLibraries.html">Native Libraries</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/Superusers.html">Proxy User</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/RackAwareness.html">Rack Awareness</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/SecureMode.html">Secure Mode</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/ServiceLevelAuth.html">Service Level Authorization</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/HttpAuthentication.html">HTTP Authentication</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-kms/index.html">Hadoop KMS</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/Tracing.html">Tracing</a> |
| </li> |
| </ul> |
| <h5>HDFS</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html">HDFS User Guide</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HDFSCommands.html">HDFS Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html">High Availability With QJM</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html">High Availability With NFS</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/Federation.html">Federation</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/ViewFs.html">ViewFs Guide</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsSnapshots.html">HDFS Snapshots</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsDesign.html">HDFS Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsEditsViewer.html">Edits Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsImageViewer.html">Image Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.html">Permissions and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsQuotaAdminGuide.html">Quotas and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/Hftp.html">HFTP</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/LibHdfs.html">C API libhdfs</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/WebHDFS.html">WebHDFS REST API</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-hdfs-httpfs/index.html">HttpFS Gateway</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html">Short Circuit Local Reads</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html">Centralized Cache Management</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html">HDFS NFS Gateway</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html">HDFS Rolling Upgrade</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html">Extended Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html">Transparent Encryption</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html">HDFS Support for Multihoming</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html">Archival Storage, SSD & Memory</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/MemoryStorage.html">Memory Storage Support</a> |
| </li> |
| </ul> |
| <h5>MapReduce</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html">MapReduce Tutorial</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html">MapReduce Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html">Compatibilty between Hadoop 1.x and Hadoop 2.x</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-core/EncryptedShuffle.html">Encrypted Shuffle</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-core/PluggableShuffleAndPluggableSort.html">Pluggable Shuffle/Sort</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-core/DistributedCacheDeploy.html">Distributed Cache Deploy</a> |
| </li> |
| </ul> |
| <h5>MapReduce REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html">MR Application Master</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-hs/HistoryServerRest.html">MR History Server</a> |
| </li> |
| </ul> |
| <h5>YARN</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/YARN.html">YARN Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html">Capacity Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/FairScheduler.html">Fair Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html">ResourceManager Restart</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html">ResourceManager HA</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/NodeLabel.html">Node Labels</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html">Web Application Proxy</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/TimelineServer.html">YARN Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html">Writing YARN Applications</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/YarnCommands.html">YARN Commands</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/NodeManagerRestart.html">NodeManager Restart</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html">DockerContainerExecutor</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html">Using CGroups</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/SecureContainer.html">Secure Containers</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/registry/index.html">Registry</a> |
| </li> |
| </ul> |
| <h5>YARN REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html">Introduction</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html">Resource Manager</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/NodeManagerRest.html">Node Manager</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-site/TimelineServer.html#Timeline_Server_REST_API_v1">Timeline Server</a> |
| </li> |
| </ul> |
| <h5>Hadoop Compatible File Systems</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-aws/tools/hadoop-aws/index.html">Amazon S3</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-azure/index.html">Azure Blob Storage</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-openstack/index.html">OpenStack Swift</a> |
| </li> |
| </ul> |
| <h5>Auth</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-auth/index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-auth/Examples.html">Examples</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-auth/Configuration.html">Configuration</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-auth/BuildingIt.html">Building</a> |
| </li> |
| </ul> |
| <h5>Tools</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-streaming/HadoopStreaming.html">Hadoop Streaming</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-archives/HadoopArchives.html">Hadoop Archives</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-distcp/DistCp.html">DistCp</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-gridmix/GridMix.html">GridMix</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-rumen/Rumen.html">Rumen</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-sls/SchedulerLoadSimulator.html">Scheduler Load Simulator</a> |
| </li> |
| </ul> |
| <h5>Reference</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/releasenotes.html">Release Notes</a> |
| </li> |
| <li class="none"> |
| <a href="api/index.html">API docs</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/CHANGES.txt">Common CHANGES.txt</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/CHANGES.txt">HDFS CHANGES.txt</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-mapreduce/CHANGES.txt">MapReduce CHANGES.txt</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-yarn/CHANGES.txt">YARN CHANGES.txt</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/Metrics.html">Metrics</a> |
| </li> |
| </ul> |
| <h5>Configuration</h5> |
| <ul> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/core-default.xml">core-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-hdfs/hdfs-default.xml">hdfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml">mapred-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-yarn/hadoop-yarn-common/yarn-default.xml">yarn-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="hadoop-project-dist/hadoop-common/DeprecatedProperties.html">Deprecated Properties</a> |
| </li> |
| </ul> |
| <a href="https://maven.apache.org/" title="Built by Maven" class="poweredBy"> |
| <img alt="Built by Maven" src="./images/logos/maven-feather.png"/> |
| </a> |
| |
| </div> |
| </div> |
| <div id="bodyColumn"> |
| <div id="contentBox"> |
| <!-- - |
| Licensed under the Apache License, Version 2.0 (the "License"); |
| you may not use this file except in compliance with the License. |
| You may obtain a copy of the License at |
| |
| http://www.apache.org/licenses/LICENSE-2.0 |
| |
| Unless required by applicable law or agreed to in writing, software |
| distributed under the License is distributed on an "AS IS" BASIS, |
| WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| See the License for the specific language governing permissions and |
| limitations under the License. See accompanying LICENSE file. --><h1>Apache Hadoop 2.7.2</h1> |
| <p>Apache Hadoop 2.7.2 is a minor release in the 2.x.y release line, building upon the previous stable release 2.7.1.</p> |
| <p>Here is a short overview of the major features and improvements.</p> |
| |
| <ul> |
| |
| <li> |
| <p>Common</p> |
| |
| <ul> |
| |
| <li>Authentication improvements when using an HTTP proxy server. This is useful when accessing WebHDFS via a proxy server.</li> |
| </ul> |
| |
| <ul> |
| |
| <li>A new Hadoop metrics sink that allows writing directly to Graphite.</li> |
| </ul> |
| |
| <ul> |
| |
| <li><a href="./hadoop-project-dist/hadoop-common/filesystem/index.html">Specification work</a> related to the Hadoop Compatible Filesystem (HCFS) effort.</li> |
| </ul></li> |
| |
| <li> |
| <p>HDFS</p> |
| |
| <ul> |
| |
| <li>Support for POSIX-style filesystem extended attributes. See the <a href="./hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html">user documentation</a> for more details.</li> |
| </ul> |
| |
| <ul> |
| |
| <li>Using the OfflineImageViewer, clients can now browse an fsimage via the WebHDFS API.</li> |
| </ul> |
| |
| <ul> |
| |
| <li>The NFS gateway received a number of supportability improvements and bug fixes. The Hadoop portmapper is no longer required to run the gateway, and the gateway is now able to reject connections from unprivileged ports.</li> |
| </ul> |
| |
| <ul> |
| |
| <li>The SecondaryNameNode, JournalNode, and DataNode web UIs have been modernized with HTML5 and Javascript.</li> |
| </ul></li> |
| |
| <li> |
| <p>YARN</p> |
| |
| <ul> |
| |
| <li>YARN’s REST APIs now support write/modify operations. Users can submit and kill applications through REST APIs.</li> |
| </ul> |
| |
| <ul> |
| |
| <li>The timeline store in YARN, used for storing generic and application-specific information for applications, supports authentication through Kerberos.</li> |
| </ul> |
| |
| <ul> |
| |
| <li>The Fair Scheduler supports dynamic hierarchical user queues, user queues are created dynamically at runtime under any specified parent-queue.</li> |
| </ul></li> |
| </ul> |
| <h1>Getting Started</h1> |
| <p>The Hadoop documentation includes the information you need to get started using Hadoop. Begin with the <a href="./hadoop-project-dist/hadoop-common/SingleCluster.html">Single Node Setup</a> which shows you how to set up a single-node Hadoop installation. Then move on to the <a href="./hadoop-project-dist/hadoop-common/ClusterSetup.html">Cluster Setup</a> to learn how to set up a multi-node Hadoop installation.</p> |
| </div> |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| <div id="footer"> |
| <div class="xright">© 2016 |
| Apache Software Foundation |
| |
| - <a href="https://maven.apache.org/privacy-policy.html">Privacy Policy</a></div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| </body> |
| </html> |
