| <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> |
| <!-- |
| | Generated by Apache Maven Doxia at 2021-06-15 |
| | Rendered using Apache Maven Stylus Skin 1.5 |
| --> |
| <html xmlns="http://www.w3.org/1999/xhtml"> |
| <head> |
| <title>Apache Hadoop 3.3.1 – Apache Hadoop 0.20.0 Release Notes</title> |
| <style type="text/css" media="all"> |
| @import url("../../css/maven-base.css"); |
| @import url("../../css/maven-theme.css"); |
| @import url("../../css/site.css"); |
| </style> |
| <link rel="stylesheet" href="../../css/print.css" type="text/css" media="print" /> |
| <meta name="Date-Revision-yyyymmdd" content="20210615" /> |
| <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> |
| </head> |
| <body class="composite"> |
| <div id="banner"> |
| <a href="http://hadoop.apache.org/" id="bannerLeft"> |
| <img src="http://hadoop.apache.org/images/hadoop-logo.jpg" alt="" /> |
| </a> |
| <a href="http://www.apache.org/" id="bannerRight"> |
| <img src="http://www.apache.org/images/asf_logo_wide.png" alt="" /> |
| </a> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="breadcrumbs"> |
| |
| <div class="xleft"> |
| <a href="http://www.apache.org/" class="externalLink">Apache</a> |
| > |
| <a href="http://hadoop.apache.org/" class="externalLink">Hadoop</a> |
| > |
| <a href="../../../index.html">Apache Hadoop Project Dist POM</a> |
| > |
| <a href="../../index.html">Apache Hadoop 3.3.1</a> |
| > |
| Apache Hadoop 0.20.0 Release Notes |
| </div> |
| <div class="xright"> <a href="http://wiki.apache.org/hadoop" class="externalLink">Wiki</a> |
| | |
| <a href="https://gitbox.apache.org/repos/asf/hadoop.git" class="externalLink">git</a> |
| | |
| <a href="http://hadoop.apache.org/" class="externalLink">Apache Hadoop</a> |
| |
| | Last Published: 2021-06-15 |
| | Version: 3.3.1 |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="leftColumn"> |
| <div id="navcolumn"> |
| |
| <h5>General</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/SingleCluster.html">Single Node Setup</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/ClusterSetup.html">Cluster Setup</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CommandsManual.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/FileSystemShell.html">FileSystem Shell</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Compatibility.html">Compatibility Specification</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/DownstreamDev.html">Downstream Developer's Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/AdminCompatibilityGuide.html">Admin Compatibility Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/InterfaceClassification.html">Interface Classification</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/filesystem/index.html">FileSystem Specification</a> |
| </li> |
| </ul> |
| <h5>Common</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CLIMiniCluster.html">CLI Mini Cluster</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/FairCallQueue.html">Fair Call Queue</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/NativeLibraries.html">Native Libraries</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Superusers.html">Proxy User</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/RackAwareness.html">Rack Awareness</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/SecureMode.html">Secure Mode</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/ServiceLevelAuth.html">Service Level Authorization</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/HttpAuthentication.html">HTTP Authentication</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CredentialProviderAPI.html">Credential Provider API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-kms/index.html">Hadoop KMS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Tracing.html">Tracing</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/UnixShellGuide.html">Unix Shell Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/registry/index.html">Registry</a> |
| </li> |
| </ul> |
| <h5>HDFS</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDesign.html">Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html">User Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html">NameNode HA With QJM</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html">NameNode HA With NFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ObserverNameNode.html">Observer NameNode</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/Federation.html">Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFs.html">ViewFs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFsOverloadScheme.html">ViewFsOverloadScheme</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsSnapshots.html">Snapshots</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsEditsViewer.html">Edits Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsImageViewer.html">Image Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.html">Permissions and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsQuotaAdminGuide.html">Quotas and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/LibHdfs.html">libhdfs (C API)</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/WebHDFS.html">WebHDFS (REST API)</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-hdfs-httpfs/index.html">HttpFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html">Short Circuit Local Reads</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html">Centralized Cache Management</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html">NFS Gateway</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html">Rolling Upgrade</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html">Extended Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html">Transparent Encryption</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html">Multihoming</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html">Storage Policies</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/MemoryStorage.html">Memory Storage Support</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/SLGUserGuide.html">Synthetic Load Generator</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSErasureCoding.html">Erasure Coding</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSDiskbalancer.html">Disk Balancer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUpgradeDomain.html">Upgrade Domain</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDataNodeAdminGuide.html">DataNode Admin</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html">Router Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsProvidedStorage.html">Provided Storage</a> |
| </li> |
| </ul> |
| <h5>MapReduce</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html">Tutorial</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html">Compatibility with 1.x</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/EncryptedShuffle.html">Encrypted Shuffle</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/PluggableShuffleAndPluggableSort.html">Pluggable Shuffle/Sort</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/DistributedCacheDeploy.html">Distributed Cache Deploy</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/SharedCacheSupport.html">Support for YARN Shared Cache</a> |
| </li> |
| </ul> |
| <h5>MapReduce REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html">MR Application Master</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-hs/HistoryServerRest.html">MR History Server</a> |
| </li> |
| </ul> |
| <h5>YARN</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YARN.html">Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html">Capacity Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/FairScheduler.html">Fair Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html">ResourceManager Restart</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html">ResourceManager HA</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceModel.html">Resource Model</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeLabel.html">Node Labels</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeAttributes.html">Node Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html">Web Application Proxy</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html">Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html">Timeline Service V.2</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html">Writing YARN Applications</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnApplicationSecurity.html">YARN Application Security</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManager.html">NodeManager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/DockerContainers.html">Running Applications in Docker Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/RuncContainers.html">Running Applications in runC Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html">Using CGroups</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/SecureContainer.html">Secure Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ReservationSystem.html">Reservation System</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/GracefulDecommission.html">Graceful Decommission</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html">Opportunistic Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/Federation.html">YARN Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/SharedCache.html">Shared Cache</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingGpus.html">Using GPU</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingFPGA.html">Using FPGA</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/PlacementConstraints.html">Placement Constraints</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnUI2.html">YARN UI2</a> |
| </li> |
| </ul> |
| <h5>YARN REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html">Introduction</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html">Resource Manager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerRest.html">Node Manager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html#Timeline_Server_REST_API_v1">Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html#Timeline_Service_v.2_REST_API">Timeline Service V.2</a> |
| </li> |
| </ul> |
| <h5>YARN Service</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Overview.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/QuickStart.html">QuickStart</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Concepts.html">Concepts</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/YarnServiceAPI.html">Yarn Service API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/ServiceDiscovery.html">Service Discovery</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/SystemServices.html">System Services</a> |
| </li> |
| </ul> |
| <h5>Hadoop Compatible File Systems</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-aliyun/tools/hadoop-aliyun/index.html">Aliyun OSS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-aws/tools/hadoop-aws/index.html">Amazon S3</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-azure/index.html">Azure Blob Storage</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-azure-datalake/index.html">Azure Data Lake Storage</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-openstack/index.html">OpenStack Swift</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-cos/cloud-storage/index.html">Tencent COS</a> |
| </li> |
| </ul> |
| <h5>Auth</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/Examples.html">Examples</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/Configuration.html">Configuration</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/BuildingIt.html">Building</a> |
| </li> |
| </ul> |
| <h5>Tools</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-streaming/HadoopStreaming.html">Hadoop Streaming</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-archives/HadoopArchives.html">Hadoop Archives</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-archive-logs/HadoopArchiveLogs.html">Hadoop Archive Logs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-distcp/DistCp.html">DistCp</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-gridmix/GridMix.html">GridMix</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-rumen/Rumen.html">Rumen</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-resourceestimator/ResourceEstimator.html">Resource Estimator Service</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-sls/SchedulerLoadSimulator.html">Scheduler Load Simulator</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Benchmarking.html">Hadoop Benchmarking</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-dynamometer/Dynamometer.html">Dynamometer</a> |
| </li> |
| </ul> |
| <h5>Reference</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/release/">Changelog and Release Notes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../api/index.html">Java API docs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/UnixShellAPI.html">Unix Shell API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Metrics.html">Metrics</a> |
| </li> |
| </ul> |
| <h5>Configuration</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/core-default.xml">core-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/hdfs-default.xml">hdfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/hdfs-rbf-default.xml">hdfs-rbf-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml">mapred-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-common/yarn-default.xml">yarn-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-kms/kms-default.html">kms-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-hdfs-httpfs/httpfs-default.html">httpfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/DeprecatedProperties.html">Deprecated Properties</a> |
| </li> |
| </ul> |
| <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"> |
| <img alt="Built by Maven" src="../../images/logos/maven-feather.png"/> |
| </a> |
| |
| </div> |
| </div> |
| <div id="bodyColumn"> |
| <div id="contentBox"> |
| <!--- |
| # Licensed to the Apache Software Foundation (ASF) under one |
| # or more contributor license agreements. See the NOTICE file |
| # distributed with this work for additional information |
| # regarding copyright ownership. The ASF licenses this file |
| # to you under the Apache License, Version 2.0 (the |
| # "License"); you may not use this file except in compliance |
| # with the License. You may obtain a copy of the License at |
| # |
| # http://www.apache.org/licenses/LICENSE-2.0 |
| # |
| # Unless required by applicable law or agreed to in writing, software |
| # distributed under the License is distributed on an "AS IS" BASIS, |
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| # See the License for the specific language governing permissions and |
| # limitations under the License. |
| --> |
| <h1>Apache Hadoop 0.20.0 Release Notes</h1> |
| <p>These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4234">HADOOP-4234</a> | <i>Minor</i> | <b>KFS: Allow KFS layer to interface with multiple KFS namenodes</b></li> |
| </ul> |
| <p>Changed KFS glue layer to allow applications to interface with multiple KFS metaservers.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4210">HADOOP-4210</a> | <i>Major</i> | <b>Findbugs warnings are printed related to equals implementation of several classes</b></li> |
| </ul> |
| <p>Changed public class org.apache.hadoop.mapreduce.ID to be an abstract class. Removed from class org.apache.hadoop.mapreduce.ID the methods public static ID read(DataInput in) and public static ID forName(String str).</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4253">HADOOP-4253</a> | <i>Major</i> | <b>Fix warnings generated by FindBugs</b></li> |
| </ul> |
| <p>Removed from class org.apache.hadoop.fs.RawLocalFileSystem deprecated methods public String getName(), public void lock(Path p, boolean shared) and public void release(Path p).</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4284">HADOOP-4284</a> | <i>Major</i> | <b>Support for user configurable global filters on HttpServer</b></li> |
| </ul> |
| <p>Introduced HttpServer method to support global filters.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4454">HADOOP-4454</a> | <i>Minor</i> | <b>Support comments in ‘slaves’ file</b></li> |
| </ul> |
| <p>Changed processing of conf/slaves file to allow # to begin a comment.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4572">HADOOP-4572</a> | <i>Major</i> | <b>INode and its sub-classes should be package private</b></li> |
| </ul> |
| <p>Moved org.apache.hadoop.hdfs.{CreateEditsLog, NNThroughputBenchmark} to org.apache.hadoop.hdfs.server.namenode.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4575">HADOOP-4575</a> | <i>Major</i> | <b>An independent HTTPS proxy for HDFS</b></li> |
| </ul> |
| <p>Introduced independent HSFTP proxy server for authenticated access to clusters.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4618">HADOOP-4618</a> | <i>Major</i> | <b>Move http server from FSNamesystem into NameNode.</b></li> |
| </ul> |
| <p>Moved HTTP server from FSNameSystem to NameNode. Removed FSNamesystem.getNameNodeInfoPort(). Replaced FSNamesystem.getDFSNameNodeMachine() and FSNamesystem.getDFSNameNodePort() with new method FSNamesystem.getDFSNameNodeAddress(). Removed constructor NameNode(bindAddress, conf).</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4567">HADOOP-4567</a> | <i>Major</i> | <b>GetFileBlockLocations should return the NetworkTopology information of the machines that hosts those blocks</b></li> |
| </ul> |
| <p>Changed GetFileBlockLocations to return topology information for nodes that host the block replicas.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4435">HADOOP-4435</a> | <i>Minor</i> | <b>The JobTracker should display the amount of heap memory used</b></li> |
| </ul> |
| <p>Changed JobTracker web status page to display the amount of heap memory in use. This changes the JobSubmissionProtocol.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-3923">HADOOP-3923</a> | <i>Minor</i> | <b>Deprecate org.apache.hadoop.mapred.StatusHttpServer</b></li> |
| </ul> |
| <p>Moved class org.apache.hadoop.mapred.StatusHttpServer to org.apache.hadoop.http.HttpServer.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4188">HADOOP-4188</a> | <i>Major</i> | <b>Remove Task’s dependency on concrete file systems</b></li> |
| </ul> |
| <p>Removed Task’s dependency on concrete file systems by taking list from FileSystem class. Added statistics table to FileSystem class. Deprecated FileSystem method getStatistics(Class<? extends FileSystem> cls).</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4661">HADOOP-4661</a> | <i>Major</i> | <b>distch: a tool for distributed ch{mod,own}</b></li> |
| </ul> |
| <p>Introduced distch tool for parallel ch{mod, own, grp}.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-1650">HADOOP-1650</a> | <i>Major</i> | <b>Upgrade Jetty to 6.x</b></li> |
| </ul> |
| <p>Upgraded all core servers to use Jetty 6</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-3986">HADOOP-3986</a> | <i>Major</i> | <b>JobClient should not have a static configuration</b></li> |
| </ul> |
| <p>Removed classes org.apache.hadoop.mapred.JobShell and org.apache.hadoop.mapred.TestJobShell. Removed from JobClient methods static void setCommandLineConfig(Configuration conf) and public static Configuration getCommandLineConfig().</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4422">HADOOP-4422</a> | <i>Major</i> | <b>S3 file systems should not create bucket</b></li> |
| </ul> |
| <p>Modified Hadoop file system to no longer create S3 buckets. Applications can create buckets for their S3 file systems by other means, for example, using the JetS3t API.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-3422">HADOOP-3422</a> | <i>Major</i> | <b>Ganglia counter metrics are all reported with the metric name “value”, so the counter values can not be seen</b></li> |
| </ul> |
| <p>Changed names of ganglia metrics to avoid conflicts and to better identify source function.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4035">HADOOP-4035</a> | <i>Blocker</i> | <b>Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory</b></li> |
| </ul> |
| <p>Changed capacity scheduler policy to take note of task memory requirements and task tracker memory availability.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-3750">HADOOP-3750</a> | <i>Major</i> | <b>Fix and enforce module dependencies</b></li> |
| </ul> |
| <p>Removed deprecated method parseArgs from org.apache.hadoop.fs.FileSystem.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-3497">HADOOP-3497</a> | <i>Major</i> | <b>File globbing with a PathFilter is too restrictive</b></li> |
| </ul> |
| <p>Changed the semantics of file globbing with a PathFilter (using the globStatus method of FileSystem). Previously, the filtering was too restrictive, so that a glob of /*/* and a filter that only accepts /a/b would not have matched /a/b. With this change /a/b does match.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4576">HADOOP-4576</a> | <i>Major</i> | <b>Modify pending tasks count in the UI to pending jobs count in the UI</b></li> |
| </ul> |
| <p>Changed capacity scheduler UI to better present number of running and pending tasks.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4305">HADOOP-4305</a> | <i>Major</i> | <b>repeatedly blacklisted tasktrackers should get declared dead</b></li> |
| </ul> |
| <p>Improved TaskTracker blacklisting strategy to better exclude faulty tracker from executing tasks.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4445">HADOOP-4445</a> | <i>Major</i> | <b>Wrong number of running map/reduce tasks are displayed in queue information.</b></li> |
| </ul> |
| <p>Changed JobTracker UI to better present the number of active tasks.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4179">HADOOP-4179</a> | <i>Major</i> | <b>Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs</b></li> |
| </ul> |
| <p>Introduced Vaidya rule based performance diagnostic tool for Map/Reduce jobs.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4029">HADOOP-4029</a> | <i>Major</i> | <b>NameNode should report status and performance for each replica of image and log</b></li> |
| </ul> |
| <p>Added name node storage information to the dfshealth page, and moved data node information to a separated page.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4749">HADOOP-4749</a> | <i>Major</i> | <b>reducer should output input data size when shuffling is done</b></li> |
| </ul> |
| <p>Added a new counter REDUCE_INPUT_BYTES.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4826">HADOOP-4826</a> | <i>Major</i> | <b>Admin command saveNamespace.</b></li> |
| </ul> |
| <p>Introduced new dfsadmin command saveNamespace to command the name service to do an immediate save of the file system image.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-3063">HADOOP-3063</a> | <i>Major</i> | <b>BloomMapFile - fail-fast version of MapFile for sparsely populated key space</b></li> |
| </ul> |
| <p>Introduced BloomMapFile subclass of MapFile that creates a Bloom filter from all keys.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-1230">HADOOP-1230</a> | <i>Major</i> | <b>Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes</b></li> |
| </ul> |
| <p>Replaced parameters with context obejcts in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4631">HADOOP-4631</a> | <i>Major</i> | <b>Split the default configurations into 3 parts</b></li> |
| </ul> |
| <p>Split hadoop-default.xml into core-default.xml, hdfs-default.xml and mapreduce-default.xml.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-3344">HADOOP-3344</a> | <i>Major</i> | <b>libhdfs: always builds 32bit, even when x86_64 Java used</b></li> |
| </ul> |
| <p>Changed build procedure for libhdfs to build correctly for different platforms. Build instructions are in the Jira item.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4827">HADOOP-4827</a> | <i>Major</i> | <b>Improve data aggregation in database</b></li> |
| </ul> |
| <p>Improved framework for data aggregation in Chuckwa.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4789">HADOOP-4789</a> | <i>Minor</i> | <b>Change fair scheduler to share between pools by default, not between invidual jobs</b></li> |
| </ul> |
| <p>Changed fair scheduler to divide resources equally between pools, not jobs.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4843">HADOOP-4843</a> | <i>Major</i> | <b>Collect Job History log file and Job Conf file into Chukwa</b></li> |
| </ul> |
| <p>Introduced Chuckwa collection of job history.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-5030">HADOOP-5030</a> | <i>Major</i> | <b>Chukwa RPM build improvements</b></li> |
| </ul> |
| <p>Changed RPM install location to the value specified by build.properties file.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4970">HADOOP-4970</a> | <i>Major</i> | <b>Use the full path when move files to .Trash/Current</b></li> |
| </ul> |
| <p>Changed trash facility to use absolute path of the deleted file.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4565">HADOOP-4565</a> | <i>Major</i> | <b>MultiFileInputSplit can use data locality information to create splits</b></li> |
| </ul> |
| <p>Improved MultiFileInputFormat so that multiple blocks from the same node or same rack can be combined into a single split.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4873">HADOOP-4873</a> | <i>Major</i> | <b>display minMaps/Reduces on advanced scheduler page</b></li> |
| </ul> |
| <p>Changed fair scheduler UI to display minMaps and minReduces variables.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4103">HADOOP-4103</a> | <i>Major</i> | <b>Alert for missing blocks</b></li> |
| </ul> |
| <p>Modified dfsadmin -report to report under replicated blocks. blocks with corrupt replicas, and missing blocks".</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4783">HADOOP-4783</a> | <i>Blocker</i> | <b>History files are given world readable permissions.</b></li> |
| </ul> |
| <p>Changed history directory permissions to 750 and history file permissions to 740.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-5521">HADOOP-5521</a> | <i>Major</i> | <b>Remove dependency of testcases on RESTART_COUNT</b></li> |
| </ul> |
| <p>This patch makes TestJobHistory and its dependent testcases independent of RESTART_COUNT.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-5468">HADOOP-5468</a> | <i>Major</i> | <b>Change Hadoop doc menu to sub-menus</b></li> |
| </ul> |
| <p>Reformatted HTML documentation for Hadoop to use submenus at the left column.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-5531">HADOOP-5531</a> | <i>Blocker</i> | <b>Remove Chukwa on branch-0.20</b></li> |
| </ul> |
| <p>Disabled Chukwa unit tests for 0.20 branch only.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-5565">HADOOP-5565</a> | <i>Major</i> | <b>The job instrumentation API needs to have a method for finalizeJob,</b></li> |
| </ul> |
| <p>Add finalizeJob & terminateJob methods to JobTrackerInstrumentation class</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-4374">HADOOP-4374</a> | <i>Major</i> | <b>JVM should not be killed but given an opportunity to exit gracefully</b></li> |
| </ul> |
| <p>This patch (1) Adds a shutdownHook that does syncLogs sothat logs of the current task are flushed and log.index is up to date in cases like System.exit(), or killed using signals(other than SIGKILL). (2) Changes writeToIndexFile() to write to a temporary index file first and then rename to log.index sothat updates to log.index file are atomic.</p><hr /> |
| <ul> |
| |
| <li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-5548">HADOOP-5548</a> | <i>Blocker</i> | <b>Observed negative running maps on the job tracker</b></li> |
| </ul> |
| <p>Adds synchronization for JobTracker methods in RecoveryManager.</p> |
| </div> |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| <div id="footer"> |
| <div class="xright"> |
| © 2008-2021 |
| Apache Software Foundation |
| |
| - <a href="http://maven.apache.org/privacy-policy.html">Privacy Policy</a>. |
| Apache Maven, Maven, Apache, the Apache feather logo, and the Apache Maven project logos are trademarks of The Apache Software Foundation. |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| </body> |
| </html> |
