Google Git
Sign in
apache / hadoop-site / 952d547359cafef280f0a0324055741b2ed55be1 / . / content / docs / r3.3.1 / hadoop-project-dist / hadoop-common / release / 0.23.1 / RELEASENOTES.0.23.1.html
blob: 2c90a03b9a40c94a447aeec751e42e42f8eb0b67 [file] [log] [blame]
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<!--
| Generated by Apache Maven Doxia at 2021-06-15
| Rendered using Apache Maven Stylus Skin 1.5
-->
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title>Apache Hadoop 3.3.1 &#x2013; Apache Hadoop 0.23.1 Release Notes</title>
<style type="text/css" media="all">
@import url("../../css/maven-base.css");
@import url("../../css/maven-theme.css");
@import url("../../css/site.css");
</style>
<link rel="stylesheet" href="../../css/print.css" type="text/css" media="print" />
<meta name="Date-Revision-yyyymmdd" content="20210615" />
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
</head>
<body class="composite">
<div id="banner">
<a href="http://hadoop.apache.org/" id="bannerLeft">
<img src="http://hadoop.apache.org/images/hadoop-logo.jpg" alt="" />
</a>
<a href="http://www.apache.org/" id="bannerRight">
<img src="http://www.apache.org/images/asf_logo_wide.png" alt="" />
</a>
<div class="clear">
<hr/>
</div>
</div>
<div id="breadcrumbs">
<div class="xleft">
<a href="http://www.apache.org/" class="externalLink">Apache</a>
&gt;
<a href="http://hadoop.apache.org/" class="externalLink">Hadoop</a>
&gt;
<a href="../../../index.html">Apache Hadoop Project Dist POM</a>
&gt;
<a href="../../index.html">Apache Hadoop 3.3.1</a>
&gt;
Apache Hadoop 0.23.1 Release Notes
</div>
<div class="xright"> <a href="http://wiki.apache.org/hadoop" class="externalLink">Wiki</a>
|
<a href="https://gitbox.apache.org/repos/asf/hadoop.git" class="externalLink">git</a>
|
<a href="http://hadoop.apache.org/" class="externalLink">Apache Hadoop</a>
&nbsp;| Last Published: 2021-06-15
&nbsp;| Version: 3.3.1
</div>
<div class="clear">
<hr/>
</div>
</div>
<div id="leftColumn">
<div id="navcolumn">
<h5>General</h5>
<ul>
<li class="none">
<a href="../../../../index.html">Overview</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/SingleCluster.html">Single Node Setup</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/ClusterSetup.html">Cluster Setup</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/CommandsManual.html">Commands Reference</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/FileSystemShell.html">FileSystem Shell</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/Compatibility.html">Compatibility Specification</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/DownstreamDev.html">Downstream Developer's Guide</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/AdminCompatibilityGuide.html">Admin Compatibility Guide</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/InterfaceClassification.html">Interface Classification</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/filesystem/index.html">FileSystem Specification</a>
</li>
</ul>
<h5>Common</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/CLIMiniCluster.html">CLI Mini Cluster</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/FairCallQueue.html">Fair Call Queue</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/NativeLibraries.html">Native Libraries</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/Superusers.html">Proxy User</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/RackAwareness.html">Rack Awareness</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/SecureMode.html">Secure Mode</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/ServiceLevelAuth.html">Service Level Authorization</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/HttpAuthentication.html">HTTP Authentication</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/CredentialProviderAPI.html">Credential Provider API</a>
</li>
<li class="none">
<a href="../../../../hadoop-kms/index.html">Hadoop KMS</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/Tracing.html">Tracing</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/UnixShellGuide.html">Unix Shell Guide</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/registry/index.html">Registry</a>
</li>
</ul>
<h5>HDFS</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDesign.html">Architecture</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html">User Guide</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSCommands.html">Commands Reference</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html">NameNode HA With QJM</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html">NameNode HA With NFS</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/ObserverNameNode.html">Observer NameNode</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/Federation.html">Federation</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFs.html">ViewFs</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFsOverloadScheme.html">ViewFsOverloadScheme</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsSnapshots.html">Snapshots</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsEditsViewer.html">Edits Viewer</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsImageViewer.html">Image Viewer</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.html">Permissions and HDFS</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsQuotaAdminGuide.html">Quotas and HDFS</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/LibHdfs.html">libhdfs (C API)</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/WebHDFS.html">WebHDFS (REST API)</a>
</li>
<li class="none">
<a href="../../../../hadoop-hdfs-httpfs/index.html">HttpFS</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html">Short Circuit Local Reads</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html">Centralized Cache Management</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html">NFS Gateway</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html">Rolling Upgrade</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html">Extended Attributes</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html">Transparent Encryption</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html">Multihoming</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html">Storage Policies</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/MemoryStorage.html">Memory Storage Support</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/SLGUserGuide.html">Synthetic Load Generator</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSErasureCoding.html">Erasure Coding</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSDiskbalancer.html">Disk Balancer</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUpgradeDomain.html">Upgrade Domain</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDataNodeAdminGuide.html">DataNode Admin</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html">Router Federation</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsProvidedStorage.html">Provided Storage</a>
</li>
</ul>
<h5>MapReduce</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html">Tutorial</a>
</li>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html">Commands Reference</a>
</li>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html">Compatibility with 1.x</a>
</li>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/EncryptedShuffle.html">Encrypted Shuffle</a>
</li>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/PluggableShuffleAndPluggableSort.html">Pluggable Shuffle/Sort</a>
</li>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/DistributedCacheDeploy.html">Distributed Cache Deploy</a>
</li>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/SharedCacheSupport.html">Support for YARN Shared Cache</a>
</li>
</ul>
<h5>MapReduce REST APIs</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html">MR Application Master</a>
</li>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-hs/HistoryServerRest.html">MR History Server</a>
</li>
</ul>
<h5>YARN</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/YARN.html">Architecture</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnCommands.html">Commands Reference</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html">Capacity Scheduler</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/FairScheduler.html">Fair Scheduler</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html">ResourceManager Restart</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html">ResourceManager HA</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceModel.html">Resource Model</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeLabel.html">Node Labels</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeAttributes.html">Node Attributes</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html">Web Application Proxy</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html">Timeline Server</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html">Timeline Service V.2</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html">Writing YARN Applications</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnApplicationSecurity.html">YARN Application Security</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManager.html">NodeManager</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/DockerContainers.html">Running Applications in Docker Containers</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/RuncContainers.html">Running Applications in runC Containers</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html">Using CGroups</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/SecureContainer.html">Secure Containers</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/ReservationSystem.html">Reservation System</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/GracefulDecommission.html">Graceful Decommission</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html">Opportunistic Containers</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/Federation.html">YARN Federation</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/SharedCache.html">Shared Cache</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingGpus.html">Using GPU</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingFPGA.html">Using FPGA</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/PlacementConstraints.html">Placement Constraints</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnUI2.html">YARN UI2</a>
</li>
</ul>
<h5>YARN REST APIs</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html">Introduction</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html">Resource Manager</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerRest.html">Node Manager</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html#Timeline_Server_REST_API_v1">Timeline Server</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html#Timeline_Service_v.2_REST_API">Timeline Service V.2</a>
</li>
</ul>
<h5>YARN Service</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Overview.html">Overview</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/QuickStart.html">QuickStart</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Concepts.html">Concepts</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/YarnServiceAPI.html">Yarn Service API</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/ServiceDiscovery.html">Service Discovery</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/SystemServices.html">System Services</a>
</li>
</ul>
<h5>Hadoop Compatible File Systems</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-aliyun/tools/hadoop-aliyun/index.html">Aliyun OSS</a>
</li>
<li class="none">
<a href="../../../../hadoop-aws/tools/hadoop-aws/index.html">Amazon S3</a>
</li>
<li class="none">
<a href="../../../../hadoop-azure/index.html">Azure Blob Storage</a>
</li>
<li class="none">
<a href="../../../../hadoop-azure-datalake/index.html">Azure Data Lake Storage</a>
</li>
<li class="none">
<a href="../../../../hadoop-openstack/index.html">OpenStack Swift</a>
</li>
<li class="none">
<a href="../../../../hadoop-cos/cloud-storage/index.html">Tencent COS</a>
</li>
</ul>
<h5>Auth</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-auth/index.html">Overview</a>
</li>
<li class="none">
<a href="../../../../hadoop-auth/Examples.html">Examples</a>
</li>
<li class="none">
<a href="../../../../hadoop-auth/Configuration.html">Configuration</a>
</li>
<li class="none">
<a href="../../../../hadoop-auth/BuildingIt.html">Building</a>
</li>
</ul>
<h5>Tools</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-streaming/HadoopStreaming.html">Hadoop Streaming</a>
</li>
<li class="none">
<a href="../../../../hadoop-archives/HadoopArchives.html">Hadoop Archives</a>
</li>
<li class="none">
<a href="../../../../hadoop-archive-logs/HadoopArchiveLogs.html">Hadoop Archive Logs</a>
</li>
<li class="none">
<a href="../../../../hadoop-distcp/DistCp.html">DistCp</a>
</li>
<li class="none">
<a href="../../../../hadoop-gridmix/GridMix.html">GridMix</a>
</li>
<li class="none">
<a href="../../../../hadoop-rumen/Rumen.html">Rumen</a>
</li>
<li class="none">
<a href="../../../../hadoop-resourceestimator/ResourceEstimator.html">Resource Estimator Service</a>
</li>
<li class="none">
<a href="../../../../hadoop-sls/SchedulerLoadSimulator.html">Scheduler Load Simulator</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/Benchmarking.html">Hadoop Benchmarking</a>
</li>
<li class="none">
<a href="../../../../hadoop-dynamometer/Dynamometer.html">Dynamometer</a>
</li>
</ul>
<h5>Reference</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/release/">Changelog and Release Notes</a>
</li>
<li class="none">
<a href="../../../../api/index.html">Java API docs</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/UnixShellAPI.html">Unix Shell API</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/Metrics.html">Metrics</a>
</li>
</ul>
<h5>Configuration</h5>
<ul>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/core-default.xml">core-default.xml</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs/hdfs-default.xml">hdfs-default.xml</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/hdfs-rbf-default.xml">hdfs-rbf-default.xml</a>
</li>
<li class="none">
<a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml">mapred-default.xml</a>
</li>
<li class="none">
<a href="../../../../hadoop-yarn/hadoop-yarn-common/yarn-default.xml">yarn-default.xml</a>
</li>
<li class="none">
<a href="../../../../hadoop-kms/kms-default.html">kms-default.xml</a>
</li>
<li class="none">
<a href="../../../../hadoop-hdfs-httpfs/httpfs-default.html">httpfs-default.xml</a>
</li>
<li class="none">
<a href="../../../../hadoop-project-dist/hadoop-common/DeprecatedProperties.html">Deprecated Properties</a>
</li>
</ul>
<a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy">
<img alt="Built by Maven" src="../../images/logos/maven-feather.png"/>
</a>
</div>
</div>
<div id="bodyColumn">
<div id="contentBox">
<!---
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
-->
<h1>Apache Hadoop 0.23.1 Release Notes</h1>
<p>These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-2784">MAPREDUCE-2784</a> | <i>Major</i> | <b>[Gridmix] TestGridmixSummary fails with NPE when run in DEBUG mode.</b></li>
</ul>
<p>Fixed bugs in ExecutionSummarizer and ResourceUsageMatcher.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-2950">MAPREDUCE-2950</a> | <i>Major</i> | <b>[Gridmix] TestUserResolve fails in trunk</b></li>
</ul>
<p>Fixes bug in TestUserResolve.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-2130">HDFS-2130</a> | <i>Major</i> | <b>Switch default checksum to CRC32C</b></li>
</ul>
<p>The default checksum algorithm used on HDFS is now CRC32C. Data from previous versions of Hadoop can still be read backwards-compatibly.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-2129">HDFS-2129</a> | <i>Major</i> | <b>Simplify BlockReader to not inherit from FSInputChecker</b></li>
</ul>
<p>BlockReader has been reimplemented to use direct byte buffers. If you use a custom socket factory, it must generate sockets that have associated Channels.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3297">MAPREDUCE-3297</a> | <i>Major</i> | <b>Move Log Related components from yarn-server-nodemanager to yarn-common</b></li>
</ul>
<p>Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3221">MAPREDUCE-3221</a> | <i>Minor</i> | <b>ant test TestSubmitJob failing on trunk</b></li>
</ul>
<p>Fixed a bug in TestSubmitJob.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3215">MAPREDUCE-3215</a> | <i>Minor</i> | <b>org.apache.hadoop.mapreduce.TestNoJobSetupCleanup failing on trunk</b></li>
</ul>
<p>Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3219">MAPREDUCE-3219</a> | <i>Minor</i> | <b>ant test TestDelegationToken failing on trunk</b></li>
</ul>
<p>Reenabled and fixed bugs in the failing test TestDelegationToken.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3217">MAPREDUCE-3217</a> | <i>Minor</i> | <b>ant test TestAuditLogger fails on trunk</b></li>
</ul>
<p>Reenabled and fixed bugs in the failing ant test TestAuditLogger.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3342">MAPREDUCE-3342</a> | <i>Critical</i> | <b>JobHistoryServer doesn&#x2019;t show job queue</b></li>
</ul>
<p>Fixed JobHistoryServer to also show the job&#x2019;s queue name.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3345">MAPREDUCE-3345</a> | <i>Major</i> | <b>Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimes</b></li>
</ul>
<p>Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3368">MAPREDUCE-3368</a> | <i>Critical</i> | <b>compile-mapred-test fails</b></li>
</ul>
<p>Fixed ant test compilation.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-2733">MAPREDUCE-2733</a> | <i>Major</i> | <b>Gridmix v3 cpu emulation system tests.</b></li>
</ul>
<p>Adds system tests for the CPU emulation feature in Gridmix3.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3333">MAPREDUCE-3333</a> | <i>Blocker</i> | <b>MR AM for sort-job going out of memory</b></li>
</ul>
<p>Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3280">MAPREDUCE-3280</a> | <i>Major</i> | <b>MR AM should not read the username from configuration</b></li>
</ul>
<p>Removed the unnecessary job user-name configuration in mapred-site.xml.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3392">MAPREDUCE-3392</a> | <i>Blocker</i> | <b>Cluster.getDelegationToken() throws NPE if client.getDelegationToken() returns null.</b></li>
</ul>
<p>Fixed Cluster&#x2019;s getDelegationToken&#x2019;s API to return null when there isn&#x2019;t a supported token.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3379">MAPREDUCE-3379</a> | <i>Major</i> | <b>LocalResourceTracker should not tracking deleted cache entries</b></li>
</ul>
<p>Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3325">MAPREDUCE-3325</a> | <i>Major</i> | <b>Improvements to CapacityScheduler doc</b></li>
</ul>
<p>document changes only.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3375">MAPREDUCE-3375</a> | <i>Major</i> | <b>Memory Emulation system tests.</b></li>
</ul>
<p>Added system tests to test the memory emulation feature in Gridmix.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3102">MAPREDUCE-3102</a> | <i>Major</i> | <b>NodeManager should fail fast with wrong configuration or permissions for LinuxContainerExecutor</b></li>
</ul>
<p>Changed NodeManager to fail fast when LinuxContainerExecutor has wrong configuration or permissions.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3355">MAPREDUCE-3355</a> | <i>Blocker</i> | <b>AM scheduling hangs frequently with sort job on 350 nodes</b></li>
</ul>
<p>Fixed MR AM&#x2019;s ContainerLauncher to handle node-command timeouts correctly.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3407">MAPREDUCE-3407</a> | <i>Minor</i> | <b>Wrong jar getting used in TestMR*Jobs* for MiniMRYarnCluster</b></li>
</ul>
<p>Fixed pom files to refer to the correct MR app-jar needed by the integration tests.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-7802">HADOOP-7802</a> | <i>Major</i> | <b>Hadoop scripts unconditionally source &#x201c;$bin&#x201d;/../libexec/hadoop-config.sh.</b></li>
</ul>
<p>Here is a patch to enable this behavior</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3412">MAPREDUCE-3412</a> | <i>Major</i> | <b>&#x2018;ant docs&#x2019; is broken</b></li>
</ul>
<p>Fixes &#x2018;ant docs&#x2019; by removing stale references to capacity-scheduler docs.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-2246">HDFS-2246</a> | <i>Major</i> | <b>Shortcut a local client reads to a Datanodes files directly</b></li>
</ul>
<ol style="list-style-type: decimal">
<li>New configurations a. dfs.block.local-path-access.user is the key in datanode configuration to specify the user allowed to do short circuit read. b. dfs.client.read.shortcircuit is the key to enable short circuit read at the client side configuration. c. dfs.client.read.shortcircuit.skip.checksum is the key to bypass checksum check at the client side.</li>
<li>By default none of the above are enabled and short circuit read will not kick in.</li>
<li>If security is on, the feature can be used only for user that has kerberos credentials at the client, therefore map reduce tasks cannot benefit from it in general.</li>
</ol><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-7851">HADOOP-7851</a> | <i>Major</i> | <b>Configuration.getClasses() never returns the default value.</b></li>
</ul>
<p>Fixed Configuration.getClasses() API to return the default value if the key is not set.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3519">MAPREDUCE-3519</a> | <i>Blocker</i> | <b>Deadlock in LocalDirsHandlerService and ShuffleHandler</b></li>
</ul>
<p>Fixed a deadlock in NodeManager LocalDirectories&#x2019;s handling service.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-2863">MAPREDUCE-2863</a> | <i>Blocker</i> | <b>Support web-services for RM &amp; NM</b></li>
</ul>
<p>Support for web-services in YARN and MR components.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3426">MAPREDUCE-3426</a> | <i>Blocker</i> | <b>uber-jobs tried to write outputs into wrong dir</b></li>
</ul>
<p>Fixed MR AM in uber mode to write map intermediate outputs in the correct directory to work properly in secure mode.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3398">MAPREDUCE-3398</a> | <i>Blocker</i> | <b>Log Aggregation broken in Secure Mode</b></li>
</ul>
<p>Fixed log aggregation to work correctly in secure mode. Contributed by Siddharth Seth.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3530">MAPREDUCE-3530</a> | <i>Blocker</i> | <b>Sometimes NODE_UPDATE to the scheduler throws an NPE causing the scheduling to stop</b></li>
</ul>
<p>Fixed an NPE occuring during scheduling in the ResourceManager.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3484">MAPREDUCE-3484</a> | <i>Major</i> | <b>JobEndNotifier is getting interrupted before completing all its retries.</b></li>
</ul>
<p>Fixed JobEndNotifier to not get interrupted before completing all its retries.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3487">MAPREDUCE-3487</a> | <i>Critical</i> | <b>jobhistory web ui task counters no longer links to singletakecounter page</b></li>
</ul>
<p>Fixed JobHistory web-UI to display links to single task&#x2019;s counters&#x2019; page.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3564">MAPREDUCE-3564</a> | <i>Blocker</i> | <b>TestStagingCleanup and TestJobEndNotifier are failing on trunk.</b></li>
</ul>
<p>Fixed failures in TestStagingCleanup and TestJobEndNotifier tests.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-778">MAPREDUCE-778</a> | <i>Major</i> | <b>[Rumen] Need a standalone JobHistory log anonymizer</b></li>
</ul>
<p>Added an anonymizer tool to Rumen. Anonymizer takes a Rumen trace file and/or topology as input. It supports persistence and plugins to override the default behavior.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3387">MAPREDUCE-3387</a> | <i>Critical</i> | <b>A tracking URL of N/A before the app master is launched breaks oozie</b></li>
</ul>
<p>Fixed AM&#x2019;s tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3339">MAPREDUCE-3339</a> | <i>Blocker</i> | <b>Job is getting hanged indefinitely,if the child processes are killed on the NM. KILL_CONTAINER eventtype is continuosly sent to the containers that are not existing</b></li>
</ul>
<p>Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3349">MAPREDUCE-3349</a> | <i>Blocker</i> | <b>No rack-name logged in JobHistory for unsuccessful tasks</b></li>
</ul>
<p>Unsuccessful tasks now log hostname and rackname to job history.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3586">MAPREDUCE-3586</a> | <i>Blocker</i> | <b>Lots of AMs hanging around in PIG testing</b></li>
</ul>
<p>Modified CompositeService to avoid duplicate stop operations thereby solving race conditions in MR AM shutdown.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3597">MAPREDUCE-3597</a> | <i>Major</i> | <b>Provide a way to access other info of history file from Rumentool</b></li>
</ul>
<p>Rumen now provides {{Parsed*}} objects. These objects provide extra information that are not provided by {{Logged*}} objects.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3399">MAPREDUCE-3399</a> | <i>Blocker</i> | <b>ContainerLocalizer should request new resources after completing the current one</b></li>
</ul>
<p>Modified ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3568">MAPREDUCE-3568</a> | <i>Critical</i> | <b>Optimize Job&#x2019;s progress calculations in MR AM</b></li>
</ul>
<p>Optimized Job&#x2019;s progress calculations in MR AM.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-7348">HADOOP-7348</a> | <i>Major</i> | <b>Modify the option of FsShell getmerge from [addnl] to [-nl] for consistency</b></li>
</ul>
<p>The &#x2018;fs -getmerge&#x2019; tool now uses a -nl flag to determine if adding a newline at end of each file is required, in favor of the &#x2018;addnl&#x2019; boolean flag that was used earlier.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3462">MAPREDUCE-3462</a> | <i>Blocker</i> | <b>Job submission failing in JUnit tests</b></li>
</ul>
<p>Fixed failing JUnit tests in Gridmix.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-1314">HDFS-1314</a> | <i>Minor</i> | <b>dfs.blocksize accepts only absolute value</b></li>
</ul>
<p>The default blocksize property &#x2018;dfs.blocksize&#x2019; now accepts unit symbols to be used instead of byte length. Values such as &#x201c;10k&#x201d;, &#x201c;128m&#x201d;, &#x201c;1g&#x201d; are now OK to provide instead of just no. of bytes as was before.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3490">MAPREDUCE-3490</a> | <i>Blocker</i> | <b>RMContainerAllocator counts failed maps towards Reduce ramp up</b></li>
</ul>
<p>Fixed MapReduce AM to count failed maps also towards Reduce ramp up.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3511">MAPREDUCE-3511</a> | <i>Blocker</i> | <b>Counters occupy a good part of AM heap</b></li>
</ul>
<p>Removed a multitude of cloned/duplicate counters in the AM thereby reducing the AM heap size and preventing full GCs.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-7963">HADOOP-7963</a> | <i>Blocker</i> | <b>test failures: TestViewFileSystemWithAuthorityLocalFileSystem and TestViewFileSystemLocalFileSystem</b></li>
</ul>
<p>Fix ViewFS to catch a null canonical service-name and pass tests TestViewFileSystem*</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3528">MAPREDUCE-3528</a> | <i>Major</i> | <b>The task timeout check interval should be configurable independent of mapreduce.task.timeout</b></li>
</ul>
<p>Fixed TaskHeartBeatHandler to use a new configuration for the thread loop interval separate from task-timeout configuration property.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3639">MAPREDUCE-3639</a> | <i>Blocker</i> | <b>TokenCache likely broken for FileSystems which don&#x2019;t issue delegation tokens</b></li>
</ul>
<p>Fixed TokenCache to work with absent FileSystem canonical service-names.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3312">MAPREDUCE-3312</a> | <i>Major</i> | <b>Make MR AM not send a stopContainer w/o corresponding start container</b></li>
</ul>
<p>Modified MR AM to not send a stop-container request for a container that isn&#x2019;t launched at all.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3382">MAPREDUCE-3382</a> | <i>Critical</i> | <b>Network ACLs can prevent AMs to ping the Job-end notification URL</b></li>
</ul>
<p>Enhanced MR AM to use a proxy to ping the job-end notification URL.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3299">MAPREDUCE-3299</a> | <i>Minor</i> | <b>Add AMInfo table to the AM job page</b></li>
</ul>
<p>Added AMInfo table to the MR AM job pages to list all the job-attempts when AM restarts and recovers.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3618">MAPREDUCE-3618</a> | <i>Major</i> | <b>TaskHeartbeatHandler holds a global lock for all task-updates</b></li>
</ul>
<p>Fixed TaskHeartbeatHandler to not hold a global lock for all task-updates.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3512">MAPREDUCE-3512</a> | <i>Blocker</i> | <b>Batch jobHistory disk flushes</b></li>
</ul>
<p>Batching JobHistory flushing to DFS so that we don&#x2019;t flush for every event slowing down AM.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3656">MAPREDUCE-3656</a> | <i>Blocker</i> | <b>Sort job on 350 scale is consistently failing with latest MRV2 code</b></li>
</ul>
<p>Fixed a race condition in MR AM which is failing the sort benchmark consistently.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3532">MAPREDUCE-3532</a> | <i>Critical</i> | <b>When 0 is provided as port number in yarn.nodemanager.webapp.address, NMs webserver component picks up random port, NM keeps on Reporting 0 port to RM</b></li>
</ul>
<p>Modified NM to report correct http address when an ephemeral web port is configured.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3404">MAPREDUCE-3404</a> | <i>Critical</i> | <b>Speculative Execution: speculative map tasks launched even if -Dmapreduce.map.speculative=false</b></li>
</ul>
<p>Corrected MR AM to honor speculative configuration and enable speculating either maps or reduces.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3641">MAPREDUCE-3641</a> | <i>Blocker</i> | <b>CapacityScheduler should be more conservative assigning off-switch requests</b></li>
</ul>
<p>Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-7986">HADOOP-7986</a> | <i>Major</i> | <b>Add config for History Server protocol in hadoop-policy for service level authorization.</b></li>
</ul>
<p>Adding config for MapReduce History Server protocol in hadoop-policy.xml for service level authorization.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3549">MAPREDUCE-3549</a> | <i>Blocker</i> | <b>write api documentation for web service apis for RM, NM, mapreduce app master, and job history server</b></li>
</ul>
<p>new files added: A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/WebServicesIntro.apt.vm A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/NodeManagerRest.apt.vm A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ResourceManagerRest.apt.vm A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/MapredAppMasterRest.apt.vm A hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/HistoryServerRest.apt.vm</p>
<p>The hadoop-project/src/site/site.xml is split into separate patch.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3710">MAPREDUCE-3710</a> | <i>Major</i> | <b>last split generated by FileInputFormat.getSplits may not have the best locality</b></li>
</ul>
<p>Improved FileInputFormat to return better locality for the last split.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3714">MAPREDUCE-3714</a> | <i>Blocker</i> | <b>Reduce hangs in a corner case</b></li>
</ul>
<p>Fixed EventFetcher and Fetcher threads to shut-down properly so that reducers don&#x2019;t hang in corner cases.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3630">MAPREDUCE-3630</a> | <i>Critical</i> | <b>NullPointerException running teragen</b></li>
</ul>
<p>Committed to trunk and branch-0.23. Thanks Mahadev.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3713">MAPREDUCE-3713</a> | <i>Blocker</i> | <b>Incorrect headroom reported to jobs</b></li>
</ul>
<p>Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-2765">MAPREDUCE-2765</a> | <i>Major</i> | <b>DistCp Rewrite</b></li>
</ul>
<p>DistCpV2 added to hadoop-tools.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3699">MAPREDUCE-3699</a> | <i>Major</i> | <b>Default RPC handlers are very low for YARN servers</b></li>
</ul>
<p>Increased RPC handlers for all YARN servers to reasonable values for working at scale.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3360">MAPREDUCE-3360</a> | <i>Critical</i> | <b>Provide information about lost nodes in the UI.</b></li>
</ul>
<p>Added information about lost/rebooted/decommissioned nodes on the webapps.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3720">MAPREDUCE-3720</a> | <i>Major</i> | <b>Command line listJobs should not visit each AM</b></li>
</ul>
<p>Changed bin/mapred job -list to not print job-specific information not available at RM.</p>
<p>Very minor incompatibility in cmd-line output, inevitable due to MRv2 architecture.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3732">MAPREDUCE-3732</a> | <i>Blocker</i> | <b>CS should only use &#x2018;activeUsers with pending requests&#x2019; for computing user-limits</b></li>
</ul>
<p>Modified CapacityScheduler to use only users with pending requests for computing user-limits.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3481">MAPREDUCE-3481</a> | <i>Major</i> | <b>[Gridmix] Improve STRESS mode locking</b></li>
</ul>
<p>Modified Gridmix STRESS mode locking structure. The submitted thread and the polling thread now run simultaneously without blocking each other.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3703">MAPREDUCE-3703</a> | <i>Critical</i> | <b>ResourceManager should provide node lists in JMX output</b></li>
</ul>
<p>New JMX Bean in ResourceManager to provide list of live node managers:</p>
<p>Hadoop:service=ResourceManager,name=RMNMInfo LiveNodeManagers</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3716">MAPREDUCE-3716</a> | <i>Blocker</i> | <b>java.io.File.createTempFile fails in map/reduce tasks</b></li>
</ul>
<p>Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3754">MAPREDUCE-3754</a> | <i>Major</i> | <b>RM webapp should have pages filtered based on App-state</b></li>
</ul>
<p>Modified RM UI to filter applications based on state of the applications.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3774">MAPREDUCE-3774</a> | <i>Major</i> | <b>yarn-default.xml should be moved to hadoop-yarn-common.</b></li>
</ul>
<p>MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-7470">HADOOP-7470</a> | <i>Minor</i> | <b>move up to Jackson 1.8.8</b></li>
</ul>
<p><b>WARNING: No release note provided for this change.</b></p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3752">MAPREDUCE-3752</a> | <i>Blocker</i> | <b>Headroom should be capped by queue max-cap</b></li>
</ul>
<p>Modified application limits to include queue max-capacities besides the usual user limits.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3784">MAPREDUCE-3784</a> | <i>Major</i> | <b>maxActiveApplications(|PerUser) per queue is too low for small clusters</b></li>
</ul>
<p>Fixed CapacityScheduler so that maxActiveApplication and maxActiveApplicationsPerUser per queue are not too low for small clusters.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-8013">HADOOP-8013</a> | <i>Major</i> | <b>ViewFileSystem does not honor setVerifyChecksum</b></li>
</ul>
<p><b>WARNING: No release note provided for this change.</b></p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3711">MAPREDUCE-3711</a> | <i>Blocker</i> | <b>AppMaster recovery for Medium to large jobs take long time</b></li>
</ul>
<p>Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3760">MAPREDUCE-3760</a> | <i>Major</i> | <b>Blacklisted NMs should not appear in Active nodes list</b></li>
</ul>
<p>Changed active nodes list to not contain unhealthy nodes on the webUI and metrics.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3417">MAPREDUCE-3417</a> | <i>Blocker</i> | <b>job access controls not working app master and job history UI&#x2019;s</b></li>
</ul>
<p>Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3808">MAPREDUCE-3808</a> | <i>Blocker</i> | <b>NPE in FileOutputCommitter when running a 0 reduce job</b></li>
</ul>
<p>Fixed an NPE in FileOutputCommitter for jobs with maps but no reduces.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3804">MAPREDUCE-3804</a> | <i>Major</i> | <b>yarn webapp interface vulnerable to cross scripting attacks</b></li>
</ul>
<p>fix cross scripting attacks vulnerability through webapp interface.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3815">MAPREDUCE-3815</a> | <i>Critical</i> | <b>Data Locality suffers if the AM asks for containers using IPs instead of hostnames</b></li>
</ul>
<p>Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3834">MAPREDUCE-3834</a> | <i>Critical</i> | <b>If multiple hosts for a split belong to the same rack, the rack is added multiple times in the AM request table</b></li>
</ul>
<p>Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3846">MAPREDUCE-3846</a> | <i>Critical</i> | <b>Restarted+Recovered AM hangs in some corner cases</b></li>
</ul>
<p>Addressed MR AM hanging issues during AM restart and then the recovery.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-8009">HADOOP-8009</a> | <i>Critical</i> | <b>Create hadoop-client and hadoop-minicluster artifacts for downstream projects</b></li>
</ul>
<p>Generate integration artifacts &#x201c;org.apache.hadoop:hadoop-client&#x201d; and &#x201c;org.apache.hadoop:hadoop-minicluster&#x201d; containing all the jars needed to use Hadoop client APIs, and to run Hadoop MiniClusters, respectively. Push these artifacts to the maven repository when mvn-deploy, along with existing artifacts.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3802">MAPREDUCE-3802</a> | <i>Critical</i> | <b>If an MR AM dies twice it looks like the process freezes</b></li>
</ul>
<p>Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3854">MAPREDUCE-3854</a> | <i>Major</i> | <b>Reinstate environment variable tests in TestMiniMRChildTask</b></li>
</ul>
<p>Fixed and reenabled tests related to MR child JVM&#x2019;s environmental variables in TestMiniMRChildTask.</p><hr />
<ul>
<li><a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-2316">HDFS-2316</a> | <i>Major</i> | <b>[umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP</b></li>
</ul>
<p>Provide WebHDFS as a complete FileSystem implementation for accessing HDFS over HTTP. Previous hftp feature was a read-only FileSystem and does not provide &#x201c;write&#x201d; accesses.</p>
</div>
</div>
<div class="clear">
<hr/>
</div>
<div id="footer">
<div class="xright">
&#169; 2008-2021
Apache Software Foundation
- <a href="http://maven.apache.org/privacy-policy.html">Privacy Policy</a>.
Apache Maven, Maven, Apache, the Apache feather logo, and the Apache Maven project logos are trademarks of The Apache Software Foundation.
</div>
<div class="clear">
<hr/>
</div>
</div>
</body>
</html>