| <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> |
| <!-- |
| | Generated by Apache Maven Doxia at 2021-06-15 |
| | Rendered using Apache Maven Stylus Skin 1.5 |
| --> |
| <html xmlns="http://www.w3.org/1999/xhtml"> |
| <head> |
| <title>Apache Hadoop 3.3.1 – Apache Hadoop Changelog</title> |
| <style type="text/css" media="all"> |
| @import url("../../css/maven-base.css"); |
| @import url("../../css/maven-theme.css"); |
| @import url("../../css/site.css"); |
| </style> |
| <link rel="stylesheet" href="../../css/print.css" type="text/css" media="print" /> |
| <meta name="Date-Revision-yyyymmdd" content="20210615" /> |
| <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> |
| </head> |
| <body class="composite"> |
| <div id="banner"> |
| <a href="http://hadoop.apache.org/" id="bannerLeft"> |
| <img src="http://hadoop.apache.org/images/hadoop-logo.jpg" alt="" /> |
| </a> |
| <a href="http://www.apache.org/" id="bannerRight"> |
| <img src="http://www.apache.org/images/asf_logo_wide.png" alt="" /> |
| </a> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="breadcrumbs"> |
| |
| <div class="xleft"> |
| <a href="http://www.apache.org/" class="externalLink">Apache</a> |
| > |
| <a href="http://hadoop.apache.org/" class="externalLink">Hadoop</a> |
| > |
| <a href="../../../index.html">Apache Hadoop Project Dist POM</a> |
| > |
| <a href="../../index.html">Apache Hadoop 3.3.1</a> |
| > |
| Apache Hadoop Changelog |
| </div> |
| <div class="xright"> <a href="http://wiki.apache.org/hadoop" class="externalLink">Wiki</a> |
| | |
| <a href="https://gitbox.apache.org/repos/asf/hadoop.git" class="externalLink">git</a> |
| | |
| <a href="http://hadoop.apache.org/" class="externalLink">Apache Hadoop</a> |
| |
| | Last Published: 2021-06-15 |
| | Version: 3.3.1 |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="leftColumn"> |
| <div id="navcolumn"> |
| |
| <h5>General</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/SingleCluster.html">Single Node Setup</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/ClusterSetup.html">Cluster Setup</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CommandsManual.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/FileSystemShell.html">FileSystem Shell</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Compatibility.html">Compatibility Specification</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/DownstreamDev.html">Downstream Developer's Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/AdminCompatibilityGuide.html">Admin Compatibility Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/InterfaceClassification.html">Interface Classification</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/filesystem/index.html">FileSystem Specification</a> |
| </li> |
| </ul> |
| <h5>Common</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CLIMiniCluster.html">CLI Mini Cluster</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/FairCallQueue.html">Fair Call Queue</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/NativeLibraries.html">Native Libraries</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Superusers.html">Proxy User</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/RackAwareness.html">Rack Awareness</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/SecureMode.html">Secure Mode</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/ServiceLevelAuth.html">Service Level Authorization</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/HttpAuthentication.html">HTTP Authentication</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CredentialProviderAPI.html">Credential Provider API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-kms/index.html">Hadoop KMS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Tracing.html">Tracing</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/UnixShellGuide.html">Unix Shell Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/registry/index.html">Registry</a> |
| </li> |
| </ul> |
| <h5>HDFS</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDesign.html">Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html">User Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html">NameNode HA With QJM</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html">NameNode HA With NFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ObserverNameNode.html">Observer NameNode</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/Federation.html">Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFs.html">ViewFs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFsOverloadScheme.html">ViewFsOverloadScheme</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsSnapshots.html">Snapshots</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsEditsViewer.html">Edits Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsImageViewer.html">Image Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.html">Permissions and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsQuotaAdminGuide.html">Quotas and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/LibHdfs.html">libhdfs (C API)</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/WebHDFS.html">WebHDFS (REST API)</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-hdfs-httpfs/index.html">HttpFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html">Short Circuit Local Reads</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html">Centralized Cache Management</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html">NFS Gateway</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html">Rolling Upgrade</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html">Extended Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html">Transparent Encryption</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html">Multihoming</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html">Storage Policies</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/MemoryStorage.html">Memory Storage Support</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/SLGUserGuide.html">Synthetic Load Generator</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSErasureCoding.html">Erasure Coding</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSDiskbalancer.html">Disk Balancer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUpgradeDomain.html">Upgrade Domain</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDataNodeAdminGuide.html">DataNode Admin</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html">Router Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsProvidedStorage.html">Provided Storage</a> |
| </li> |
| </ul> |
| <h5>MapReduce</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html">Tutorial</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html">Compatibility with 1.x</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/EncryptedShuffle.html">Encrypted Shuffle</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/PluggableShuffleAndPluggableSort.html">Pluggable Shuffle/Sort</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/DistributedCacheDeploy.html">Distributed Cache Deploy</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/SharedCacheSupport.html">Support for YARN Shared Cache</a> |
| </li> |
| </ul> |
| <h5>MapReduce REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html">MR Application Master</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-hs/HistoryServerRest.html">MR History Server</a> |
| </li> |
| </ul> |
| <h5>YARN</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YARN.html">Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html">Capacity Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/FairScheduler.html">Fair Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html">ResourceManager Restart</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html">ResourceManager HA</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceModel.html">Resource Model</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeLabel.html">Node Labels</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeAttributes.html">Node Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html">Web Application Proxy</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html">Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html">Timeline Service V.2</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html">Writing YARN Applications</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnApplicationSecurity.html">YARN Application Security</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManager.html">NodeManager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/DockerContainers.html">Running Applications in Docker Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/RuncContainers.html">Running Applications in runC Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html">Using CGroups</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/SecureContainer.html">Secure Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ReservationSystem.html">Reservation System</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/GracefulDecommission.html">Graceful Decommission</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html">Opportunistic Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/Federation.html">YARN Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/SharedCache.html">Shared Cache</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingGpus.html">Using GPU</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingFPGA.html">Using FPGA</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/PlacementConstraints.html">Placement Constraints</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnUI2.html">YARN UI2</a> |
| </li> |
| </ul> |
| <h5>YARN REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html">Introduction</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html">Resource Manager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerRest.html">Node Manager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html#Timeline_Server_REST_API_v1">Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html#Timeline_Service_v.2_REST_API">Timeline Service V.2</a> |
| </li> |
| </ul> |
| <h5>YARN Service</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Overview.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/QuickStart.html">QuickStart</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Concepts.html">Concepts</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/YarnServiceAPI.html">Yarn Service API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/ServiceDiscovery.html">Service Discovery</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/SystemServices.html">System Services</a> |
| </li> |
| </ul> |
| <h5>Hadoop Compatible File Systems</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-aliyun/tools/hadoop-aliyun/index.html">Aliyun OSS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-aws/tools/hadoop-aws/index.html">Amazon S3</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-azure/index.html">Azure Blob Storage</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-azure-datalake/index.html">Azure Data Lake Storage</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-openstack/index.html">OpenStack Swift</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-cos/cloud-storage/index.html">Tencent COS</a> |
| </li> |
| </ul> |
| <h5>Auth</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/Examples.html">Examples</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/Configuration.html">Configuration</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/BuildingIt.html">Building</a> |
| </li> |
| </ul> |
| <h5>Tools</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-streaming/HadoopStreaming.html">Hadoop Streaming</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-archives/HadoopArchives.html">Hadoop Archives</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-archive-logs/HadoopArchiveLogs.html">Hadoop Archive Logs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-distcp/DistCp.html">DistCp</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-gridmix/GridMix.html">GridMix</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-rumen/Rumen.html">Rumen</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-resourceestimator/ResourceEstimator.html">Resource Estimator Service</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-sls/SchedulerLoadSimulator.html">Scheduler Load Simulator</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Benchmarking.html">Hadoop Benchmarking</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-dynamometer/Dynamometer.html">Dynamometer</a> |
| </li> |
| </ul> |
| <h5>Reference</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/release/">Changelog and Release Notes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../api/index.html">Java API docs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/UnixShellAPI.html">Unix Shell API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Metrics.html">Metrics</a> |
| </li> |
| </ul> |
| <h5>Configuration</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/core-default.xml">core-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/hdfs-default.xml">hdfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/hdfs-rbf-default.xml">hdfs-rbf-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml">mapred-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-common/yarn-default.xml">yarn-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-kms/kms-default.html">kms-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-hdfs-httpfs/httpfs-default.html">httpfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/DeprecatedProperties.html">Deprecated Properties</a> |
| </li> |
| </ul> |
| <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"> |
| <img alt="Built by Maven" src="../../images/logos/maven-feather.png"/> |
| </a> |
| |
| </div> |
| </div> |
| <div id="bodyColumn"> |
| <div id="contentBox"> |
| <!--- |
| # Licensed to the Apache Software Foundation (ASF) under one |
| # or more contributor license agreements. See the NOTICE file |
| # distributed with this work for additional information |
| # regarding copyright ownership. The ASF licenses this file |
| # to you under the Apache License, Version 2.0 (the |
| # "License"); you may not use this file except in compliance |
| # with the License. You may obtain a copy of the License at |
| # |
| # http://www.apache.org/licenses/LICENSE-2.0 |
| # |
| # Unless required by applicable law or agreed to in writing, software |
| # distributed under the License is distributed on an "AS IS" BASIS, |
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| # See the License for the specific language governing permissions and |
| # limitations under the License. |
| --> |
| <h1>Apache Hadoop Changelog</h1> |
| <div class="section"> |
| <h2><a name="Release_2.7.2_-_2016-01-25"></a>Release 2.7.2 - 2016-01-25</h2> |
| <div class="section"> |
| <h3><a name="INCOMPATIBLE_CHANGES:"></a>INCOMPATIBLE CHANGES:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4087">YARN-4087</a> </td> |
| <td align="left"> Followup fixes after YARN-2019 regarding RM behavior when state-store error occurs </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Jian He </td> |
| <td align="left"> Jian He </td></tr> |
| </tbody> |
| </table></div> |
| <div class="section"> |
| <h3><a name="IMPROVEMENTS:"></a>IMPROVEMENTS:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-7645">HDFS-7645</a> </td> |
| <td align="left"> Rolling upgrade is restoring blocks from trash multiple times </td> |
| <td align="left"> Major </td> |
| <td align="left"> datanode </td> |
| <td align="left"> Nathan Roberts </td> |
| <td align="left"> Keisuke Ogiwara </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3248">YARN-3248</a> </td> |
| <td align="left"> Display count of nodes blacklisted by apps in the web UI </td> |
| <td align="left"> Major </td> |
| <td align="left"> capacityscheduler, resourcemanager </td> |
| <td align="left"> Varun Vasudev </td> |
| <td align="left"> Varun Vasudev </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-11812">HADOOP-11812</a> </td> |
| <td align="left"> Implement listLocatedStatus for ViewFileSystem to speed up split calculation </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> fs </td> |
| <td align="left"> Gera Shegalov </td> |
| <td align="left"> Gera Shegalov </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-7139">HADOOP-7139</a> </td> |
| <td align="left"> Allow appending to existing SequenceFiles </td> |
| <td align="left"> Major </td> |
| <td align="left"> io </td> |
| <td align="left"> Stephen Rose </td> |
| <td align="left"> Kanaka Kumar Avvaru </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8659">HDFS-8659</a> </td> |
| <td align="left"> Block scanner INFO message is spamming logs </td> |
| <td align="left"> Major </td> |
| <td align="left"> datanode </td> |
| <td align="left"> Yongjun Zhang </td> |
| <td align="left"> Yongjun Zhang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8722">HDFS-8722</a> </td> |
| <td align="left"> Optimize datanode writes for small writes and flushes </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12232">HADOOP-12232</a> </td> |
| <td align="left"> Upgrade Tomcat dependency to 6.0.44. </td> |
| <td align="left"> Major </td> |
| <td align="left"> build </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3170">YARN-3170</a> </td> |
| <td align="left"> YARN architecture document needs updating </td> |
| <td align="left"> Major </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Allen Wittenauer </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-7314">HDFS-7314</a> </td> |
| <td align="left"> When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Ming Ma </td> |
| <td align="left"> Ming Ma </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3978">YARN-3978</a> </td> |
| <td align="left"> Configurably turn off the saving of container info in Generic AHS </td> |
| <td align="left"> Major </td> |
| <td align="left"> timelineserver, yarn </td> |
| <td align="left"> Eric Payne </td> |
| <td align="left"> Eric Payne </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12280">HADOOP-12280</a> </td> |
| <td align="left"> Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded </td> |
| <td align="left"> Minor </td> |
| <td align="left"> test </td> |
| <td align="left"> Masatake Iwasaki </td> |
| <td align="left"> Masatake Iwasaki </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-5323">HADOOP-5323</a> </td> |
| <td align="left"> Trash documentation should describe its directory structure and configurations </td> |
| <td align="left"> Minor </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Suman Sehgal </td> |
| <td align="left"> Weiwei Yang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8384">HDFS-8384</a> </td> |
| <td align="left"> Allow NN to startup if there are files having a lease but are not under construction </td> |
| <td align="left"> Minor </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Tsz Wo Nicholas Sze </td> |
| <td align="left"> Jing Zhao </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12413">HADOOP-12413</a> </td> |
| <td align="left"> AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. </td> |
| <td align="left"> Major </td> |
| <td align="left"> security </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4158">YARN-4158</a> </td> |
| <td align="left"> Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers </td> |
| <td align="left"> Minor </td> |
| <td align="left"> nodemanager </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3727">YARN-3727</a> </td> |
| <td align="left"> For better error recovery, check if the directory exists before using it for localization. </td> |
| <td align="left"> Major </td> |
| <td align="left"> nodemanager </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9221">HDFS-9221</a> </td> |
| <td align="left"> HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array </td> |
| <td align="left"> Major </td> |
| <td align="left"> performance </td> |
| <td align="left"> Staffan Friberg </td> |
| <td align="left"> Staffan Friberg </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9434">HDFS-9434</a> </td> |
| <td align="left"> Recommission a datanode with 500k blocks may pause NN for 30 seconds </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Tsz Wo Nicholas Sze </td> |
| <td align="left"> Tsz Wo Nicholas Sze </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12825">HADOOP-12825</a> </td> |
| <td align="left"> Log slow name resolutions </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Sidharta Seethana </td> |
| <td align="left"> Sidharta Seethana </td></tr> |
| </tbody> |
| </table></div> |
| <div class="section"> |
| <h3><a name="BUG_FIXES:"></a>BUG FIXES:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9242">HADOOP-9242</a> </td> |
| <td align="left"> Duplicate surefire plugin config in hadoop-common </td> |
| <td align="left"> Major </td> |
| <td align="left"> test </td> |
| <td align="left"> Andrey Klochkov </td> |
| <td align="left"> Andrey Klochkov </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-6945">HDFS-6945</a> </td> |
| <td align="left"> BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed </td> |
| <td align="left"> Critical </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Akira Ajisaka </td> |
| <td align="left"> Akira Ajisaka </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8046">HDFS-8046</a> </td> |
| <td align="left"> Allow better control of getContentSummary </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-2890">YARN-2890</a> </td> |
| <td align="left"> MiniYarnCluster should turn on timeline service if configured to do so </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Mit Desai </td> |
| <td align="left"> Mit Desai </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-7725">HDFS-7725</a> </td> |
| <td align="left"> Incorrect “nodes in service” metrics caused all writes to fail </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Ming Ma </td> |
| <td align="left"> Ming Ma </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8099">HDFS-8099</a> </td> |
| <td align="left"> Change “DFSInputStream has been closed already” message to debug log level </td> |
| <td align="left"> Minor </td> |
| <td align="left"> hdfs-client </td> |
| <td align="left"> Charles Lamb </td> |
| <td align="left"> Charles Lamb </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-11491">HADOOP-11491</a> </td> |
| <td align="left"> HarFs incorrectly declared as requiring an authority </td> |
| <td align="left"> Critical </td> |
| <td align="left"> fs </td> |
| <td align="left"> Gera Shegalov </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5649">MAPREDUCE-5649</a> </td> |
| <td align="left"> Reduce cannot use more than 2G memory for the final merge </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv2 </td> |
| <td align="left"> stanley shi </td> |
| <td align="left"> Gera Shegalov </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8219">HDFS-8219</a> </td> |
| <td align="left"> setStoragePolicy with folder behavior is different after cluster restart </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Peter Shi </td> |
| <td align="left"> Surendra Singh Lilhore </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6273">MAPREDUCE-6273</a> </td> |
| <td align="left"> HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state </td> |
| <td align="left"> Minor </td> |
| <td align="left"> jobhistoryserver </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8431">HDFS-8431</a> </td> |
| <td align="left"> hdfs crypto class not found in Windows </td> |
| <td align="left"> Critical </td> |
| <td align="left"> scripts </td> |
| <td align="left"> Sumana Sathish </td> |
| <td align="left"> Anu Engineer </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-7609">HDFS-7609</a> </td> |
| <td align="left"> Avoid retry cache collision when Standby NameNode loading edits </td> |
| <td align="left"> Critical </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Carrey Zhan </td> |
| <td align="left"> Ming Ma </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6377">MAPREDUCE-6377</a> </td> |
| <td align="left"> JHS sorting on state column not working in webUi </td> |
| <td align="left"> Minor </td> |
| <td align="left"> jobhistoryserver </td> |
| <td align="left"> Bibin A Chundatt </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3780">YARN-3780</a> </td> |
| <td align="left"> Should use equals when compare Resource in RMNodeImpl#ReconnectNodeTransition </td> |
| <td align="left"> Minor </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8615">HDFS-8615</a> </td> |
| <td align="left"> Correct HTTP method in WebHDFS document </td> |
| <td align="left"> Major </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Akira Ajisaka </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3802">YARN-3802</a> </td> |
| <td align="left"> Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected. </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5948">MAPREDUCE-5948</a> </td> |
| <td align="left"> org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Kris Geusebroek </td> |
| <td align="left"> Akira Ajisaka </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-8151">HADOOP-8151</a> </td> |
| <td align="left"> Error handling in snappy decompressor throws invalid exceptions </td> |
| <td align="left"> Major </td> |
| <td align="left"> io, native </td> |
| <td align="left"> Todd Lipcon </td> |
| <td align="left"> Matt Foley </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8656">HDFS-8656</a> </td> |
| <td align="left"> Preserve compatibility of ClientProtocol#rollingUpgrade after finalization </td> |
| <td align="left"> Critical </td> |
| <td align="left"> rolling upgrades </td> |
| <td align="left"> Andrew Wang </td> |
| <td align="left"> Andrew Wang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3793">YARN-3793</a> </td> |
| <td align="left"> Several NPEs when deleting local files on NM recovery </td> |
| <td align="left"> Major </td> |
| <td align="left"> nodemanager </td> |
| <td align="left"> Karthik Kambatla </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3508">YARN-3508</a> </td> |
| <td align="left"> Prevent processing preemption events on the main RM dispatcher </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager, scheduler </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6425">MAPREDUCE-6425</a> </td> |
| <td align="left"> ShuffleHandler passes wrong “base” parameter to getMapOutputInfo if mapId is not in the cache. </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv2, nodemanager </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12186">HADOOP-12186</a> </td> |
| <td align="left"> ActiveStandbyElector shouldn’t call monitorLockNodeAsync multiple times </td> |
| <td align="left"> Major </td> |
| <td align="left"> ha </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3690">YARN-3690</a> </td> |
| <td align="left"> [JDK8] ‘mvn site’ fails </td> |
| <td align="left"> Major </td> |
| <td align="left"> api, site </td> |
| <td align="left"> Akira Ajisaka </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6426">MAPREDUCE-6426</a> </td> |
| <td align="left"> TestShuffleHandler#testGetMapOutputInfo is failing </td> |
| <td align="left"> Major </td> |
| <td align="left"> test </td> |
| <td align="left"> Devaraj K </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12191">HADOOP-12191</a> </td> |
| <td align="left"> Bzip2Factory is not thread safe </td> |
| <td align="left"> Major </td> |
| <td align="left"> io </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8767">HDFS-8767</a> </td> |
| <td align="left"> RawLocalFileSystem.listStatus() returns null for UNIX pipefile </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Haohui Mai </td> |
| <td align="left"> Kanaka Kumar Avvaru </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3535">YARN-3535</a> </td> |
| <td align="left"> Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED </td> |
| <td align="left"> Critical </td> |
| <td align="left"> capacityscheduler, fairscheduler, resourcemanager </td> |
| <td align="left"> Peng Zhang </td> |
| <td align="left"> Peng Zhang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3905">YARN-3905</a> </td> |
| <td align="left"> Application History Server UI NPEs when accessing apps run after RM restart </td> |
| <td align="left"> Major </td> |
| <td align="left"> timelineserver </td> |
| <td align="left"> Eric Payne </td> |
| <td align="left"> Eric Payne </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3878">YARN-3878</a> </td> |
| <td align="left"> AsyncDispatcher can hang while stopping if it is configured for draining events on stop </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Varun Saxena </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-2019">YARN-2019</a> </td> |
| <td align="left"> Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Junping Du </td> |
| <td align="left"> Jian He </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8806">HDFS-8806</a> </td> |
| <td align="left"> Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Zhe Zhang </td> |
| <td align="left"> Zhe Zhang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3967">YARN-3967</a> </td> |
| <td align="left"> Fetch the application report from the AHS if the RM does not know about it </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Mit Desai </td> |
| <td align="left"> Mit Desai </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3925">YARN-3925</a> </td> |
| <td align="left"> ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. </td> |
| <td align="left"> Critical </td> |
| <td align="left"> nodemanager </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3990">YARN-3990</a> </td> |
| <td align="left"> AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected </td> |
| <td align="left"> Critical </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Rohith Sharma K S </td> |
| <td align="left"> Bibin A Chundatt </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8850">HDFS-8850</a> </td> |
| <td align="left"> VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks </td> |
| <td align="left"> Major </td> |
| <td align="left"> datanode </td> |
| <td align="left"> Colin P. McCabe </td> |
| <td align="left"> Colin P. McCabe </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12304">HADOOP-12304</a> </td> |
| <td align="left"> Applications using FileContext fail with the default file system configured to be wasb/s3/etc. </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> fs </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-11932">HADOOP-11932</a> </td> |
| <td align="left"> MetricsSinkAdapter hangs when being stopped </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Jian He </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3999">YARN-3999</a> </td> |
| <td align="left"> RM hangs on draining events </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Jian He </td> |
| <td align="left"> Jian He </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8879">HDFS-8879</a> </td> |
| <td align="left"> Quota by storage type usage incorrectly initialized upon namenode restart </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Xiaoyu Yao </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4005">YARN-4005</a> </td> |
| <td align="left"> Completed container whose app is finished is not removed from NMStateStore </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Jun Gong </td> |
| <td align="left"> Jun Gong </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4047">YARN-4047</a> </td> |
| <td align="left"> ClientRMService getApplications has high scheduler lock contention </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Jason Lowe </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8891">HDFS-8891</a> </td> |
| <td align="left"> HDFS concat should keep srcs order </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Yong Zhang </td> |
| <td align="left"> Yong Zhang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6439">MAPREDUCE-6439</a> </td> |
| <td align="left"> AM may fail instead of retrying if RM shuts down during the allocate call </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Anubhav Dhoot </td> |
| <td align="left"> Anubhav Dhoot </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8852">HDFS-8852</a> </td> |
| <td align="left"> HDFS architecture documentation of version 2.x is outdated about append write support </td> |
| <td align="left"> Major </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Hong Dai Thanh </td> |
| <td align="left"> Ajith S </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3857">YARN-3857</a> </td> |
| <td align="left"> Memory leak in ResourceManager with SIMPLE mode </td> |
| <td align="left"> Critical </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> mujunchao </td> |
| <td align="left"> mujunchao </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8867">HDFS-8867</a> </td> |
| <td align="left"> Enable optimized block reports </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Rushabh S Shah </td> |
| <td align="left"> Daryn Sharp </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8863">HDFS-8863</a> </td> |
| <td align="left"> The remaining space check in BlockPlacementPolicyDefault is flawed </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6454">MAPREDUCE-6454</a> </td> |
| <td align="left"> MapReduce doesn’t set the HADOOP_CLASSPATH for jar lib in distributed cache. </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Junping Du </td> |
| <td align="left"> Junping Du </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3896">YARN-3896</a> </td> |
| <td align="left"> RMNode transitioned from RUNNING to REBOOTED because its response id had not been reset synchronously </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Jun Gong </td> |
| <td align="left"> Jun Gong </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8846">HDFS-8846</a> </td> |
| <td align="left"> Add a unit test for INotify functionality across a layout version upgrade </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Zhe Zhang </td> |
| <td align="left"> Zhe Zhang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8950">HDFS-8950</a> </td> |
| <td align="left"> NameNode refresh doesn’t remove DataNodes that are no longer in the allowed list </td> |
| <td align="left"> Major </td> |
| <td align="left"> datanode, namenode </td> |
| <td align="left"> Daniel Templeton </td> |
| <td align="left"> Daniel Templeton </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12359">HADOOP-12359</a> </td> |
| <td align="left"> hadoop fs -getmerge doc is wrong </td> |
| <td align="left"> Major </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Daniel Templeton </td> |
| <td align="left"> Jagadesh Kiran N </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-10365">HADOOP-10365</a> </td> |
| <td align="left"> BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block </td> |
| <td align="left"> Minor </td> |
| <td align="left"> util </td> |
| <td align="left"> Ted Yu </td> |
| <td align="left"> Kiran Kumar M R </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8995">HDFS-8995</a> </td> |
| <td align="left"> Flaw in registration bookeeping can make DN die on reconnect </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12006">HADOOP-12006</a> </td> |
| <td align="left"> Remove unimplemented option for `hadoop fs -ls` from document in branch-2.7 </td> |
| <td align="left"> Major </td> |
| <td align="left"> documentation, fs </td> |
| <td align="left"> Akira Ajisaka </td> |
| <td align="left"> Akira Ajisaka </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12213">HADOOP-12213</a> </td> |
| <td align="left"> Interrupted exception can occur when Client#stop is called </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Oleg Zhurakousky </td> |
| <td align="left"> Kuhu Shukla </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4103">YARN-4103</a> </td> |
| <td align="left"> RM WebServices missing scheme for appattempts logLinks </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Jonathan Eagles </td> |
| <td align="left"> Jonathan Eagles </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4105">YARN-4105</a> </td> |
| <td align="left"> Capacity Scheduler headroom for DRF is wrong </td> |
| <td align="left"> Major </td> |
| <td align="left"> capacityscheduler </td> |
| <td align="left"> Chang Li </td> |
| <td align="left"> Chang Li </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6442">MAPREDUCE-6442</a> </td> |
| <td align="left"> Stack trace is missing when error occurs in client protocol provider’s constructor </td> |
| <td align="left"> Major </td> |
| <td align="left"> client </td> |
| <td align="left"> Chang Li </td> |
| <td align="left"> Chang Li </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4096">YARN-4096</a> </td> |
| <td align="left"> App local logs are leaked if log aggregation fails to initialize for the app </td> |
| <td align="left"> Major </td> |
| <td align="left"> log-aggregation, nodemanager </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Jason Lowe </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9033">HDFS-9033</a> </td> |
| <td align="left"> dfsadmin -metasave prints “NaN” for cache used% </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Archana T </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6474">MAPREDUCE-6474</a> </td> |
| <td align="left"> ShuffleHandler can possibly exhaust nodemanager file descriptors </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv2, nodemanager </td> |
| <td align="left"> Nathan Roberts </td> |
| <td align="left"> Kuhu Shukla </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9042">HDFS-9042</a> </td> |
| <td align="left"> Update document for the Storage policy name </td> |
| <td align="left"> Minor </td> |
| <td align="left"> documentation </td> |
| <td align="left"> J.Andreina </td> |
| <td align="left"> J.Andreina </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6472">MAPREDUCE-6472</a> </td> |
| <td align="left"> MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks </td> |
| <td align="left"> Major </td> |
| <td align="left"> mr-am </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Naganarasimha G R </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6481">MAPREDUCE-6481</a> </td> |
| <td align="left"> LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. </td> |
| <td align="left"> Critical </td> |
| <td align="left"> mrv2 </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5982">MAPREDUCE-5982</a> </td> |
| <td align="left"> Task attempts that fail from the ASSIGNED state can disappear </td> |
| <td align="left"> Major </td> |
| <td align="left"> mr-am </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Chang Li </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3697">YARN-3697</a> </td> |
| <td align="left"> FairScheduler: ContinuousSchedulingThread can fail to shutdown </td> |
| <td align="left"> Critical </td> |
| <td align="left"> fairscheduler </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9043">HDFS-9043</a> </td> |
| <td align="left"> Doc updation for commands in HDFS Federation </td> |
| <td align="left"> Minor </td> |
| <td align="left"> documentation </td> |
| <td align="left"> J.Andreina </td> |
| <td align="left"> J.Andreina </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3975">YARN-3975</a> </td> |
| <td align="left"> WebAppProxyServlet should not redirect to RM page if AHS is enabled </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Mit Desai </td> |
| <td align="left"> Mit Desai </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3624">YARN-3624</a> </td> |
| <td align="left"> ApplicationHistoryServer reverses the order of the filters it gets </td> |
| <td align="left"> Major </td> |
| <td align="left"> timelineserver </td> |
| <td align="left"> Mit Desai </td> |
| <td align="left"> Mit Desai </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9106">HDFS-9106</a> </td> |
| <td align="left"> Transfer failure during pipeline recovery causes permanent write failures </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6492">MAPREDUCE-6492</a> </td> |
| <td align="left"> AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Bibin A Chundatt </td> |
| <td align="left"> Bibin A Chundatt </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4180">YARN-4180</a> </td> |
| <td align="left"> AMLauncher does not retry on failures when talking to NM </td> |
| <td align="left"> Critical </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Anubhav Dhoot </td> |
| <td align="left"> Anubhav Dhoot </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6497">MAPREDUCE-6497</a> </td> |
| <td align="left"> Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Shinichi Yamashita </td> |
| <td align="left"> Shinichi Yamashita </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12230">HADOOP-12230</a> </td> |
| <td align="left"> hadoop-project declares duplicate, conflicting curator dependencies </td> |
| <td align="left"> Minor </td> |
| <td align="left"> build </td> |
| <td align="left"> Steve Loughran </td> |
| <td align="left"> Rakesh R </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3619">YARN-3619</a> </td> |
| <td align="left"> ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException </td> |
| <td align="left"> Major </td> |
| <td align="left"> nodemanager </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4209">YARN-4209</a> </td> |
| <td align="left"> RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition </td> |
| <td align="left"> Critical </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9178">HDFS-9178</a> </td> |
| <td align="left"> Slow datanode I/O can cause a wrong node to be marked bad </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12465">HADOOP-12465</a> </td> |
| <td align="left"> Incorrect javadoc in WritableUtils.java </td> |
| <td align="left"> Minor </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Martin Petricek </td> |
| <td align="left"> Jagadesh Kiran N </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-8676">HDFS-8676</a> </td> |
| <td align="left"> Delayed rolling upgrade finalization can cause heartbeat expiration and write failures </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Walter Su </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9220">HDFS-9220</a> </td> |
| <td align="left"> Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Bogdan Raducanu </td> |
| <td align="left"> Jing Zhao </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12464">HADOOP-12464</a> </td> |
| <td align="left"> Interrupted client may try to fail-over and retry </td> |
| <td align="left"> Major </td> |
| <td align="left"> ipc </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4281">YARN-4281</a> </td> |
| <td align="left"> 2.7 RM app page is broken </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Chang Li </td> |
| <td align="left"> Chang Li </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3798">YARN-3798</a> </td> |
| <td align="left"> ZKRMStateStore shouldn’t create new session without occurrance of SESSIONEXPIED </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Bibin A Chundatt </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6518">MAPREDUCE-6518</a> </td> |
| <td align="left"> Set SO_KEEPALIVE on shuffle connections </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv2, nodemanager </td> |
| <td align="left"> Nathan Roberts </td> |
| <td align="left"> Chang Li </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9273">HDFS-9273</a> </td> |
| <td align="left"> ACLs on root directory may be lost after NN restart </td> |
| <td align="left"> Critical </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Xiao Chen </td> |
| <td align="left"> Xiao Chen </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4000">YARN-4000</a> </td> |
| <td align="left"> RM crashes with NPE if leaf queue becomes parent queue during restart </td> |
| <td align="left"> Major </td> |
| <td align="left"> capacityscheduler, resourcemanager </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4009">YARN-4009</a> </td> |
| <td align="left"> CORS support for ResourceManager REST API </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Prakash Ramachandran </td> |
| <td align="left"> Varun Vasudev </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4041">YARN-4041</a> </td> |
| <td align="left"> Slow delegation token renewal can severely prolong RM recovery </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Sunil Govindan </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9290">HDFS-9290</a> </td> |
| <td align="left"> DFSClient#callAppend() is not backward compatible for slightly older NameNodes </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Tony Wu </td> |
| <td align="left"> Tony Wu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9305">HDFS-9305</a> </td> |
| <td align="left"> Delayed heartbeat processing causes storm of subsequent heartbeats </td> |
| <td align="left"> Major </td> |
| <td align="left"> datanode </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Arpit Agarwal </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9317">HDFS-9317</a> </td> |
| <td align="left"> Document fsck -blockId and -storagepolicy options in branch-2.7 </td> |
| <td align="left"> Major </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Akira Ajisaka </td> |
| <td align="left"> Akira Ajisaka </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9083">HDFS-9083</a> </td> |
| <td align="left"> Replication violates block placement policy. </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Rushabh S Shah </td> |
| <td align="left"> Rushabh S Shah </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4313">YARN-4313</a> </td> |
| <td align="left"> Race condition in MiniMRYarnCluster when getting history server address </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Jian He </td> |
| <td align="left"> Jian He </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4312">YARN-4312</a> </td> |
| <td align="left"> TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Varun Saxena </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4320">YARN-4320</a> </td> |
| <td align="left"> TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Varun Saxena </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6528">MAPREDUCE-6528</a> </td> |
| <td align="left"> Memory leak for HistoryFileManager.getJobSummary() </td> |
| <td align="left"> Critical </td> |
| <td align="left"> jobhistoryserver </td> |
| <td align="left"> Junping Du </td> |
| <td align="left"> Junping Du </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6451">MAPREDUCE-6451</a> </td> |
| <td align="left"> DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic </td> |
| <td align="left"> Major </td> |
| <td align="left"> distcp </td> |
| <td align="left"> Kuhu Shukla </td> |
| <td align="left"> Kuhu Shukla </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4321">YARN-4321</a> </td> |
| <td align="left"> Incessant retries if NoAuthException is thrown by Zookeeper in non HA mode </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Varun Saxena </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4326">YARN-4326</a> </td> |
| <td align="left"> Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> MENG DING </td> |
| <td align="left"> MENG DING </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9289">HDFS-9289</a> </td> |
| <td align="left"> Make DataStreamer#block thread safe and verify genStamp in commitBlock </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Chang Li </td> |
| <td align="left"> Chang Li </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4127">YARN-4127</a> </td> |
| <td align="left"> RM fail with noAuth error if switched from failover mode to non-failover mode </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Jian He </td> |
| <td align="left"> Varun Saxena </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12526">HADOOP-12526</a> </td> |
| <td align="left"> [Branch-2] there are duplicate dependency definitions in pom’s </td> |
| <td align="left"> Major </td> |
| <td align="left"> build </td> |
| <td align="left"> Sangjin Lee </td> |
| <td align="left"> Sangjin Lee </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12451">HADOOP-12451</a> </td> |
| <td align="left"> [Branch-2] Setting HADOOP_HOME explicitly should be allowed </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> scripts </td> |
| <td align="left"> Karthik Kambatla </td> |
| <td align="left"> Karthik Kambatla </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4241">YARN-4241</a> </td> |
| <td align="left"> Fix typo of property name in yarn-default.xml </td> |
| <td align="left"> Major </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Anthony Rojas </td> |
| <td align="left"> Anthony Rojas </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6540">MAPREDUCE-6540</a> </td> |
| <td align="left"> TestMRTimelineEventHandling fails </td> |
| <td align="left"> Major </td> |
| <td align="left"> test </td> |
| <td align="left"> Sangjin Lee </td> |
| <td align="left"> Sangjin Lee </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4354">YARN-4354</a> </td> |
| <td align="left"> Public resource localization fails with NPE </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> nodemanager </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Jason Lowe </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9413">HDFS-9413</a> </td> |
| <td align="left"> getContentSummary() on standby should throw StandbyException </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Brahma Reddy Battula </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9431">HDFS-9431</a> </td> |
| <td align="left"> DistributedFileSystem#concat fails if the target path is relative. </td> |
| <td align="left"> Major </td> |
| <td align="left"> hdfs-client </td> |
| <td align="left"> Kazuho Fujii </td> |
| <td align="left"> Kazuho Fujii </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-2859">YARN-2859</a> </td> |
| <td align="left"> ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster </td> |
| <td align="left"> Critical </td> |
| <td align="left"> timelineserver </td> |
| <td align="left"> Hitesh Shah </td> |
| <td align="left"> Vinod Kumar Vavilapalli </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12577">HADOOP-12577</a> </td> |
| <td align="left"> Bump up commons-collections version to 3.2.2 to address a security flaw </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> build, security </td> |
| <td align="left"> Wei-Chiu Chuang </td> |
| <td align="left"> Wei-Chiu Chuang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4344">YARN-4344</a> </td> |
| <td align="left"> NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations </td> |
| <td align="left"> Critical </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Varun Vasudev </td> |
| <td align="left"> Varun Vasudev </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5883">MAPREDUCE-5883</a> </td> |
| <td align="left"> “Total megabyte-seconds” in job counters is slightly misleading </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Nathan Roberts </td> |
| <td align="left"> Nathan Roberts </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4365">YARN-4365</a> </td> |
| <td align="left"> FileSystemNodeLabelStore should check for root dir existence on startup </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Kuhu Shukla </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12415">HADOOP-12415</a> </td> |
| <td align="left"> hdfs and nfs builds broken on -missing compile-time dependency on netty </td> |
| <td align="left"> Major </td> |
| <td align="left"> nfs </td> |
| <td align="left"> Konstantin Boudnik </td> |
| <td align="left"> Tom Zeng </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6549">MAPREDUCE-6549</a> </td> |
| <td align="left"> multibyte delimiters with LineRecordReader cause duplicate records </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv1, mrv2 </td> |
| <td align="left"> Dustin Cote </td> |
| <td align="left"> Wilfred Spiegelenburg </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9426">HDFS-9426</a> </td> |
| <td align="left"> Rollingupgrade finalization is not backward compatible </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9470">HDFS-9470</a> </td> |
| <td align="left"> Encryption zone on root not loaded from fsimage after NN restart </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Xiao Chen </td> |
| <td align="left"> Xiao Chen </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9294">HDFS-9294</a> </td> |
| <td align="left"> DFSClient deadlock when close file and failed to renew lease </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> hdfs-client </td> |
| <td align="left"> DENG FEI </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4348">YARN-4348</a> </td> |
| <td align="left"> ZKRMStateStore.syncInternal shouldn’t wait for sync completion for avoiding blocking ZK’s event thread </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Tsuyoshi Ozawa </td> |
| <td align="left"> Tsuyoshi Ozawa </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4424">YARN-4424</a> </td> |
| <td align="left"> Fix deadlock in RMAppImpl </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Yesha Vora </td> |
| <td align="left"> Jian He </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4434">YARN-4434</a> </td> |
| <td align="left"> NodeManager Disk Checker parameter documentation is not correct </td> |
| <td align="left"> Minor </td> |
| <td align="left"> documentation, nodemanager </td> |
| <td align="left"> Takashi Ohnishi </td> |
| <td align="left"> Weiwei Yang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9445">HDFS-9445</a> </td> |
| <td align="left"> Datanode may deadlock while handling a bad volume </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Walter Su </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-9574">HDFS-9574</a> </td> |
| <td align="left"> Reduce client failures during datanode restart </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| </tbody> |
| </table></div> |
| <div class="section"> |
| <h3><a name="TESTS:"></a>TESTS:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3580">YARN-3580</a> </td> |
| <td align="left"> [JDK 8] TestClientRMService.testGetLabelsToNodes fails </td> |
| <td align="left"> Major </td> |
| <td align="left"> test </td> |
| <td align="left"> Robert Kanter </td> |
| <td align="left"> Robert Kanter </td></tr> |
| </tbody> |
| </table></div> |
| <div class="section"> |
| <h3><a name="SUB-TASKS:"></a>SUB-TASKS:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3136">YARN-3136</a> </td> |
| <td align="left"> getTransferredContainers can be a bottleneck during AM registration </td> |
| <td align="left"> Major </td> |
| <td align="left"> scheduler </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Sunil Govindan </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3700">YARN-3700</a> </td> |
| <td align="left"> ATS Web Performance issue at load time when large number of jobs </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager, webapp, yarn </td> |
| <td align="left"> Xuan Gong </td> |
| <td align="left"> Xuan Gong </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3740">YARN-3740</a> </td> |
| <td align="left"> Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager, webapp, yarn </td> |
| <td align="left"> Xuan Gong </td> |
| <td align="left"> Xuan Gong </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3969">YARN-3969</a> </td> |
| <td align="left"> Allow jobs to be submitted to reservation that is active but does not have any allocations </td> |
| <td align="left"> Major </td> |
| <td align="left"> capacityscheduler, fairscheduler, resourcemanager </td> |
| <td align="left"> Subru Krishnan </td> |
| <td align="left"> Subru Krishnan </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4092">YARN-4092</a> </td> |
| <td align="left"> RM HA UI redirection needs to be fixed when both RMs are in standby mode </td> |
| <td align="left"> Major </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Xuan Gong </td> |
| <td align="left"> Xuan Gong </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-2801">YARN-2801</a> </td> |
| <td align="left"> Add documentation for node labels feature </td> |
| <td align="left"> Major </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Gururaj Shetty </td> |
| <td align="left"> Wangda Tan </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3893">YARN-3893</a> </td> |
| <td align="left"> Both RM in active state when Admin#transitionToActive failure from refeshAll() </td> |
| <td align="left"> Critical </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Bibin A Chundatt </td> |
| <td align="left"> Bibin A Chundatt </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4101">YARN-4101</a> </td> |
| <td align="left"> RM should print alert messages if Zookeeper and Resourcemanager gets connection issue </td> |
| <td align="left"> Critical </td> |
| <td align="left"> yarn </td> |
| <td align="left"> Yesha Vora </td> |
| <td align="left"> Xuan Gong </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-2513">YARN-2513</a> </td> |
| <td align="left"> Host framework UIs in YARN for use with the ATS </td> |
| <td align="left"> Major </td> |
| <td align="left"> timelineserver </td> |
| <td align="left"> Jonathan Eagles </td> |
| <td align="left"> Jonathan Eagles </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-2902">YARN-2902</a> </td> |
| <td align="left"> Killing a container that is localizing can orphan resources in the DOWNLOADING state </td> |
| <td align="left"> Major </td> |
| <td align="left"> nodemanager </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Varun Saxena </td></tr> |
| </tbody> |
| </table></div></div> |
| </div> |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| <div id="footer"> |
| <div class="xright"> |
| © 2008-2021 |
| Apache Software Foundation |
| |
| - <a href="http://maven.apache.org/privacy-policy.html">Privacy Policy</a>. |
| Apache Maven, Maven, Apache, the Apache feather logo, and the Apache Maven project logos are trademarks of The Apache Software Foundation. |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| </body> |
| </html> |