| <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> |
| <!-- |
| | Generated by Apache Maven Doxia at 2021-06-15 |
| | Rendered using Apache Maven Stylus Skin 1.5 |
| --> |
| <html xmlns="http://www.w3.org/1999/xhtml"> |
| <head> |
| <title>Apache Hadoop 3.3.1 – Apache Hadoop Changelog</title> |
| <style type="text/css" media="all"> |
| @import url("../../css/maven-base.css"); |
| @import url("../../css/maven-theme.css"); |
| @import url("../../css/site.css"); |
| </style> |
| <link rel="stylesheet" href="../../css/print.css" type="text/css" media="print" /> |
| <meta name="Date-Revision-yyyymmdd" content="20210615" /> |
| <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> |
| </head> |
| <body class="composite"> |
| <div id="banner"> |
| <a href="http://hadoop.apache.org/" id="bannerLeft"> |
| <img src="http://hadoop.apache.org/images/hadoop-logo.jpg" alt="" /> |
| </a> |
| <a href="http://www.apache.org/" id="bannerRight"> |
| <img src="http://www.apache.org/images/asf_logo_wide.png" alt="" /> |
| </a> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="breadcrumbs"> |
| |
| <div class="xleft"> |
| <a href="http://www.apache.org/" class="externalLink">Apache</a> |
| > |
| <a href="http://hadoop.apache.org/" class="externalLink">Hadoop</a> |
| > |
| <a href="../../../index.html">Apache Hadoop Project Dist POM</a> |
| > |
| <a href="../../index.html">Apache Hadoop 3.3.1</a> |
| > |
| Apache Hadoop Changelog |
| </div> |
| <div class="xright"> <a href="http://wiki.apache.org/hadoop" class="externalLink">Wiki</a> |
| | |
| <a href="https://gitbox.apache.org/repos/asf/hadoop.git" class="externalLink">git</a> |
| | |
| <a href="http://hadoop.apache.org/" class="externalLink">Apache Hadoop</a> |
| |
| | Last Published: 2021-06-15 |
| | Version: 3.3.1 |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="leftColumn"> |
| <div id="navcolumn"> |
| |
| <h5>General</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/SingleCluster.html">Single Node Setup</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/ClusterSetup.html">Cluster Setup</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CommandsManual.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/FileSystemShell.html">FileSystem Shell</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Compatibility.html">Compatibility Specification</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/DownstreamDev.html">Downstream Developer's Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/AdminCompatibilityGuide.html">Admin Compatibility Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/InterfaceClassification.html">Interface Classification</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/filesystem/index.html">FileSystem Specification</a> |
| </li> |
| </ul> |
| <h5>Common</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CLIMiniCluster.html">CLI Mini Cluster</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/FairCallQueue.html">Fair Call Queue</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/NativeLibraries.html">Native Libraries</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Superusers.html">Proxy User</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/RackAwareness.html">Rack Awareness</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/SecureMode.html">Secure Mode</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/ServiceLevelAuth.html">Service Level Authorization</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/HttpAuthentication.html">HTTP Authentication</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CredentialProviderAPI.html">Credential Provider API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-kms/index.html">Hadoop KMS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Tracing.html">Tracing</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/UnixShellGuide.html">Unix Shell Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/registry/index.html">Registry</a> |
| </li> |
| </ul> |
| <h5>HDFS</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDesign.html">Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html">User Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html">NameNode HA With QJM</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html">NameNode HA With NFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ObserverNameNode.html">Observer NameNode</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/Federation.html">Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFs.html">ViewFs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFsOverloadScheme.html">ViewFsOverloadScheme</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsSnapshots.html">Snapshots</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsEditsViewer.html">Edits Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsImageViewer.html">Image Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.html">Permissions and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsQuotaAdminGuide.html">Quotas and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/LibHdfs.html">libhdfs (C API)</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/WebHDFS.html">WebHDFS (REST API)</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-hdfs-httpfs/index.html">HttpFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html">Short Circuit Local Reads</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html">Centralized Cache Management</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html">NFS Gateway</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html">Rolling Upgrade</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html">Extended Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html">Transparent Encryption</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html">Multihoming</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html">Storage Policies</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/MemoryStorage.html">Memory Storage Support</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/SLGUserGuide.html">Synthetic Load Generator</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSErasureCoding.html">Erasure Coding</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSDiskbalancer.html">Disk Balancer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUpgradeDomain.html">Upgrade Domain</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDataNodeAdminGuide.html">DataNode Admin</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html">Router Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsProvidedStorage.html">Provided Storage</a> |
| </li> |
| </ul> |
| <h5>MapReduce</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html">Tutorial</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html">Compatibility with 1.x</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/EncryptedShuffle.html">Encrypted Shuffle</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/PluggableShuffleAndPluggableSort.html">Pluggable Shuffle/Sort</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/DistributedCacheDeploy.html">Distributed Cache Deploy</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/SharedCacheSupport.html">Support for YARN Shared Cache</a> |
| </li> |
| </ul> |
| <h5>MapReduce REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html">MR Application Master</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-hs/HistoryServerRest.html">MR History Server</a> |
| </li> |
| </ul> |
| <h5>YARN</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YARN.html">Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html">Capacity Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/FairScheduler.html">Fair Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html">ResourceManager Restart</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html">ResourceManager HA</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceModel.html">Resource Model</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeLabel.html">Node Labels</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeAttributes.html">Node Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html">Web Application Proxy</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html">Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html">Timeline Service V.2</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html">Writing YARN Applications</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnApplicationSecurity.html">YARN Application Security</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManager.html">NodeManager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/DockerContainers.html">Running Applications in Docker Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/RuncContainers.html">Running Applications in runC Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html">Using CGroups</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/SecureContainer.html">Secure Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ReservationSystem.html">Reservation System</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/GracefulDecommission.html">Graceful Decommission</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html">Opportunistic Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/Federation.html">YARN Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/SharedCache.html">Shared Cache</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingGpus.html">Using GPU</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingFPGA.html">Using FPGA</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/PlacementConstraints.html">Placement Constraints</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnUI2.html">YARN UI2</a> |
| </li> |
| </ul> |
| <h5>YARN REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html">Introduction</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html">Resource Manager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerRest.html">Node Manager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html#Timeline_Server_REST_API_v1">Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html#Timeline_Service_v.2_REST_API">Timeline Service V.2</a> |
| </li> |
| </ul> |
| <h5>YARN Service</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Overview.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/QuickStart.html">QuickStart</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Concepts.html">Concepts</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/YarnServiceAPI.html">Yarn Service API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/ServiceDiscovery.html">Service Discovery</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/SystemServices.html">System Services</a> |
| </li> |
| </ul> |
| <h5>Hadoop Compatible File Systems</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-aliyun/tools/hadoop-aliyun/index.html">Aliyun OSS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-aws/tools/hadoop-aws/index.html">Amazon S3</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-azure/index.html">Azure Blob Storage</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-azure-datalake/index.html">Azure Data Lake Storage</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-openstack/index.html">OpenStack Swift</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-cos/cloud-storage/index.html">Tencent COS</a> |
| </li> |
| </ul> |
| <h5>Auth</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/Examples.html">Examples</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/Configuration.html">Configuration</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/BuildingIt.html">Building</a> |
| </li> |
| </ul> |
| <h5>Tools</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-streaming/HadoopStreaming.html">Hadoop Streaming</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-archives/HadoopArchives.html">Hadoop Archives</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-archive-logs/HadoopArchiveLogs.html">Hadoop Archive Logs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-distcp/DistCp.html">DistCp</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-gridmix/GridMix.html">GridMix</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-rumen/Rumen.html">Rumen</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-resourceestimator/ResourceEstimator.html">Resource Estimator Service</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-sls/SchedulerLoadSimulator.html">Scheduler Load Simulator</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Benchmarking.html">Hadoop Benchmarking</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-dynamometer/Dynamometer.html">Dynamometer</a> |
| </li> |
| </ul> |
| <h5>Reference</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/release/">Changelog and Release Notes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../api/index.html">Java API docs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/UnixShellAPI.html">Unix Shell API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Metrics.html">Metrics</a> |
| </li> |
| </ul> |
| <h5>Configuration</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/core-default.xml">core-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/hdfs-default.xml">hdfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/hdfs-rbf-default.xml">hdfs-rbf-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml">mapred-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-common/yarn-default.xml">yarn-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-kms/kms-default.html">kms-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-hdfs-httpfs/httpfs-default.html">httpfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/DeprecatedProperties.html">Deprecated Properties</a> |
| </li> |
| </ul> |
| <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"> |
| <img alt="Built by Maven" src="../../images/logos/maven-feather.png"/> |
| </a> |
| |
| </div> |
| </div> |
| <div id="bodyColumn"> |
| <div id="contentBox"> |
| <!--- |
| # Licensed to the Apache Software Foundation (ASF) under one |
| # or more contributor license agreements. See the NOTICE file |
| # distributed with this work for additional information |
| # regarding copyright ownership. The ASF licenses this file |
| # to you under the Apache License, Version 2.0 (the |
| # "License"); you may not use this file except in compliance |
| # with the License. You may obtain a copy of the License at |
| # |
| # http://www.apache.org/licenses/LICENSE-2.0 |
| # |
| # Unless required by applicable law or agreed to in writing, software |
| # distributed under the License is distributed on an "AS IS" BASIS, |
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| # See the License for the specific language governing permissions and |
| # limitations under the License. |
| --> |
| <h1>Apache Hadoop Changelog</h1> |
| <div class="section"> |
| <h2><a name="Release_2.7.6_-_2018-04-16"></a>Release 2.7.6 - 2018-04-16</h2> |
| <div class="section"> |
| <h3><a name="NEW_FEATURES:"></a>NEW FEATURES:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9477">HADOOP-9477</a> </td> |
| <td align="left"> Add posixGroups support for LDAP groups mapping service </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Kai Zheng </td> |
| <td align="left"> Dapeng Sun </td></tr> |
| </tbody> |
| </table></div> |
| <div class="section"> |
| <h3><a name="IMPROVEMENTS:"></a>IMPROVEMENTS:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12472">HADOOP-12472</a> </td> |
| <td align="left"> Make GenericTestUtils.assertExceptionContains robust </td> |
| <td align="left"> Minor </td> |
| <td align="left"> test </td> |
| <td align="left"> Steve Loughran </td> |
| <td align="left"> Steve Loughran </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12568">HADOOP-12568</a> </td> |
| <td align="left"> Update core-default.xml to describe posixGroups support </td> |
| <td align="left"> Minor </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Wei-Chiu Chuang </td> |
| <td align="left"> Wei-Chiu Chuang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13105">HADOOP-13105</a> </td> |
| <td align="left"> Support timeouts in LDAP queries in LdapGroupsMapping. </td> |
| <td align="left"> Major </td> |
| <td align="left"> security </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Mingliang Liu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13263">HADOOP-13263</a> </td> |
| <td align="left"> Reload cached groups in background after expiry </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Stephen O’Donnell </td> |
| <td align="left"> Stephen O’Donnell </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11003">HDFS-11003</a> </td> |
| <td align="left"> Expose “XmitsInProgress” through DataNodeMXBean </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Brahma Reddy Battula </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-14246">HADOOP-14246</a> </td> |
| <td align="left"> Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets </td> |
| <td align="left"> Major </td> |
| <td align="left"> security </td> |
| <td align="left"> Robert Kanter </td> |
| <td align="left"> Robert Kanter </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-7590">YARN-7590</a> </td> |
| <td align="left"> Improve container-executor validation check </td> |
| <td align="left"> Major </td> |
| <td align="left"> security, yarn </td> |
| <td align="left"> Eric Yang </td> |
| <td align="left"> Eric Yang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-15212">HADOOP-15212</a> </td> |
| <td align="left"> Add independent secret manager method for logging expired tokens </td> |
| <td align="left"> Major </td> |
| <td align="left"> security </td> |
| <td align="left"> Daryn Sharp </td> |
| <td align="left"> Daryn Sharp </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-7048">MAPREDUCE-7048</a> </td> |
| <td align="left"> Uber AM can crash due to unknown task in statusUpdate </td> |
| <td align="left"> Major </td> |
| <td align="left"> mr-am </td> |
| <td align="left"> Peter Bacsko </td> |
| <td align="left"> Peter Bacsko </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-11187">HDFS-11187</a> </td> |
| <td align="left"> Optimize disk access for last partial chunk checksum of Finalized replica </td> |
| <td align="left"> Major </td> |
| <td align="left"> datanode </td> |
| <td align="left"> Wei-Chiu Chuang </td> |
| <td align="left"> Gabor Bota </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-15279">HADOOP-15279</a> </td> |
| <td align="left"> increase maven heap size recommendations </td> |
| <td align="left"> Minor </td> |
| <td align="left"> build, documentation, test </td> |
| <td align="left"> Allen Wittenauer </td> |
| <td align="left"> Allen Wittenauer </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-12884">HDFS-12884</a> </td> |
| <td align="left"> BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Konstantin Shvachko </td> |
| <td align="left"> chencan </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-15345">HADOOP-15345</a> </td> |
| <td align="left"> Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> He Xiaoqiao </td> |
| <td align="left"> He Xiaoqiao </td></tr> |
| </tbody> |
| </table></div> |
| <div class="section"> |
| <h3><a name="BUG_FIXES:"></a>BUG FIXES:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-3425">YARN-3425</a> </td> |
| <td align="left"> NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed </td> |
| <td align="left"> Minor </td> |
| <td align="left"> resourcemanager </td> |
| <td align="left"> Bibin A Chundatt </td> |
| <td align="left"> Bibin A Chundatt </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12001">HADOOP-12001</a> </td> |
| <td align="left"> Limiting LDAP search conflicts with posixGroup addition </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> security </td> |
| <td align="left"> Patrick White </td> |
| <td align="left"> Patrick White </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-4167">YARN-4167</a> </td> |
| <td align="left"> NPE on RMActiveServices#serviceStop when store is null </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Bibin A Chundatt </td> |
| <td align="left"> Bibin A Chundatt </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12181">HADOOP-12181</a> </td> |
| <td align="left"> Fix intermittent test failure of TestZKSignerSecretProvider </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Masatake Iwasaki </td> |
| <td align="left"> Masatake Iwasaki </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-7959">HDFS-7959</a> </td> |
| <td align="left"> WebHdfs logging is missing on Datanode </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Kihwal Lee </td> |
| <td align="left"> Kihwal Lee </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-4210">HDFS-4210</a> </td> |
| <td align="left"> Throw helpful exception when DNS entry for JournalNode cannot be resolved </td> |
| <td align="left"> Trivial </td> |
| <td align="left"> ha, journal-node, namenode </td> |
| <td align="left"> Damien Hardy </td> |
| <td align="left"> John Zhuge </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13375">HADOOP-13375</a> </td> |
| <td align="left"> o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky </td> |
| <td align="left"> Major </td> |
| <td align="left"> security, test </td> |
| <td align="left"> Mingliang Liu </td> |
| <td align="left"> Weiwei Yang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12611">HADOOP-12611</a> </td> |
| <td align="left"> TestZKSignerSecretProvider#testMultipleInit occasionally fail </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Wei-Chiu Chuang </td> |
| <td align="left"> Eric Badger </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-13508">HADOOP-13508</a> </td> |
| <td align="left"> FsPermission string constructor does not recognize sticky bit </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Atul Sikaria </td> |
| <td align="left"> Atul Sikaria </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-12299">HDFS-12299</a> </td> |
| <td align="left"> Race Between update pipeline and DN Re-Registration </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Brahma Reddy Battula </td> |
| <td align="left"> Brahma Reddy Battula </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-12371">HDFS-12371</a> </td> |
| <td align="left"> “BlockVerificationFailures” and “BlocksVerified” show up as 0 in Datanode JMX </td> |
| <td align="left"> Major </td> |
| <td align="left"> metrics </td> |
| <td align="left"> Sai Nukavarapu </td> |
| <td align="left"> Hanisha Koneru </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5124">MAPREDUCE-5124</a> </td> |
| <td align="left"> AM lacks flow control for task events </td> |
| <td align="left"> Major </td> |
| <td align="left"> mr-am </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Peter Bacsko </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-12881">HDFS-12881</a> </td> |
| <td align="left"> Output streams closed with IOUtils suppressing write errors </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Jason Lowe </td> |
| <td align="left"> Ajay Kumar </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-7661">YARN-7661</a> </td> |
| <td align="left"> NodeManager metrics return wrong value after update node resource </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Yang Wang </td> |
| <td align="left"> Yang Wang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-12347">HDFS-12347</a> </td> |
| <td align="left"> TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently </td> |
| <td align="left"> Critical </td> |
| <td align="left"> test </td> |
| <td align="left"> Xiao Chen </td> |
| <td align="left"> Bharat Viswanadham </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-6632">YARN-6632</a> </td> |
| <td align="left"> Backport YARN-3425 to branch 2.7 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Íñigo Goiri </td> |
| <td align="left"> Íñigo Goiri </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-15143">HADOOP-15143</a> </td> |
| <td align="left"> NPE due to Invalid KerberosTicket in UGI </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Jitendra Nath Pandey </td> |
| <td align="left"> Mukul Kumar Singh </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-7028">MAPREDUCE-7028</a> </td> |
| <td align="left"> Concurrent task progress updates causing NPE in Application Master </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> mr-am </td> |
| <td align="left"> Gergo Repas </td> |
| <td align="left"> Gergo Repas </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12751">HADOOP-12751</a> </td> |
| <td align="left"> While using kerberos Hadoop incorrectly assumes names with ‘@’ to be non-simple </td> |
| <td align="left"> Critical </td> |
| <td align="left"> security </td> |
| <td align="left"> Bolke de Bruin </td> |
| <td align="left"> Bolke de Bruin </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-7020">MAPREDUCE-7020</a> </td> |
| <td align="left"> Task timeout in uber mode can crash AM </td> |
| <td align="left"> Major </td> |
| <td align="left"> mr-am </td> |
| <td align="left"> Akira Ajisaka </td> |
| <td align="left"> Peter Bacsko </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-13126">HDFS-13126</a> </td> |
| <td align="left"> Backport [HDFS-7959] to branch-2.7 to re-enable HTTP request logging for WebHDFS </td> |
| <td align="left"> Major </td> |
| <td align="left"> datanode, webhdfs </td> |
| <td align="left"> Erik Krogen </td> |
| <td align="left"> Erik Krogen </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-13120">HDFS-13120</a> </td> |
| <td align="left"> Snapshot diff could be corrupted after concat </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode, snapshots </td> |
| <td align="left"> Xiaoyu Yao </td> |
| <td align="left"> Xiaoyu Yao </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-10453">HDFS-10453</a> </td> |
| <td align="left"> ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> He Xiaoqiao </td> |
| <td align="left"> He Xiaoqiao </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-7052">MAPREDUCE-7052</a> </td> |
| <td align="left"> TestFixedLengthInputFormat#testFormatCompressedIn is flaky </td> |
| <td align="left"> Major </td> |
| <td align="left"> client, test </td> |
| <td align="left"> Peter Bacsko </td> |
| <td align="left"> Peter Bacsko </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-13112">HDFS-13112</a> </td> |
| <td align="left"> Token expiration edits may cause log corruption or deadlock </td> |
| <td align="left"> Critical </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Daryn Sharp </td> |
| <td align="left"> Daryn Sharp </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-15206">HADOOP-15206</a> </td> |
| <td align="left"> BZip2 drops and duplicates records when input split size is small </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Aki Tanaka </td> |
| <td align="left"> Aki Tanaka </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-15283">HADOOP-15283</a> </td> |
| <td align="left"> Upgrade from findbugs 3.0.1 to spotbugs 3.1.2 in branch-2 to fix docker image build </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Xiao Chen </td> |
| <td align="left"> Akira Ajisaka </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-13195">HDFS-13195</a> </td> |
| <td align="left"> DataNode conf page cannot display the current value after reconfig </td> |
| <td align="left"> Minor </td> |
| <td align="left"> datanode </td> |
| <td align="left"> maobaolong </td> |
| <td align="left"> maobaolong </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-12862">HADOOP-12862</a> </td> |
| <td align="left"> LDAP Group Mapping over SSL can not specify trust store </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Wei-Chiu Chuang </td> |
| <td align="left"> Wei-Chiu Chuang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-7249">YARN-7249</a> </td> |
| <td align="left"> Fix CapacityScheduler NPE issue when a container preempted while the node is being removed </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> . </td> |
| <td align="left"> Wangda Tan </td> |
| <td align="left"> Wangda Tan </td></tr> |
| </tbody> |
| </table></div> |
| <div class="section"> |
| <h3><a name="OTHER:"></a>OTHER:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/YARN-6633">YARN-6633</a> </td> |
| <td align="left"> Backport YARN-4167 to branch 2.7 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Íñigo Goiri </td> |
| <td align="left"> Íñigo Goiri </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-15177">HADOOP-15177</a> </td> |
| <td align="left"> Update the release year to 2018 </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> build </td> |
| <td align="left"> Akira Ajisaka </td> |
| <td align="left"> Bharat Viswanadham </td></tr> |
| </tbody> |
| </table></div></div> |
| </div> |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| <div id="footer"> |
| <div class="xright"> |
| © 2008-2021 |
| Apache Software Foundation |
| |
| - <a href="http://maven.apache.org/privacy-policy.html">Privacy Policy</a>. |
| Apache Maven, Maven, Apache, the Apache feather logo, and the Apache Maven project logos are trademarks of The Apache Software Foundation. |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| </body> |
| </html> |
