| <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> |
| <!-- |
| | Generated by Apache Maven Doxia at 2024-05-17 |
| | Rendered using Apache Maven Stylus Skin 1.5 |
| --> |
| <html xmlns="http://www.w3.org/1999/xhtml"> |
| <head> |
| <title>Apache Hadoop 3.5.0-SNAPSHOT – Apache Hadoop Changelog</title> |
| <style type="text/css" media="all"> |
| @import url("../../css/maven-base.css"); |
| @import url("../../css/maven-theme.css"); |
| @import url("../../css/site.css"); |
| </style> |
| <link rel="stylesheet" href="../../css/print.css" type="text/css" media="print" /> |
| <meta name="Date-Revision-yyyymmdd" content="20240517" /> |
| <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> |
| </head> |
| <body class="composite"> |
| <div id="banner"> |
| <a href="http://hadoop.apache.org/" id="bannerLeft"> |
| <img src="http://hadoop.apache.org/images/hadoop-logo.jpg" alt="" /> |
| </a> |
| <a href="http://www.apache.org/" id="bannerRight"> |
| <img src="http://www.apache.org/images/asf_logo_wide.png" alt="" /> |
| </a> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="breadcrumbs"> |
| |
| <div class="xright"> <a href="http://wiki.apache.org/hadoop" class="externalLink">Wiki</a> |
| | |
| <a href="https://gitbox.apache.org/repos/asf/hadoop.git" class="externalLink">git</a> |
| | |
| <a href="http://hadoop.apache.org/" class="externalLink">Apache Hadoop</a> |
| |
| | Last Published: 2024-05-17 |
| | Version: 3.5.0-SNAPSHOT |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| <div id="leftColumn"> |
| <div id="navcolumn"> |
| |
| <h5>General</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/SingleCluster.html">Single Node Setup</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/ClusterSetup.html">Cluster Setup</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CommandsManual.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/FileSystemShell.html">FileSystem Shell</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Compatibility.html">Compatibility Specification</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/DownstreamDev.html">Downstream Developer's Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/AdminCompatibilityGuide.html">Admin Compatibility Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/InterfaceClassification.html">Interface Classification</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/filesystem/index.html">FileSystem Specification</a> |
| </li> |
| </ul> |
| <h5>Common</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CLIMiniCluster.html">CLI Mini Cluster</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/FairCallQueue.html">Fair Call Queue</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/NativeLibraries.html">Native Libraries</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Superusers.html">Proxy User</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/RackAwareness.html">Rack Awareness</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/SecureMode.html">Secure Mode</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/ServiceLevelAuth.html">Service Level Authorization</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/HttpAuthentication.html">HTTP Authentication</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/CredentialProviderAPI.html">Credential Provider API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-kms/index.html">Hadoop KMS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Tracing.html">Tracing</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/UnixShellGuide.html">Unix Shell Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/registry/index.html">Registry</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/AsyncProfilerServlet.html">Async Profiler</a> |
| </li> |
| </ul> |
| <h5>HDFS</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDesign.html">Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html">User Guide</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html">NameNode HA With QJM</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithNFS.html">NameNode HA With NFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ObserverNameNode.html">Observer NameNode</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/Federation.html">Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFs.html">ViewFs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ViewFsOverloadScheme.html">ViewFsOverloadScheme</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsSnapshots.html">Snapshots</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsEditsViewer.html">Edits Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsImageViewer.html">Image Viewer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.html">Permissions and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsQuotaAdminGuide.html">Quotas and HDFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/LibHdfs.html">libhdfs (C API)</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/WebHDFS.html">WebHDFS (REST API)</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-hdfs-httpfs/index.html">HttpFS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ShortCircuitLocalReads.html">Short Circuit Local Reads</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/CentralizedCacheManagement.html">Centralized Cache Management</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html">NFS Gateway</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsRollingUpgrade.html">Rolling Upgrade</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ExtendedAttributes.html">Extended Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/TransparentEncryption.html">Transparent Encryption</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsMultihoming.html">Multihoming</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/ArchivalStorage.html">Storage Policies</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/MemoryStorage.html">Memory Storage Support</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/SLGUserGuide.html">Synthetic Load Generator</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSErasureCoding.html">Erasure Coding</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HDFSDiskbalancer.html">Disk Balancer</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsUpgradeDomain.html">Upgrade Domain</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsDataNodeAdminGuide.html">DataNode Admin</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/HDFSRouterFederation.html">Router Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/HdfsProvidedStorage.html">Provided Storage</a> |
| </li> |
| </ul> |
| <h5>MapReduce</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduceTutorial.html">Tutorial</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapReduce_Compatibility_Hadoop1_Hadoop2.html">Compatibility with 1.x</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/EncryptedShuffle.html">Encrypted Shuffle</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/PluggableShuffleAndPluggableSort.html">Pluggable Shuffle/Sort</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/DistributedCacheDeploy.html">Distributed Cache Deploy</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/SharedCacheSupport.html">Support for YARN Shared Cache</a> |
| </li> |
| </ul> |
| <h5>MapReduce REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/MapredAppMasterRest.html">MR Application Master</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-hs/HistoryServerRest.html">MR History Server</a> |
| </li> |
| </ul> |
| <h5>YARN</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YARN.html">Architecture</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnCommands.html">Commands Reference</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html">Capacity Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/FairScheduler.html">Fair Scheduler</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html">ResourceManager Restart</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html">ResourceManager HA</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceModel.html">Resource Model</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeLabel.html">Node Labels</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeAttributes.html">Node Attributes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html">Web Application Proxy</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html">Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html">Timeline Service V.2</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WritingYarnApplications.html">Writing YARN Applications</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnApplicationSecurity.html">YARN Application Security</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManager.html">NodeManager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/DockerContainers.html">Running Applications in Docker Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/RuncContainers.html">Running Applications in runC Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html">Using CGroups</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/SecureContainer.html">Secure Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ReservationSystem.html">Reservation System</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/GracefulDecommission.html">Graceful Decommission</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/OpportunisticContainers.html">Opportunistic Containers</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/Federation.html">YARN Federation</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/SharedCache.html">Shared Cache</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingGpus.html">Using GPU</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/UsingFPGA.html">Using FPGA</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/PlacementConstraints.html">Placement Constraints</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/YarnUI2.html">YARN UI2</a> |
| </li> |
| </ul> |
| <h5>YARN REST APIs</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html">Introduction</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html">Resource Manager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/NodeManagerRest.html">Node Manager</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServer.html#Timeline_Server_REST_API_v1">Timeline Server</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/TimelineServiceV2.html#Timeline_Service_v.2_REST_API">Timeline Service V.2</a> |
| </li> |
| </ul> |
| <h5>YARN Service</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Overview.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/QuickStart.html">QuickStart</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/Concepts.html">Concepts</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/YarnServiceAPI.html">Yarn Service API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/ServiceDiscovery.html">Service Discovery</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-site/yarn-service/SystemServices.html">System Services</a> |
| </li> |
| </ul> |
| <h5>Hadoop Compatible File Systems</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-aliyun/tools/hadoop-aliyun/index.html">Aliyun OSS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-aws/tools/hadoop-aws/index.html">Amazon S3</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-azure/index.html">Azure Blob Storage</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-azure-datalake/index.html">Azure Data Lake Storage</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-cos/cloud-storage/index.html">Tencent COS</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-huaweicloud/cloud-storage/index.html">Huaweicloud OBS</a> |
| </li> |
| </ul> |
| <h5>Auth</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/index.html">Overview</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/Examples.html">Examples</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/Configuration.html">Configuration</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-auth/BuildingIt.html">Building</a> |
| </li> |
| </ul> |
| <h5>Tools</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-streaming/HadoopStreaming.html">Hadoop Streaming</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-archives/HadoopArchives.html">Hadoop Archives</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-archive-logs/HadoopArchiveLogs.html">Hadoop Archive Logs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-distcp/DistCp.html">DistCp</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-federation-balance/HDFSFederationBalance.html">HDFS Federation Balance</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-gridmix/GridMix.html">GridMix</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-rumen/Rumen.html">Rumen</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-resourceestimator/ResourceEstimator.html">Resource Estimator Service</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-sls/SchedulerLoadSimulator.html">Scheduler Load Simulator</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Benchmarking.html">Hadoop Benchmarking</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-dynamometer/Dynamometer.html">Dynamometer</a> |
| </li> |
| </ul> |
| <h5>Reference</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/release/">Changelog and Release Notes</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../api/index.html">Java API docs</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/UnixShellAPI.html">Unix Shell API</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/Metrics.html">Metrics</a> |
| </li> |
| </ul> |
| <h5>Configuration</h5> |
| <ul> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/core-default.xml">core-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs/hdfs-default.xml">hdfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-hdfs-rbf/hdfs-rbf-default.xml">hdfs-rbf-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml">mapred-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-yarn/hadoop-yarn-common/yarn-default.xml">yarn-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-kms/kms-default.html">kms-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-hdfs-httpfs/httpfs-default.html">httpfs-default.xml</a> |
| </li> |
| <li class="none"> |
| <a href="../../../../hadoop-project-dist/hadoop-common/DeprecatedProperties.html">Deprecated Properties</a> |
| </li> |
| </ul> |
| <a href="http://maven.apache.org/" title="Built by Maven" class="poweredBy"> |
| <img alt="Built by Maven" src="../../images/logos/maven-feather.png"/> |
| </a> |
| |
| </div> |
| </div> |
| <div id="bodyColumn"> |
| <div id="contentBox"> |
| <!--- |
| # Licensed to the Apache Software Foundation (ASF) under one |
| # or more contributor license agreements. See the NOTICE file |
| # distributed with this work for additional information |
| # regarding copyright ownership. The ASF licenses this file |
| # to you under the Apache License, Version 2.0 (the |
| # "License"); you may not use this file except in compliance |
| # with the License. You may obtain a copy of the License at |
| # |
| # http://www.apache.org/licenses/LICENSE-2.0 |
| # |
| # Unless required by applicable law or agreed to in writing, software |
| # distributed under the License is distributed on an "AS IS" BASIS, |
| # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| # See the License for the specific language governing permissions and |
| # limitations under the License. |
| --> |
| <h1>Apache Hadoop Changelog</h1><section> |
| <h2><a name="Release_1.3.0_-_Unreleased_.28as_of_2018-09-02.29"></a>Release 1.3.0 - Unreleased (as of 2018-09-02)</h2><section> |
| <h3><a name="INCOMPATIBLE_CHANGES:"></a>INCOMPATIBLE CHANGES:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5777">MAPREDUCE-5777</a> </td> |
| <td align="left"> Support utf-8 text with BOM (byte order marker) </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> bc Wong </td> |
| <td align="left"> zhihai xu </td></tr> |
| </tbody> |
| </table></section><section> |
| <h3><a name="IMPROVEMENTS:"></a>IMPROVEMENTS:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-2351">MAPREDUCE-2351</a> </td> |
| <td align="left"> mapred.job.tracker.history.completed.location should support an arbitrary filesystem URI </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Tom White </td> |
| <td align="left"> Tom White </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9450">HADOOP-9450</a> </td> |
| <td align="left"> HADOOP_USER_CLASSPATH_FIRST is not honored; CLASSPATH is PREpended instead of APpended </td> |
| <td align="left"> Major </td> |
| <td align="left"> scripts </td> |
| <td align="left"> Mitch Wyle </td> |
| <td align="left"> Harsh J </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-4521">HDFS-4521</a> </td> |
| <td align="left"> invalid network topologies should not be cached </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Colin P. McCabe </td> |
| <td align="left"> Colin P. McCabe </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-8873">HADOOP-8873</a> </td> |
| <td align="left"> Port HADOOP-8175 (Add mkdir -p flag) to branch-1 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Eli Collins </td> |
| <td align="left"> Akira Ajisaka </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-4903">HDFS-4903</a> </td> |
| <td align="left"> Print trash configuration and trash emptier state in namenode log </td> |
| <td align="left"> Minor </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Suresh Srinivas </td> |
| <td align="left"> Arpit Agarwal </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5406">MAPREDUCE-5406</a> </td> |
| <td align="left"> Improve logging around Task Tracker exiting with JVM manager inconsistent state </td> |
| <td align="left"> Major </td> |
| <td align="left"> tasktracker </td> |
| <td align="left"> Chelsey Chang </td> |
| <td align="left"> Chelsey Chang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5408">MAPREDUCE-5408</a> </td> |
| <td align="left"> CLONE - The logging level of the tasks should be configurable by the job </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Owen O’Malley </td> |
| <td align="left"> Arun C Murthy </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5367">MAPREDUCE-5367</a> </td> |
| <td align="left"> Local jobs all use same local working directory </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Sandy Ryza </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-4963">HDFS-4963</a> </td> |
| <td align="left"> Improve multihoming support in namenode </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Arpit Agarwal </td> |
| <td align="left"> Arpit Agarwal </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9855">HADOOP-9855</a> </td> |
| <td align="left"> Backport HADOOP-6578 to branch-1 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> James Kinley </td> |
| <td align="left"> James Kinley </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-5038">HDFS-5038</a> </td> |
| <td align="left"> Backport several branch-2 APIs to branch-1 </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Jing Zhao </td> |
| <td align="left"> Jing Zhao </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-5367">HDFS-5367</a> </td> |
| <td align="left"> Restoring namenode storage locks namenode due to unnecessary fsimage write </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> yunjiong zhao </td> |
| <td align="left"> yunjiong zhao </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5457">MAPREDUCE-5457</a> </td> |
| <td align="left"> Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Sandy Ryza </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5609">MAPREDUCE-5609</a> </td> |
| <td align="left"> Add debug log message when sending job end notification </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Robert Kanter </td> |
| <td align="left"> Robert Kanter </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-3310">MAPREDUCE-3310</a> </td> |
| <td align="left"> Custom grouping comparator cannot be set for Combiners </td> |
| <td align="left"> Major </td> |
| <td align="left"> client </td> |
| <td align="left"> Mathias Herberts </td> |
| <td align="left"> Alejandro Abdelnur </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5651">MAPREDUCE-5651</a> </td> |
| <td align="left"> Backport Fair Scheduler queue placement policies to branch-1 </td> |
| <td align="left"> Major </td> |
| <td align="left"> scheduler </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Ted Malaska </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5712">MAPREDUCE-5712</a> </td> |
| <td align="left"> Backport Fair Scheduler pool placement by secondary group </td> |
| <td align="left"> Major </td> |
| <td align="left"> scheduler </td> |
| <td align="left"> Theodore michael Malaska </td> |
| <td align="left"> Theodore michael Malaska </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-10614">HADOOP-10614</a> </td> |
| <td align="left"> CBZip2InputStream is not threadsafe </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Xiangrui Meng </td> |
| <td align="left"> Xiangrui Meng </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6088">MAPREDUCE-6088</a> </td> |
| <td align="left"> TestTokenCache tests should use their own JobConf instances </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv1, test </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-7312">HDFS-7312</a> </td> |
| <td align="left"> Update DistCp v1 to optionally not use tmp location (branch-1 only) </td> |
| <td align="left"> Minor </td> |
| <td align="left"> tools </td> |
| <td align="left"> Joseph Prosser </td> |
| <td align="left"> Joseph Prosser </td></tr> |
| </tbody> |
| </table></section><section> |
| <h3><a name="BUG_FIXES:"></a>BUG FIXES:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-7140">HADOOP-7140</a> </td> |
| <td align="left"> IPC Reader threads do not stop when server stops </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Todd Lipcon </td> |
| <td align="left"> Todd Lipcon </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-2264">HDFS-2264</a> </td> |
| <td align="left"> NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Aaron T. Myers </td> |
| <td align="left"> Aaron T. Myers </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5046">MAPREDUCE-5046</a> </td> |
| <td align="left"> backport MAPREDUCE-1423 to mapred.lib.CombineFileInputFormat </td> |
| <td align="left"> Major </td> |
| <td align="left"> client </td> |
| <td align="left"> Sangjin Lee </td> |
| <td align="left"> </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5047">MAPREDUCE-5047</a> </td> |
| <td align="left"> keep.failed.task.files=true causes job failure on secure clusters </td> |
| <td align="left"> Major </td> |
| <td align="left"> task, tasktracker </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Sandy Ryza </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5070">MAPREDUCE-5070</a> </td> |
| <td align="left"> TestClusterStatus.testClusterMetrics fails on JDK7 </td> |
| <td align="left"> Major </td> |
| <td align="left"> test </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Sandy Ryza </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5072">MAPREDUCE-5072</a> </td> |
| <td align="left"> TestDelegationTokenRenewal.testDTRenewal fails in MR1 on jdk7 </td> |
| <td align="left"> Major </td> |
| <td align="left"> test </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Sandy Ryza </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5073">MAPREDUCE-5073</a> </td> |
| <td align="left"> TestJobStatusPersistency.testPersistency fails on JDK7 </td> |
| <td align="left"> Major </td> |
| <td align="left"> test </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Sandy Ryza </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-4622">HDFS-4622</a> </td> |
| <td align="left"> Remove redundant synchronized from FSNamesystem#rollEditLog in branch-1 </td> |
| <td align="left"> Trivial </td> |
| <td align="left"> . </td> |
| <td align="left"> Jing Zhao </td> |
| <td align="left"> Jing Zhao </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-2817">MAPREDUCE-2817</a> </td> |
| <td align="left"> MiniRMCluster hardcodes ‘mapred.local.dir’ configuration to ‘build/test/mapred/local’ </td> |
| <td align="left"> Minor </td> |
| <td align="left"> test </td> |
| <td align="left"> Alejandro Abdelnur </td> |
| <td align="left"> Robert Kanter </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5133">MAPREDUCE-5133</a> </td> |
| <td align="left"> TestSubmitJob.testSecureJobExecution is flaky due to job dir deletion race </td> |
| <td align="left"> Major </td> |
| <td align="left"> test </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Sandy Ryza </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5218">MAPREDUCE-5218</a> </td> |
| <td align="left"> Annotate (comment) internal classes as Private </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Karthik Kambatla </td> |
| <td align="left"> Karthik Kambatla </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5217">MAPREDUCE-5217</a> </td> |
| <td align="left"> DistCp fails when launched by Oozie in a secure cluster </td> |
| <td align="left"> Major </td> |
| <td align="left"> distcp, security </td> |
| <td align="left"> Venkat Ranganathan </td> |
| <td align="left"> Venkat Ranganathan </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5095">MAPREDUCE-5095</a> </td> |
| <td align="left"> TestShuffleExceptionCount#testCheckException fails occasionally with JDK7 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Arpit Agarwal </td> |
| <td align="left"> Arpit Agarwal </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5250">MAPREDUCE-5250</a> </td> |
| <td align="left"> Searching for ‘;’ in JobTracker History throws ArrayOutOfBoundException </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Karthik Kambatla </td> |
| <td align="left"> Karthik Kambatla </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-4944">HDFS-4944</a> </td> |
| <td align="left"> WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. </td> |
| <td align="left"> Major </td> |
| <td align="left"> webhdfs </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9678">HADOOP-9678</a> </td> |
| <td align="left"> TestRPC#testStopsAllThreads intermittently fails on Windows </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Ivan Mitic </td> |
| <td align="left"> Ivan Mitic </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9307">HADOOP-9307</a> </td> |
| <td align="left"> BufferedFSInputStream.read returns wrong results after certain seeks </td> |
| <td align="left"> Major </td> |
| <td align="left"> fs </td> |
| <td align="left"> Todd Lipcon </td> |
| <td align="left"> Todd Lipcon </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-5003">HDFS-5003</a> </td> |
| <td align="left"> TestNNThroughputBenchmark failed caused by existing directories </td> |
| <td align="left"> Minor </td> |
| <td align="left"> test </td> |
| <td align="left"> Xi Fang </td> |
| <td align="left"> Xi Fang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5405">MAPREDUCE-5405</a> </td> |
| <td align="left"> Job recovery can fail if task log directory symlink from prior run still exists </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv1 </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5288">MAPREDUCE-5288</a> </td> |
| <td align="left"> ResourceEstimator#getEstimatedTotalMapOutputSize suffers from divide by zero issues </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv1 </td> |
| <td align="left"> Harsh J </td> |
| <td align="left"> Karthik Kambatla </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9507">HADOOP-9507</a> </td> |
| <td align="left"> LocalFileSystem rename() is broken in some cases when destination exists </td> |
| <td align="left"> Minor </td> |
| <td align="left"> fs </td> |
| <td align="left"> Mostafa Elhemali </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-4366">MAPREDUCE-4366</a> </td> |
| <td align="left"> mapred metrics shows negative count of waiting maps and reduces </td> |
| <td align="left"> Major </td> |
| <td align="left"> jobtracker </td> |
| <td align="left"> Thomas Graves </td> |
| <td align="left"> Sandy Ryza </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9768">HADOOP-9768</a> </td> |
| <td align="left"> chown and chgrp reject users and groups with spaces on platforms where spaces are otherwise acceptable </td> |
| <td align="left"> Major </td> |
| <td align="left"> fs </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9801">HADOOP-9801</a> </td> |
| <td align="left"> Configuration#writeXml uses platform defaulting encoding, which may mishandle multi-byte characters. </td> |
| <td align="left"> Major </td> |
| <td align="left"> conf </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-4898">HDFS-4898</a> </td> |
| <td align="left"> BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack </td> |
| <td align="left"> Minor </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Eric Sirianni </td> |
| <td align="left"> Tsz Wo Nicholas Sze </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-5211">HDFS-5211</a> </td> |
| <td align="left"> Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache. </td> |
| <td align="left"> Major </td> |
| <td align="left"> hdfs-client </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5508">MAPREDUCE-5508</a> </td> |
| <td align="left"> JobTracker memory leak caused by unreleased FileSystem objects in JobInProgress#cleanupJob </td> |
| <td align="left"> Critical </td> |
| <td align="left"> jobtracker </td> |
| <td align="left"> Xi Fang </td> |
| <td align="left"> Xi Fang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-5245">HDFS-5245</a> </td> |
| <td align="left"> shouldRetry() in WebHDFSFileSystem generates excessive warnings </td> |
| <td align="left"> Minor </td> |
| <td align="left"> webhdfs </td> |
| <td align="left"> Haohui Mai </td> |
| <td align="left"> Haohui Mai </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-10009">HADOOP-10009</a> </td> |
| <td align="left"> Backport HADOOP-7808 to branch-1 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Haohui Mai </td> |
| <td align="left"> Haohui Mai </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5569">MAPREDUCE-5569</a> </td> |
| <td align="left"> FloatSplitter is not generating correct splits </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Nathan Roberts </td> |
| <td align="left"> Nathan Roberts </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5512">MAPREDUCE-5512</a> </td> |
| <td align="left"> TaskTracker hung after failed reconnect to the JobTracker </td> |
| <td align="left"> Major </td> |
| <td align="left"> tasktracker </td> |
| <td align="left"> Ivan Mitic </td> |
| <td align="left"> Ivan Mitic </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-4794">HDFS-4794</a> </td> |
| <td align="left"> Browsing filesystem via webui throws kerberos exception when NN service RPC is enabled in a secure cluster </td> |
| <td align="left"> Major </td> |
| <td align="left"> security </td> |
| <td align="left"> Benoy Antony </td> |
| <td align="left"> Benoy Antony </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-10142">HADOOP-10142</a> </td> |
| <td align="left"> Avoid groups lookup for unprivileged users such as “dr.who” </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Vinayakumar B </td> |
| <td align="left"> Vinayakumar B </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-10090">HADOOP-10090</a> </td> |
| <td align="left"> Jobtracker metrics not updated properly after execution of a mapreduce job </td> |
| <td align="left"> Major </td> |
| <td align="left"> metrics </td> |
| <td align="left"> Ivan Mitic </td> |
| <td align="left"> Ivan Mitic </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5702">MAPREDUCE-5702</a> </td> |
| <td align="left"> TaskLogServlet#printTaskLog has spurious HTML closing tags </td> |
| <td align="left"> Trivial </td> |
| <td align="left"> task </td> |
| <td align="left"> Karthik Kambatla </td> |
| <td align="left"> Robert Kanter </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5698">MAPREDUCE-5698</a> </td> |
| <td align="left"> Backport MAPREDUCE-1285 to branch-1 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Yongjun Zhang </td> |
| <td align="left"> Yongjun Zhang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-5685">HDFS-5685</a> </td> |
| <td align="left"> DistCp will fail to copy with -delete switch </td> |
| <td align="left"> Major </td> |
| <td align="left"> hdfs-client </td> |
| <td align="left"> Yongjun Zhang </td> |
| <td align="left"> Yongjun Zhang </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5710">MAPREDUCE-5710</a> </td> |
| <td align="left"> Backport MAPREDUCE-1305 to branch-1 </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Yongjun Zhang </td> |
| <td align="left"> Yongjun Zhang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-5944">HDFS-5944</a> </td> |
| <td align="left"> LeaseManager:findLeaseWithPrefixPath can’t handle path like /a/b/ right and cause SecondaryNameNode failed do checkpoint </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> yunjiong zhao </td> |
| <td align="left"> yunjiong zhao </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-5516">HDFS-5516</a> </td> |
| <td align="left"> WebHDFS does not require user name when anonymous http requests are disallowed. </td> |
| <td align="left"> Major </td> |
| <td align="left"> webhdfs </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Miodrag Radulovic </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5808">MAPREDUCE-5808</a> </td> |
| <td align="left"> Port output replication factor configurable for terasort to Hadoop 1.x </td> |
| <td align="left"> Minor </td> |
| <td align="left"> examples </td> |
| <td align="left"> Chuan Liu </td> |
| <td align="left"> Chuan Liu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5822">MAPREDUCE-5822</a> </td> |
| <td align="left"> FairScheduler does not preempt due to fairshare-starvation when fairshare is 1 </td> |
| <td align="left"> Major </td> |
| <td align="left"> scheduler </td> |
| <td align="left"> Anubhav Dhoot </td> |
| <td align="left"> Anubhav Dhoot </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-6141">HDFS-6141</a> </td> |
| <td align="left"> WebHdfsFileSystem#toUrl does not perform character escaping. </td> |
| <td align="left"> Major </td> |
| <td align="left"> webhdfs </td> |
| <td align="left"> Chris Nauroth </td> |
| <td align="left"> Chris Nauroth </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-10562">HADOOP-10562</a> </td> |
| <td align="left"> Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager </td> |
| <td align="left"> Critical </td> |
| <td align="left"> . </td> |
| <td align="left"> Suresh Srinivas </td> |
| <td align="left"> Suresh Srinivas </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5877">MAPREDUCE-5877</a> </td> |
| <td align="left"> Inconsistency between JT/TT for tasks taking a long time to launch </td> |
| <td align="left"> Critical </td> |
| <td align="left"> jobtracker, tasktracker </td> |
| <td align="left"> Karthik Kambatla </td> |
| <td align="left"> Karthik Kambatla </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5979">MAPREDUCE-5979</a> </td> |
| <td align="left"> FairScheduler: zero weight can cause sort failures </td> |
| <td align="left"> Major </td> |
| <td align="left"> scheduler </td> |
| <td align="left"> Anubhav Dhoot </td> |
| <td align="left"> Anubhav Dhoot </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5966">MAPREDUCE-5966</a> </td> |
| <td align="left"> MR1 FairScheduler use of custom weight adjuster is not thread safe for comparisons </td> |
| <td align="left"> Major </td> |
| <td align="left"> scheduler </td> |
| <td align="left"> Anubhav Dhoot </td> |
| <td align="left"> Anubhav Dhoot </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5968">MAPREDUCE-5968</a> </td> |
| <td align="left"> Work directory is not deleted when downloadCacheObject throws IOException </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv1 </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-6822">HDFS-6822</a> </td> |
| <td align="left"> In branch-1, Namenode and datanode fails to replace “_HOST” to hostname for hadoop.http.authentication.kerberos.principal </td> |
| <td align="left"> Major </td> |
| <td align="left"> security </td> |
| <td align="left"> Jing Zhao </td> |
| <td align="left"> Jing Zhao </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6012">MAPREDUCE-6012</a> </td> |
| <td align="left"> DBInputSplit creates invalid ranges on Oracle </td> |
| <td align="left"> Major </td> |
| <td align="left"> . </td> |
| <td align="left"> Julien Serdaru </td> |
| <td align="left"> Wei Yan </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-11035">HADOOP-11035</a> </td> |
| <td align="left"> distcp on mr1(branch-1) fails with NPE using a short relative source path. </td> |
| <td align="left"> Major </td> |
| <td align="left"> tools </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6009">MAPREDUCE-6009</a> </td> |
| <td align="left"> Map-only job with new-api runs wrong OutputCommitter when cleanup scheduled in a reduce slot </td> |
| <td align="left"> Blocker </td> |
| <td align="left"> client, job submission </td> |
| <td align="left"> Gera Shegalov </td> |
| <td align="left"> Gera Shegalov </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6147">MAPREDUCE-6147</a> </td> |
| <td align="left"> Support mapreduce.input.fileinputformat.split.maxsize </td> |
| <td align="left"> Minor </td> |
| <td align="left"> mrv1 </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6170">MAPREDUCE-6170</a> </td> |
| <td align="left"> TestUlimit failure on JDK8 </td> |
| <td align="left"> Major </td> |
| <td align="left"> contrib/streaming </td> |
| <td align="left"> bc Wong </td> |
| <td align="left"> bc Wong </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-7503">HDFS-7503</a> </td> |
| <td align="left"> Namenode restart after large deletions can cause slow processReport (due to logging) </td> |
| <td align="left"> Major </td> |
| <td align="left"> namenode </td> |
| <td align="left"> Arpit Agarwal </td> |
| <td align="left"> Arpit Agarwal </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6196">MAPREDUCE-6196</a> </td> |
| <td align="left"> Fix BigDecimal ArithmeticException in PiEstimator </td> |
| <td align="left"> Minor </td> |
| <td align="left"> . </td> |
| <td align="left"> Ray Chiang </td> |
| <td align="left"> Ray Chiang </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6198">MAPREDUCE-6198</a> </td> |
| <td align="left"> NPE from JobTracker#resolveAndAddToTopology in MR1 cause initJob and heartbeat failure. </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv1 </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5272">MAPREDUCE-5272</a> </td> |
| <td align="left"> A Minor Error in Javadoc of TestMRWithDistributedCache in Branch-1 </td> |
| <td align="left"> Trivial </td> |
| <td align="left"> test </td> |
| <td align="left"> Zhijie Shen </td> |
| <td align="left"> Zhijie Shen </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5556">MAPREDUCE-5556</a> </td> |
| <td align="left"> mapred docs have incorrect classpath </td> |
| <td align="left"> Trivial </td> |
| <td align="left"> . </td> |
| <td align="left"> Allen Wittenauer </td> |
| <td align="left"> Harsh J </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5660">MAPREDUCE-5660</a> </td> |
| <td align="left"> Log info about possible thrashing (when using memory-based scheduling in Capacity Scheduler) is not printed </td> |
| <td align="left"> Trivial </td> |
| <td align="left"> capacity-sched, mrv1, tasktracker </td> |
| <td align="left"> Adam Kawa </td> |
| <td align="left"> Adam Kawa </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-5183">MAPREDUCE-5183</a> </td> |
| <td align="left"> In, TaskTracker#reportProgress logging of 0.0-1.0 progress is followed by percent sign </td> |
| <td align="left"> Minor </td> |
| <td align="left"> mrv1, tasktracker </td> |
| <td align="left"> Sandy Ryza </td> |
| <td align="left"> Niranjan Singh </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HDFS-6649">HDFS-6649</a> </td> |
| <td align="left"> Documentation for setrep is wrong </td> |
| <td align="left"> Trivial </td> |
| <td align="left"> documentation </td> |
| <td align="left"> Alexander Fahlke </td> |
| <td align="left"> Akira Ajisaka </td></tr> |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-6076">MAPREDUCE-6076</a> </td> |
| <td align="left"> Zero map split input length combine with none zero map split input length may cause MR1 job hung sometimes. </td> |
| <td align="left"> Major </td> |
| <td align="left"> mrv1 </td> |
| <td align="left"> zhihai xu </td> |
| <td align="left"> zhihai xu </td></tr> |
| </tbody> |
| </table></section><section> |
| <h3><a name="TESTS:"></a>TESTS:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9624">HADOOP-9624</a> </td> |
| <td align="left"> TestFSMainOperationsLocalFileSystem failed when the Hadoop test root path has “X” in its name </td> |
| <td align="left"> Minor </td> |
| <td align="left"> test </td> |
| <td align="left"> Xi Fang </td> |
| <td align="left"> Xi Fang </td></tr> |
| </tbody> |
| </table></section><section> |
| <h3><a name="SUB-TASKS:"></a>SUB-TASKS:</h3> |
| <table border="0" class="bodyTable"> |
| <thead> |
| |
| <tr class="a"> |
| <th align="left"> JIRA </th> |
| <th align="left"> Summary </th> |
| <th align="left"> Priority </th> |
| <th align="left"> Component </th> |
| <th align="left"> Reporter </th> |
| <th align="left"> Contributor </th></tr> |
| </thead><tbody> |
| |
| <tr class="b"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/MAPREDUCE-4049">MAPREDUCE-4049</a> </td> |
| <td align="left"> plugin for generic shuffle service </td> |
| <td align="left"> Major </td> |
| <td align="left"> performance, task, tasktracker </td> |
| <td align="left"> Avner BenHanoch </td> |
| <td align="left"> Avner BenHanoch </td></tr> |
| <tr class="a"> |
| <td align="left"> <a class="externalLink" href="https://issues.apache.org/jira/browse/HADOOP-9573">HADOOP-9573</a> </td> |
| <td align="left"> Fix test-patch script to work with the enhanced PreCommit-Admin script. </td> |
| <td align="left"> Major </td> |
| <td align="left"> build </td> |
| <td align="left"> Giridharan Kesavan </td> |
| <td align="left"> Giridharan Kesavan </td></tr> |
| </tbody> |
| </table></section></section> |
| </div> |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| <div id="footer"> |
| <div class="xright"> |
| © 2008-2024 |
| Apache Software Foundation |
| |
| - <a href="http://maven.apache.org/privacy-policy.html">Privacy Policy</a>. |
| Apache Maven, Maven, Apache, the Apache feather logo, and the Apache Maven project logos are trademarks of The Apache Software Foundation. |
| </div> |
| <div class="clear"> |
| <hr/> |
| </div> |
| </div> |
| </body> |
| </html> |
