“Apache Hadoop” Changelog

Release 2.8.0 - 2017-03-17

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
YARN-3241FairScheduler handles “invalid” queue names inconsistentlyMajorfairschedulerzhihai xuzhihai xu
HADOOP-11731Rework the changelog and releasenotesMajordocumentationAllen WittenauerAllen Wittenauer
HADOOP-11746rewrite test-patch.shMajorbuild, testAllen WittenauerAllen Wittenauer
HDFS-8226Non-HA rollback compatibility brokenBlocker.J.AndreinaJ.Andreina
HADOOP-11772RPC Invoker relies on static ClientCache which has synchronized(this) blocksMajoripc, performanceGopal VHaohui Mai
YARN-2336Fair scheduler REST api returns a missing ‘[’ bracket JSON for deep queue treeMajorfairschedulerKenji KikushimaAkira Ajisaka
YARN-41The RM should handle the graceful shutdown of the NM.Majornodemanager, resourcemanagerRavi Teja Ch N VDevaraj K
HDFS-6564Use slf4j instead of common-logging in hdfs-clientMajorbuildHaohui MaiRakesh R
MAPREDUCE-6427Fix typo in JobHistoryEventHandlerMinor.Brahma Reddy BattulaRay Chiang
HADOOP-12269Update aws-sdk dependency to 1.10.6; move to aws-sdk-s3Majorfs/s3Thomas DemoorThomas Demoor
HDFS-8900Compact XAttrs to optimize memory footprint.MajornamenodeYi LiuYi Liu
YARN-4087Followup fixes after YARN-2019 regarding RM behavior when state-store error occursMajor.Jian HeJian He
HADOOP-12416Trash messages should be handled by Logger instead of being delivered on System.outMajortrashAshutosh ChauhanMingliang Liu
HDFS-9063Correctly handle snapshot path for getContentSummaryMajornamenodeJing ZhaoJing Zhao
HDFS-9433DFS getEZForPath API on a non-existent file should throw FileNotFoundExceptionMajorencryptionRakesh RRakesh R
HADOOP-11252RPC client does not time out by defaultCriticalipcWilfred SpiegelenburgMasatake Iwasaki
HDFS-9047Retire libwebhdfsMajorwebhdfsAllen WittenauerHaohui Mai
HADOOP-12651Replace dev-support with wrappers to YetusMajorscriptsAllen WittenauerAllen Wittenauer
HADOOP-12552Fix undeclared/unused dependency to httpclientMinorbuildMasatake IwasakiMasatake Iwasaki
HADOOP-11792Remove all of the CHANGES.txt filesMajorbuildAllen WittenauerAndrew Wang
YARN-5035FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned onMajorfairschedulerKarthik KambatlaKarthik Kambatla
HADOOP-12892fix/rewrite create-releaseBlockerbuildAllen WittenauerAllen Wittenauer
HADOOP-13139Branch-2: S3a to use thread pool that blocks clientsMajorfs/s3Pieter ReusePieter Reuse
HADOOP-13382remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projectsMajorbuildMatt FoleyMatt Foley
HDFS-7933fsck should also report decommissioning replicas.MajornamenodeJitendra Nath PandeyXiaoyu Yao
HADOOP-13560S3ABlockOutputStream to support huge (many GB) file writesMajorfs/s3Steve LoughranSteve Loughran
HDFS-11048Audit Log should escape control charactersMajor.Eric BadgerEric Badger
HADOOP-13812Upgrade Tomcat to 6.0.48BlockerkmsJohn ZhugeJohn Zhuge
HADOOP-13929ADLS connector should not check in contract-test-options.xmlMajorfs/adl, testJohn ZhugeJohn Zhuge

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor
YARN-4785inconsistent value type of the “type” field for LeafQueueInfo in response of RM REST API - cluster/schedulerMajorwebappJayeshVarun Vasudev

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-8934Shell command ls should include sort optionsMinorfsJonathan AllenJonathan Allen
HADOOP-9477Add posixGroups support for LDAP groups mapping serviceMajor.Kai ZhengDapeng Sun
HDFS-8009Signal congestion on the DataNodeMajordatanodeHaohui MaiHaohui Mai
YARN-2901Add errors and warning metrics page to RM, NM web UIMajornodemanager, resourcemanagerVarun VasudevVarun Vasudev
HDFS-7891A block placement policy with best rack failure toleranceMinornamenodeWalter SuWalter Su
HADOOP-11843Make setting up the build environment easierMajorbuildNiels BasjesNiels Basjes
MAPREDUCE-6284Add Task Attempt State API to MapReduce Application Master REST APIMinor.Ryu KobayashiRyu Kobayashi
HADOOP-10971Add -C flag to make hadoop fs -ls print filenames onlyMajorfsRyan WilliamsKengo Seki
MAPREDUCE-6364Add a “Kill” link to Task Attempts pageMinorapplicationmasterRyu KobayashiRyu Kobayashi
MAPREDUCE-6304Specifying node labels when submitting MR jobsMajor.Jian FangNaganarasimha G R
HDFS-8487Generalize BlockInfo in preparation of merging HDFS-7285 into trunk and branch-2MajornamenodeZhe ZhangZhe Zhang
HDFS-8608Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)Major.Zhe ZhangZhe Zhang
HADOOP-5732Add SFTP FileSystemMinorfsÍñigo Goiriramtin
HDFS-8622Implement GETCONTENTSUMMARY operation for WebImageViewerMajor.Jagadesh Kiran NJagadesh Kiran N
HDFS-8155Support OAuth2 in WebHDFSMajorwebhdfsJakob HomanJakob Homan
MAPREDUCE-6415Create a tool to combine aggregated logs into HAR filesMajor.Robert KanterRobert Kanter
HADOOP-12360Create StatsD metrics2 sinkMinormetricsDave MarionDave Marion
YARN-261Ability to fail AM attemptsMajorapiJason LoweRohith Sharma K S
HDFS-9184Logging HDFS operation's caller context into audit logsMajor.Mingliang LiuMingliang Liu
HDFS-9057allow/disallow snapshots via webhdfsMajorwebhdfsAllen WittenauerBrahma Reddy Battula
YARN-4349Support CallerContext in YARNMajor.Wangda TanWangda Tan
YARN-3623We should have a config to indicate the Timeline Service versionMajortimelineserverZhijie ShenXuan Gong
HADOOP-12657Add a option to skip newline on empty files with getMerge -nlMinor.Jan FilipiakKanaka Kumar Avvaru
YARN-3458CPU resource monitoring in WindowsMinornodemanagerInigo GoiriInigo Goiri
HADOOP-12691Add CSRF Filter for REST APIs to Hadoop CommonMajorsecurityLarry McCayLarry McCay
HADOOP-12635Adding Append API support for WASBMajorfs/azureDushyanthDushyanth
HADOOP-12426Add Entry point for Kerberos health checkMinorsecuritySteve LoughranSteve Loughran
HDFS-9244Support nested encryption zonesMajorencryptionXiaoyu YaoZhe Zhang
HADOOP-12548Read s3a creds from a Credential ProviderMajorfs/s3Allen WittenauerLarry McCay
HDFS-9711Integrate CSRF prevention filter in WebHDFS.Majordatanode, namenode, webhdfsChris NaurothChris Nauroth
HDFS-9835OIV: add ReverseXML processor which reconstructs an fsimage from an XML fileMajortoolsColin P. McCabeColin P. McCabe
HDFS-9239DataNode Lifeline Protocol: an alternative protocol for reporting DataNode livenessMajordatanode, namenodeChris NaurothChris Nauroth
HADOOP-12909Change ipc.Client to support asynchronous callsMajoripcTsz Wo Nicholas SzeXiaobing Zhou
HDFS-9945Datanode command for evicting writersMajordatanodeKihwal LeeKihwal Lee
HADOOP-13008Add XFS Filter for UIs to Hadoop CommonMajorsecurityLarry McCayLarry McCay
HADOOP-13065Add a new interface for retrieving FS and FC StatisticsMajorfsRam VenkateshMingliang Liu
HADOOP-12723S3A: Add ability to plug in any AWSCredentialsProviderMajorfs/s3Steven K. WongSteven K. Wong
HADOOP-13226Support async call retry and failoverMajorio, ipcXiaobing ZhouTsz Wo Nicholas Sze
HADOOP-12537S3A to support Amazon STS temporary credentialsMinorfs/s3Sean MackrorySean Mackrory
HDFS-9804Allow long-running Balancer to login with keytabMajorbalancer & mover, securityXiao ChenXiao Chen
HDFS-10918Add a tool to get FileEncryptionInfo from CLIMajorencryptionXiao ChenXiao Chen
HADOOP-13716Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setupMajortestSteve LoughranSteve Loughran
HADOOP-14049Honour AclBit flag associated to file/folder permission for Azure datalake accountMajorfs/adlVishwajeet DusaneVishwajeet Dusane
HADOOP-14048REDO operation of WASB#AtomicRename should create placeholder blob for destination folderCriticalfs/azureNITIN VERMANITIN VERMA

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HDFS-2580NameNode#main(...) can make use of GenericOptionsParser.MinornamenodeHarsh JHarsh J
MAPREDUCE-5232log classpath and other key properties on child JVM startMajormrv1, mrv2Sangjin LeeSangjin Lee
HADOOP-7713dfs -count -q should label output columnTrivial.Nigel DaleyJonathan Allen
HDFS-7546Document, and set an accepting default for dfs.namenode.kerberos.principal.patternMinorsecurityHarsh JHarsh J
HADOOP-11692Improve authentication failure WARN message to avoid user confusionMajoripcYongjun ZhangYongjun Zhang
HADOOP-11226Add a configuration to set ipc.Client's traffic class with IPTOS_LOWDELAY|IPTOS_RELIABILITYMajoripcGopal VGopal V
HADOOP-11711Provide a default value for AES/CTR/NoPadding CryptoCodec classesMinor.Andrew WangAndrew Wang
MAPREDUCE-4414Add main methods to JobConf and YarnConfiguration, for debug purposesMajorclientHarsh JPlamen Jeliazkov
MAPREDUCE-6105Inconsistent configuration in property mapreduce.reduce.shuffle.merge.percentTrivial.Dongwook KwonRay Chiang
HDFS-2360Ugly stacktrace when quota exceedsMinorhdfs-clientRajit SahaHarsh J
MAPREDUCE-6100replace “mapreduce.job.credentials.binary” with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability.Trivialmrv2zhihai xuzhihai xu
MAPREDUCE-5755MapTask.MapOutputBuffer#compare/swap should have @Override annotationTrivial.Tsuyoshi OzawaTsuyoshi Ozawa
MAPREDUCE-4653TestRandomAlgorithm has an unused “import” statementTrivialcontrib/gridmixAmir SanjarAmir Sanjar
HADOOP-11659o.a.h.fs.FileSystem.Cache#remove should use a single hash map lookupMinorfsGera ShegalovBrahma Reddy Battula
HADOOP-11709Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variableTrivial.Ajith SAjith S
HDFS-7835make initial sleeptime in locateFollowingBlock configurable for DFSClient.Majorhdfs-clientzhihai xuzhihai xu
HDFS-7829Code clean up for LocatedBlockMinor.Jing ZhaoTakanobu Asanuma
MAPREDUCE-6282Reuse historyFileAbsolute.getFileSystem in CompletedJob#loadFullHistoryData for code optimization.Trivialjobhistoryserverzhihai xuzhihai xu
HADOOP-11447Add a more meaningful toString method to SampleStat and MutableStatMinormetricsKarthik KambatlaKarthik Kambatla
YARN-3350YARN RackResolver spams logs with messages at info levelMajor.Wilfred SpiegelenburgWilfred Spiegelenburg
MAPREDUCE-6239Consolidate TestJobConf classes in hadoop-mapreduce-client-jobclient and hadoop-mapreduce-client-coreMinorclientVarun SaxenaVarun Saxena
MAPREDUCE-5190Unnecessary condition test in RandomSamplerMinormrv2Jingguo YaoJingguo Yao
MAPREDUCE-6287Deprecated methods in org.apache.hadoop.examples.SortMinorexamplesChao ZhangChao Zhang
HADOOP-11737mockito‘s version in hadoop-nfs’ pom.xml shouldn’t be specifiedMinornfsKengo SekiKengo Seki
YARN-2868FairScheduler: Metric for latency to allocate first container for an applicationMajor.Ray ChiangRay Chiang
HDFS-7875Improve log message when wrong value configured for dfs.datanode.failed.volumes.toleratedTrivialdatanodenijelnijel
HDFS-7793Refactor DFSOutputStream separating DataStreamer outMajorhdfs-clientKai ZhengLi Bo
HADOOP-11741Add LOG.isDebugEnabled() guard for some LOG.debug()Major.Walter SuWalter Su
MAPREDUCE-579Streaming “slowmatch” documentationTrivialcontrib/streamingBo AdlerHarsh J
HDFS-7928Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busyMajordatanodeRushabh S ShahRushabh S Shah
HADOOP-11719[Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help textMinorscriptsBrahma Reddy BattulaBrahma Reddy Battula
HDFS-8004Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zoneTrivialencryptionAndrew WangAndrew Wang
HDFS-7890Improve information on Top users for metrics in RollingWindowsManager and lower log levelMajor.J.AndreinaJ.Andreina
HDFS-4396Add START_MSG/SHUTDOWN_MSG for ZKFCMajorauto-failover, ha, toolsLiang XieLiang Xie
HADOOP-11660Add support for hardware crc of HDFS checksums on ARM aarch64 architectureMinornativeEdward NevillEdward Nevill
HDFS-7645Rolling upgrade is restoring blocks from trash multiple timesMajordatanodeNathan RobertsKeisuke Ogiwara
HDFS-3918EditLogTailer shouldn't log WARN when other node is in standby modeMajorhaTodd LipconTodd Lipcon
HDFS-7944Minor cleanup of BlockPoolManager#getAllNamenodeThreadsMinor.Arpit AgarwalArpit Agarwal
YARN-3258FairScheduler: Need to add more logging to investigate allocationsMinorfairschedulerAnubhav DhootAnubhav Dhoot
HDFS-7671hdfs user guide should point to the common rack awareness docMajordocumentationAllen WittenauerKai Sasaki
YARN-3412RM tests should use MockRM where possibleMajorresourcemanager, testKarthik KambatlaKarthik Kambatla
YARN-3428Debug log resources to be localized for a containerTrivialnodemanagerKarthik KambatlaKarthik Kambatla
YARN-3424Change logs for ContainerMonitorImpl's resourse monitoring from info to debugMajornodemanagerAnubhav DhootAnubhav Dhoot
YARN-3248Display count of nodes blacklisted by apps in the web UIMajorcapacityscheduler, resourcemanagerVarun VasudevVarun Vasudev
HDFS-7978Add LOG.isDebugEnabled() guard for some LOG.debug(..)Major.Walter SuWalter Su
HDFS-8008Support client-side back off when the datanodes are congestedMajorhdfs-clientHaohui MaiHaohui Mai
HDFS-7888Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassingMinorhdfs-clientLi BoLi Bo
HDFS-8035Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManagerMinornamenodeHaohui MaiHaohui Mai
HADOOP-9805Refactor RawLocalFileSystem#rename for improved testability.Minorfs, testChris NaurothJean-Pierre Matsumoto
HADOOP-11785Reduce number of listStatus operation in distcp buildListing()Minortools/distcpZoran DimitrijevicZoran Dimitrijevic
HADOOP-11717Add Redirecting WebSSO behavior with JWT Token in Hadoop AuthMajorsecurityLarry McCayLarry McCay
YARN-3294Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time periodMajorcapacityschedulerVarun VasudevVarun Vasudev
HDFS-8073Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided.TrivialnamenodeWalter SuWalter Su
HDFS-8076Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possibleMajor.Zhe ZhangZhe Zhang
HDFS-7979Initialize block report IDs with a random numberMinordatanodeAndrew WangAndrew Wang
HDFS-8101DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtimeMinorhdfs-clientSean BusbeySean Busbey
YARN-3293Track and display capacity scheduler health metrics in web UIMajorcapacityschedulerVarun VasudevVarun Vasudev
MAPREDUCE-6291Correct mapred queue usage commandMinorclientBrahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6307Remove property mapreduce.tasktracker.taskmemorymanager.monitoringintervalMinor.Akira AjisakaJ.Andreina
YARN-3348Add a ‘yarn top’ tool to help understand cluster usageMajorresourcemanagerVarun VasudevVarun Vasudev
YARN-3469ZKRMStateStore: Avoid setting watches that are not requiredMinor.Jun GongJun Gong
HDFS-8117More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned dataMajor.Zhe ZhangZhe Zhang
HDFS-8144Split TestLazyPersistFiles into multiple testsMajortestArpit AgarwalArpit Agarwal
YARN-3404View the queue name to YARN Application pageMinor.Ryu KobayashiRyu Kobayashi
YARN-3451Add start time and Elapsed in ApplicationAttemptReport and display the same in RMAttemptBlock WebUIMajorapi, webappRohith Sharma K SRohith Sharma K S
HDFS-7863Missing description of some methods and parameters in javadoc of FSDirDeleteOpMinor.Yongjun ZhangBrahma Reddy Battula
HDFS-8152Refactoring of lazy persist storage casesMajortestArpit AgarwalArpit Agarwal
HDFS-8133Improve readability of deleted block checkMajornamenodeDaryn SharpDaryn Sharp
HADOOP-11812Implement listLocatedStatus for ViewFileSystem to speed up split calculationBlockerfsGera ShegalovGera Shegalov
MAPREDUCE-6297Task Id of the failed task in diagnostics should link to the task pageMinorjobhistoryserverSiqi LiSiqi Li
HADOOP-11827Speed-up distcp buildListing() using threadpoolMajortools/distcpZoran DimitrijevicZoran Dimitrijevic
YARN-3494Expose AM resource limit and usage in QueueMetricsMajor.Jian HeRohith Sharma K S
YARN-3503Expose disk utilization percentage and bad local and log dir counts on NM via JMXMajornodemanagerVarun VasudevVarun Vasudev
YARN-3410YARN admin should be able to remove individual application records from RMStateStoreCriticalresourcemanager, yarnWangda TanRohith Sharma K S
HDFS-8215Refactor NamenodeFsck#check methodMinornamenodeTakanobu AsanumaTakanobu Asanuma
YARN-3511Add errors and warnings page to ATSMajortimelineserverVarun VasudevVarun Vasudev
HDFS-8176Record from/to snapshots in audit log for snapshot diff reportMinorsnapshotsJ.AndreinaJ.Andreina
YARN-3406Display count of running containers in the RM's Web UIMinor.Ryu KobayashiRyu Kobayashi
HADOOP-11357Print information of the build enviornment in test-patch.shMinorscriptsHaohui MaiAllen Wittenauer
HDFS-8204Mover/Balancer should not schedule two replicas to the same DNMinorbalancer & moverWalter SuWalter Su
HDFS-8280Code Cleanup in DFSInputStreamMinor.Jing ZhaoJing Zhao
HDFS-8283DataStreamer cleanup and some minor improvementMinorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-5574Remove buffer copy in BlockReader.skipTrivial.Binglin ChangBinglin Chang
HDFS-7770Need document for storage type label of data node storage locations under dfs.datanode.data.dirMajordocumentationXiaoyu YaoXiaoyu Yao
HDFS-8200Refactor FSDirStatAndListingOpMajor.Haohui MaiHaohui Mai
YARN-3363add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container.Majornodemanagerzhihai xuzhihai xu
HDFS-7397Add more detail to the documentation for the conf key “dfs.client.read.shortcircuit.streams.cache.size”Minorhdfs-clientTsz Wo Nicholas SzeBrahma Reddy Battula
YARN-2980Move health check script related functionality to hadoop-commonBlocker.Ming MaVarun Saxena
HADOOP-11911test-patch should allow configuration of default branchMinor.Sean BusbeySean Busbey
HDFS-7758Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() insteadMajordatanodeLei (Eddy) XuLei (Eddy) Xu
HADOOP-11925backport trunk's smart-apply-patch.sh to branch-2MajorscriptsAllen WittenauerAllen Wittenauer
MAPREDUCE-6192Create unit test to automatically compare MR related classes and mapred-default.xmlMinor.Ray ChiangRay Chiang
HADOOP-11813releasedocmaker.py should use today's date instead of unreleasedMinorbuildAllen WittenauerDarrell Taylor
YARN-3491PublicLocalizer#addResource is too slow.Criticalnodemanagerzhihai xuzhihai xu
MAPREDUCE-6279AM should explicity exit JVM after all services have stoppedMajor.Jason LoweEric Payne
HDFS-8108Fsck should provide the info on mandatory option to be used along with “-blocks , -locations and -racks”TrivialdocumentationJ.AndreinaJ.Andreina
HDFS-8207Improper log message when blockreport interval compared with initial delayMinor.Brahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6079Rename JobImpl#username to reporterUserNameMajor.Tsuyoshi OzawaTsuyoshi Ozawa
HDFS-8209Support different number of datanode directories in MiniDFSCluster.MinortestSurendra Singh LilhoreSurendra Singh Lilhore
YARN-3169Drop YARN's overview documentMajordocumentationAllen WittenauerBrahma Reddy Battula
YARN-2784Make POM project names consistentMinorbuildRohith Sharma K SRohith Sharma K S
MAPREDUCE-5981Log levels of certain MR logs can be changed to DEBUGMajor.Varun SaxenaVarun Saxena
HADOOP-6842“hadoop fs -text” does not give a useful text representation of MapWritable objectsMajorioSteven K. WongAkira Ajisaka
YARN-20More information for “yarn.resourcemanager.webapp.address” in yarn-default.xmlTrivialdocumentation, resourcemanagerNemon LouBartosz Ługowski
HDFS-5640Add snapshot methods to FileContext.Majorhdfs-client, snapshotsChris NaurothRakesh R
HDFS-8284Update documentation about how to use HTrace with HDFSMajordocumentationMasatake IwasakiMasatake Iwasaki
HDFS-7433Optimize performance of DatanodeManager's node mapCriticalnamenodeDaryn SharpDaryn Sharp
MAPREDUCE-5248Let NNBenchWithoutMR specify the replication factor for its testMinorclient, testErik PaulsonErik Paulson
HADOOP-9737JarFinder#getJar should delete the jar file upon destruction of the JVMMajorutilEsteban GutierrezJean-Baptiste Onofré
YARN-1050Document the Fair Scheduler REST APIMajordocumentation, fairschedulerSandy RyzaKenji Kikushima
YARN-3271FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnabilityMajor.Karthik Kambatlanijel
YARN-2206Update document for applications REST API response examplesMinordocumentationKenji KikushimaBrahma Reddy Battula
HDFS-6757Simplify lease manager with INodeIDMajor.Haohui MaiHaohui Mai
HDFS-8327Simplify quota calculations for snapshots and truncateMajor.Haohui MaiHaohui Mai
YARN-1287Consolidate MockClocksMajor.Sandy RyzaSebastian Wong
HDFS-8357Consolidate parameters of INode.CleanSubtree() into a parameter objects.Major.Haohui MaiLi Lu
HADOOP-11950Add cli option to test-patch to set the project-under-testMinor.Sean BusbeySean Busbey
HADOOP-11948test-patch's issue matching regex should be configurable.Major.Sean BusbeySean Busbey
MAPREDUCE-5465Tasks are often killed before they exit on their ownMajormr-am, mrv2Radim KolarMing Ma
YARN-3513Remove unused variables in ContainersMonitorImpl and add debug log for overall resource usage by all containersTrivialnodemanagerNaganarasimha G RNaganarasimha G R
HDFS-8255Rename getBlockReplication to getPreferredBlockReplicationMajor.Zhe ZhangZhe Zhang
YARN-3613TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methodsMinortestKarthik Kambatlanijel
HDFS-6184Capture NN's thread dump when it fails overMajornamenodeMing MaMing Ma
YARN-3539Compatibility doc to state that ATS v1 is a stable REST APIMajordocumentationSteve LoughranSteve Loughran
HADOOP-9723Improve error message when hadoop archive output path already existsTrivial.Stephen ChuYongjun Zhang
HADOOP-11713ViewFileSystem should support snapshot methods.MajorfsChris NaurothRakesh R
HDFS-8350Remove old webhdfs.xml and other outdated documentation stuffMajordocumentationAkira AjisakaBrahma Reddy Battula
HADOOP-11960Enable Azure-Storage Client Side logging.MajortoolsDushyanthDushyanth
HDFS-6888Allow selectively audit logging opsMajor.Kihwal LeeChen He
HDFS-8397Refactor the error handling code in DataStreamerMinorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8394Move getAdditionalBlock() and related functionalities into a separate classMajor.Haohui MaiHaohui Mai
HADOOP-11939Deprecate DistCpV1 and LogalyzerMajor.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-4185Add a metric for number of active leasesMajornamenodeKihwal LeeRakesh R
HADOOP-1540Support file exclusion list in distcpMinorutilSenthil SubramanianRich Haase
HADOOP-11103Clean up RemoteExceptionTrivialipcSean BusbeySean Busbey
HDFS-8131Implement a space balanced block placement policyMinornamenodeLiu ShaohuiLiu Shaohui
HADOOP-11970Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandomMajor.Sean BusbeySean Busbey
HADOOP-11995Make jetty version configurable from the maven command lineTrivialbuild, ldsriharsha devinenisriharsha devineni
HDFS-4383Document the lease limitsMinor.Eli CollinsMohammad Arshad
HADOOP-10366Add whitespaces between the classes for values in core-default.xml to fit better in browserMinordocumentationChengwei YangKanaka Kumar Avvaru
HADOOP-11594Improve the readability of site index of documentationMinordocumentationMasatake IwasakiMasatake Iwasaki
YARN-160nodemanagers should obtain cpu/memory values from underlying OSMajornodemanagerAlejandro AbdelnurVarun Vasudev
HADOOP-11242Record the time of calling in tracing span of IPC serverMinoripcMasatake IwasakiMasatake Iwasaki
YARN-3722Merge multiple TestWebAppUtils into o.a.h.yarn.webapp.util.TestWebAppUtilsMinortestMasatake IwasakiMasatake Iwasaki
HADOOP-11894Bump the version of Apache HTrace to 3.2.0-incubatingMajor.Masatake IwasakiMasatake Iwasaki
YARN-3489RMServerUtils.validateResourceRequests should only obtain queue info onceMajorresourcemanagerJason LoweVarun Saxena
HDFS-8443Document dfs.namenode.service.handler.count in hdfs-site.xmlMajordocumentationAkira AjisakaJ.Andreina
YARN-3547FairScheduler: Apps that have no resource demand should not participate schedulingMajorfairschedulerXianyin XinXianyin Xin
YARN-3713Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransitionMinornodemanagerzhihai xuzhihai xu
HADOOP-12043Display warning if defaultFs is not set when running fs commands.MinorfsLei (Eddy) XuLei (Eddy) Xu
YARN-3467Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UIMinorwebapp, yarnAnthony RojasAnubhav Dhoot
HDFS-8490Typo in trace enabled log in ExceptionHandler of WebHDFSTrivialwebhdfsJakob HomanArchana T
HDFS-8521Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}Trivial.Colin P. McCabeColin P. McCabe
MAPREDUCE-6174Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.Majormrv2Eric PayneEric Payne
HDFS-8532Make the visibility of DFSOutputStream#streamer member variable to privateTrivial.Rakesh RRakesh R
HDFS-8535Clarify that dfs usage in dfsadmin -report output includes all block replicas.MinordocumentationLei (Eddy) XuLei (Eddy) Xu
MAPREDUCE-6383Pi job (QuasiMonteCarlo) should not try to read the results file if its job failsMajorexamplesHarsh JHarsh J
YARN-3259FairScheduler: Trigger fairShare updates on node eventsMajorfairschedulerAnubhav DhootAnubhav Dhoot
HADOOP-12059S3Credentials should support use of CredentialProviderMajorfs/s3Sean BusbeySean Busbey
MAPREDUCE-6354ShuffleHandler should be able to log shuffle connectionsMajor.Chang LiChang Li
HADOOP-12055Deprecate usage of NativeIO#linkMajornativeAndrew WangAndrew Wang
HDFS-8432Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.Majornamenode, rolling upgradesChris NaurothChris Nauroth
HDFS-8116Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManagerTrivialnamenodeXiaoyu YaoBrahma Reddy Battula
YARN-2716Refactor ZKRMStateStore retry code with Apache CuratorMajor.Jian HeKarthik Kambatla
HDFS-8553Document hdfs class path optionsMajordocumentationXiaoyu YaoBrahma Reddy Battula
YARN-3786Document yarn class path optionsMajordocumentationBrahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6392Document mapred class path optionsMajordocumentationBrahma Reddy BattulaBrahma Reddy Battula
HDFS-8549Abort the balancer if an upgrade is in progressMajorbalancer & moverAndrew WangAndrew Wang
HDFS-8573Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipelineMajordatanodeLei (Eddy) XuLei (Eddy) Xu
HADOOP-11971Move test utilities for tracing from hadoop-hdfs to hadoop-commonMinortracingMasatake IwasakiMasatake Iwasaki
HDFS-8361Choose SSD over DISK in block placementMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
YARN-3789Improve logs for LeafQueue#activateApplications()MinorresourcemanagerBibin A ChundattBibin A Chundatt
HDFS-8606Cleanup DFSOutputStream by removing unwanted changesMinorhdfs-clientRakesh RRakesh R
YARN-3148Allow CORS related headers to passthrough in WebAppProxyServletMajor.Prakash RamachandranVarun Saxena
HDFS-8589Fix unused imports in BPServiceActor and BlockReportLeaseManagerTrivial.Colin P. McCabeColin P. McCabe
HADOOP-7139Allow appending to existing SequenceFilesMajorioStephen RoseKanaka Kumar Avvaru
HDFS-8605Merge Refactor of DFSOutputStream from HDFS-7285 branchMajor.Vinayakumar BVinayakumar B
MAPREDUCE-6395Improve the commit failure messages in MRAppMaster recoveryMajorapplicationmasterGera ShegalovBrahma Reddy Battula
HDFS-8582Support getting a list of reconfigurable config properties and do not generate spurious reconfig warningsMinordatanode, hdfs-clientLei (Eddy) XuLei (Eddy) Xu
MAPREDUCE-6316Task Attempt List entries should link to the task overviewMajor.Siqi LiSiqi Li
MAPREDUCE-6305AM/Task log page should be able to link back to the jobMajor.Siqi LiSiqi Li
YARN-3834Scrub debug logging of tokens during resource localization.MajornodemanagerChris NaurothChris Nauroth
MAPREDUCE-6408Queue name and user name should be printed on the job pageMajorapplicationmasterSiqi LiSiqi Li
HDFS-8639Option for HTTP port of NameNode by MiniDFSClusterManagerMinortestKai SasakiKai Sasaki
YARN-3360Add JMX metrics to TimelineDataManagerMajortimelineserverJason LoweJason Lowe
HADOOP-12049Control http authentication cookie persistence via configurationMajorsecurityBenoy AntonyHuizhi Lu
HDFS-8462Implement GETXATTRS and LISTXATTRS operations for WebImageViewerMajor.Akira AjisakaJagadesh Kiran N
HDFS-8640Make reserved RBW space visible through JMXMajor.Kanaka Kumar AvvaruKanaka Kumar Avvaru
HDFS-8546Use try with resources in DataStorage and StorageMinordatanodeAndrew WangAndrew Wang
HADOOP-11807add a lint mode to releasedocmakerMinorbuild, documentation, yetusAllen Wittenauerramtin
HDFS-8653Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfoMajor.Zhe ZhangZhe Zhang
HDFS-8659Block scanner INFO message is spamming logsMajordatanodeYongjun ZhangYongjun Zhang
MAPREDUCE-6384Add the last reporting reducer info for too many fetch failure diagnosticsMajor.Chang LiChang Li
HADOOP-12158Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installedTrivialtestAndrew WangAndrew Wang
HADOOP-12172FsShell mkdir -p makes an unnecessary check for the existence of the parent.MinorfsChris NaurothChris Nauroth
HDFS-8703Merge refactor of DFSInputStream from ErasureCoding branchMajor.Vinayakumar BVinayakumar B
HDFS-8709Clarify automatic sync in FSEditLog#logEditMinor.Andrew WangAndrew Wang
HADOOP-12045Enable LocalFileSystem#setTimes to change atimeMinorfsKazuho FujiiKazuho Fujii
HADOOP-12185NetworkTopology is not efficient adding/getting/removing nodesMajor.Inigo GoiriInigo Goiri
HADOOP-12135cleanup releasedocmakerMajoryetusAllen WittenauerAllen Wittenauer
HADOOP-12195Add annotation to package-info.java file to workaround MCOMPILER-205Trivial.Andrew WangAndrew Wang
HADOOP-12193Rename Touchz.java to Touch.javaTrivial.Andrew WangAndrew Wang
HDFS-8711setSpaceQuota command should print the available storage type when input storage type is wrongMajorhdfs-clientSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-8712Remove “public” and “abstract” modifiers in FsVolumeSpi and FsDatasetSpiTrivial.Lei (Eddy) XuLei (Eddy) Xu
HADOOP-12194Support for incremental generation in the protoc pluginMajor.Andrew WangAndrew Wang
HADOOP-12180Move ResourceCalculatorPlugin from YARN to CommonMajorutilChris DouglasChris Douglas
HADOOP-12210Collect network usage on the nodeMajor.Robert GrandlRobert Grandl
YARN-3069Document missing properties in yarn-default.xmlMajordocumentationRay ChiangRay Chiang
YARN-3381Fix typo InvalidStateTransitonExceptionMinorapiXiaoshuang LUBrahma Reddy Battula
HADOOP-12211Collect disks usages on the nodeMajor.Robert GrandlRobert Grandl
HDFS-8722Optimize datanode writes for small writes and flushesCritical.Kihwal LeeKihwal Lee
HADOOP-12232Upgrade Tomcat dependency to 6.0.44.MajorbuildChris NaurothChris Nauroth
YARN-3170YARN architecture document needs updatingMajordocumentationAllen WittenauerBrahma Reddy Battula
MAPREDUCE-5762Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2MinordocumentationAkira AjisakaAkira Ajisaka
YARN-3174Consolidate the NodeManager and NodeManagerRestart documentation into oneMajordocumentationAllen WittenauerMasatake Iwasaki
HDFS-7314When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClientMajor.Ming MaMing Ma
HADOOP-11893Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.PublicMajorsecuritySteve LoughranBrahma Reddy Battula
HADOOP-12081Fix UserGroupInformation.java to support 64-bit zLinuxMajorsecurityAdam RobertsAkira Ajisaka
HADOOP-12214Parse ‘HadoopArchive’ commandline using cli Options.Minor.Vinayakumar BVinayakumar B
YARN-2921Fix MockRM/MockAM#waitForState sleep too longMajortestKarthik KambatlaTsuyoshi Ozawa
HADOOP-12161Add getStoragePolicy API to the FileSystem interfaceMajorfsArpit AgarwalBrahma Reddy Battula
HADOOP-12189Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible.Majoripc, testzhihai xuzhihai xu
HADOOP-12009Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatusMinordocumentation, fs, testJakob HomanJ.Andreina
HADOOP-12259Utility to Dynamic port allocationMajortest, utilBrahma Reddy BattulaBrahma Reddy Battula
HDFS-8735Inotify : All events classes should implement toString() API.Majorhdfs-clientSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-7858Improve HA Namenode Failover detection on the clientMajorhdfs-clientArun SureshArun Suresh
HDFS-8180AbstractFileSystem Implementation for WebHdfsMajorwebhdfsSanthosh G NayakSanthosh G Nayak
HDFS-8811Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.javaMajor.Vinayakumar BVinayakumar B
HDFS-8822Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPoliciesMajor.Vinayakumar BVinayakumar B
YARN-3950Add unique YARN_SHELL_ID environment variable to DistributedShellMajorapplications/distributed-shellRobert KanterRobert Kanter
YARN-2768Avoid cloning Resource in FSAppAttempt#updateDemandMinorfairschedulerHong ZhiguoHong Zhiguo
HDFS-8816Improve visualization for the Datanode tab in the NN UIMajor.Haohui MaiHaohui Mai
HDFS-8821Explain message “Operation category X is not supported in state standby”Minor.Gautam GopalakrishnanGautam Gopalakrishnan
HADOOP-12271Hadoop Jar Error Should Be More ExplanatoryMinor.Jesse AndersonJosh Elser
HADOOP-12183Annotate the HTrace span created by FsShell with the command-line arguments passed by the userMinortracingMasatake IwasakiMasatake Iwasaki
YARN-3978Configurably turn off the saving of container info in Generic AHSMajortimelineserver, yarnEric PayneEric Payne
YARN-3965Add startup timestamp to nodemanager UIMinornodemanagerHong ZhiguoHong Zhiguo
HADOOP-12280Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoadedMinortestMasatake IwasakiMasatake Iwasaki
HDFS-8815DFS getStoragePolicy implementation using single RPC callMajorhdfs-clientArpit AgarwalSurendra Singh Lilhore
YARN-3961Expose pending, running and reserved containers of a queue in REST api and yarn topMajorcapacityscheduler, fairscheduler, webappAnubhav DhootAnubhav Dhoot
YARN-4019Add JvmPauseMonitor to ResourceManager and NodeManagerMajornodemanager, resourcemanagerRobert KanterRobert Kanter
MAPREDUCE-6443Add JvmPauseMonitor to Job History ServerMajorjobhistoryserverRobert KanterRobert Kanter
HDFS-8887Expose storage type and storage ID in BlockLocationMajor.Andrew WangAndrew Wang
HADOOP-12318Expose underlying LDAP exceptions in SaslPlainServerMinorsecurityMike YoderMike Yoder
HADOOP-12295Improve NetworkTopology#InnerNode#remove logicMajor.Yi LiuYi Liu
HDFS-7649Multihoming docs should emphasize using hostnames in configurationsMajordocumentationArpit AgarwalBrahma Reddy Battula
YARN-4055Report node resource utilization in heartbeatMajornodemanagerInigo GoiriInigo Goiri
HDFS-8713Convert DatanodeDescriptor to use SLF4J loggingTrivial.Andrew WangAndrew Wang
HDFS-8883NameNode Metrics : Add FSNameSystem lock Queue LengthMajornamenodeAnu EngineerAnu Engineer
HDFS-6407Add sorting and pagination in the datanode tab of the NN Web UICriticalnamenodeNathan RobertsHaohui Mai
HDFS-8880NameNode metrics loggingMajornamenodeArpit AgarwalArpit Agarwal
YARN-4057If ContainersMonitor is not enabled, only print related log info one timeMinornodemanagerJun GongJun Gong
HADOOP-12050Enable MaxInactiveInterval for hadoop http auth tokenMajorsecurityBenoy AntonyHuizhi Lu
HDFS-8435Support CreateFlag in WebHdfsMajorwebhdfsVinoth SathappanJakob Homan
HDFS-8911NameNode Metric : Add Editlog counters as a JMX metricMajornamenodeAnu EngineerAnu Engineer
HDFS-8917Cleanup BlockInfoUnderConstruction from comments and testsMinornamenodeZhe ZhangZhe Zhang
HDFS-8884Fail-fast check in BlockPlacementPolicyDefault#chooseTargetMajor.Yi LiuYi Liu
HDFS-8828Utilize Snapshot diff report to build diff copy list in distcpMajordistcp, snapshotsYufei GuYufei Gu
HDFS-8924Add pluggable interface for reading replicas in DFSClientMajorhdfs-clientColin P. McCabeColin P. McCabe
HDFS-8928Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an arrayMinornamenodeZhe ZhangJing Zhao
HDFS-2390dfsadmin -setBalancerBandwidth doesnot validate -ve valueMinorbalancer & moverRajit SahaGautam Gopalakrishnan
HDFS-8865Improve quota initialization performanceMajor.Kihwal LeeKihwal Lee
HDFS-8983NameNode support for protected directoriesMajornamenodeArpit AgarwalArpit Agarwal
HDFS-8946Improve choosing datanode storage for block placementMajornamenodeYi LiuYi Liu
HDFS-8965Harden edit log reading code against out of memory errorsMajor.Colin P. McCabeColin P. McCabe
HADOOP-12368Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstractTrivial.Andrew WangAndrew Wang
HADOOP-12367Move TestFileUtil's test resources to resources folderMinor.Andrew WangAndrew Wang
HADOOP-12369Point hadoop-project/pom.xml java.security.krb5.conf within target folderMinor.Andrew WangAndrew Wang
HDFS-328Improve fs -setrep error message for invalid replication factorsMajornamenodeTsz Wo Nicholas SzeDaniel Templeton
HADOOP-5323Trash documentation should describe its directory structure and configurationsMinordocumentationSuman SehgalWeiwei Yang
HDFS-9021Use a yellow elephant rather than a blue one in diagramMinor.Andrew WangAndrew Wang
HADOOP-12358Add -safely flag to rm to prompt when deleting many filesMajorfsXiaoyu YaoXiaoyu Yao
YARN-4024YARN RM should avoid unnecessary resolving IP when NMs doing heartbeatMajorresourcemanagerWangda TanHong Zhiguo
HADOOP-12384Add “-direct” flag option for fs copy so that user can choose not to create “._COPYING_” fileMajorfsChen HeJ.Andreina
HDFS-9019Adding informative message to sticky bit permission denied exceptionMinorsecurityThejas M NairXiaoyu Yao
HDFS-8384Allow NN to startup if there are files having a lease but are not under constructionMinornamenodeTsz Wo Nicholas SzeJing Zhao
HDFS-8929Add a metric to expose the timestamp of the last journalMajorjournal-nodeAkira AjisakaSurendra Singh Lilhore
HDFS-7116Add a command to get the balancer bandwidthMajorbalancer & moverAkira AjisakaRakesh R
YARN-4086Allow Aggregated Log readers to handle HAR filesMajor.Robert KanterRobert Kanter
HDFS-8974Convert docs in xdoc format to markdownMinordocumentationMasatake IwasakiMasatake Iwasaki
YARN-4145Make RMHATestBase abstract so its not run when running all tests under that namespaceMinor.Anubhav DhootAnubhav Dhoot
HADOOP-12324Better exception reporting in SaslPlainServerMinorsecurityMike YoderMike Yoder
YARN-2005Blacklisting support for scheduling AMsMajorresourcemanagerJason LoweAnubhav Dhoot
HDFS-8829Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuningMajordatanodeHe TianyiHe Tianyi
HDFS-9065Include commas on # of files, blocks, total filesystem objects in NN Web UIMinornamenodeDaniel TempletonDaniel Templeton
HADOOP-12413AccessControlList should avoid calling getGroupNames in isUserInList with empty groups.Majorsecurityzhihai xuzhihai xu
HDFS-8953DataNode Metrics loggingMajor.Kanaka Kumar AvvaruKanaka Kumar Avvaru
YARN-4158Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainersMinornodemanagerzhihai xuzhihai xu
YARN-4149yarn logs -am should provide an option to fetch all the log filesMajorclient, nodemanagerVarun VasudevVarun Vasudev
HDFS-9082Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUGMinorwebhdfsSanthosh G NayakSanthosh G Nayak
YARN-4135Improve the assertion message in MockRM while failing after waiting for the state.Trivial.nijelnijel
MAPREDUCE-6478Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob().Major.Junping DuJunping Du
HADOOP-12404Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class.Minorconfzhihai xuzhihai xu
HADOOP-12428Fix inconsistency between log-level guards and statementsMinor.Jackie ChangJagadesh Kiran N
YARN-4095Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService.Majornodemanagerzhihai xuzhihai xu
HDFS-5795RemoteBlockReader2#checkSuccess() shoud print error statusTrivial.Brandon LiXiao Chen
HDFS-9112Improve error message for Haadmin when multiple name service IDs are configuredMajortoolsAnu EngineerAnu Engineer
HDFS-9132Pass genstamp to ReplicaAccessorBuilderMajorhdfs-clientColin P. McCabeColin P. McCabe
HDFS-8873Allow the directoryScanner to be rate-limitedMajordatanodeNathan RobertsDaniel Templeton
HADOOP-12442Display help if the command option to "hdfs dfs " is not validMinor.nijelnijel
HADOOP-11984Enable parallel JUnit tests in pre-commit.Majorbuild, scripts, testChris NaurothChris Nauroth
MAPREDUCE-6471Document distcp incremental copyMajordistcpArpit AgarwalNeelesh Srinivas Salian
HDFS-9148Incorrect assert message in TestWriteToReplica#testWriteToTemporaryTrivialtestTony WuTony Wu
HDFS-8859Improve DataNode ReplicaMap memory footprint to save about 45%MajordatanodeYi LiuYi Liu
HDFS-8696Make the lower and higher watermark in the DN Netty server configurableMajorwebhdfsXiaobing ZhouXiaobing Zhou
YARN-3727For better error recovery, check if the directory exists before using it for localization.Majornodemanagerzhihai xuzhihai xu
HDFS-9175Change scope of ‘AccessTokenProvider.getAccessToken()’ and ‘CredentialBasedAccessTokenProvider.getCredential()’ abstract methods to publicMajorwebhdfsSanthosh G NayakSanthosh G Nayak
HADOOP-12458Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-commonMinordocumentationNeelesh Srinivas SalianNeelesh Srinivas Salian
HDFS-9151Mover should print the exit status/reason on console like balancer tool.Minorbalancer & moverArchana TSurendra Singh Lilhore
HADOOP-12350WASB Logging: Improve WASB Logging around deletes, reads and writesMajortoolsDushyanthDushyanth
HADOOP-12284UserGroupInformation doAs can throw misleading exceptionTrivialsecurityAaron DossettAaron Dossett
YARN-4228FileSystemRMStateStore use IOUtils#close instead of fs#closeMinor.Bibin A ChundattBibin A Chundatt
YARN-3943Use separate threshold configurations for disk-full detection and disk-not-full detection.Criticalnodemanagerzhihai xuzhihai xu
MAPREDUCE-6479Add missing mapred job command options in mapreduce documentMajordocumentationnijelnijel
HADOOP-11104org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checkingMinor.Ray ChiangRay Chiang
HDFS-9181Better handling of exceptions thrown during upgrade shutdownMinor.Wei-Chiu ChuangWei-Chiu Chuang
HDFS-9110Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiencyMinor.Charlie HelinCharlie Helin
HDFS-9221HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary arrayMajorperformanceStaffan FribergStaffan Friberg
HDFS-8988Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMapMajor.Yi LiuYi Liu
HDFS-9139Enable parallel JUnit tests for HDFS Pre-commitMajortestVinayakumar BVinayakumar B
HDFS-9145Tracking methods that hold FSNamesytemLock for too longMajornamenodeJing ZhaoMingliang Liu
HADOOP-10775Shell operations to fail with meaningful errors on windows if winutils.exe not foundMinorutilSteve LoughranSteve Loughran
YARN-4253Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutorMajor.Sidharta SeethanaSidharta Seethana
YARN-4252Log container-executor invocation details when exit code is non-zeroMinornodemanagerSidharta SeethanaSidharta Seethana
HDFS-9238Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile()TrivialtestTony WuTony Wu
HDFS-9188Make block corruption related tests FsDataset-agnostic.MajortestLei (Eddy) XuLei (Eddy) Xu
HDFS-9205Do not schedule corrupt blocks for replicationMinornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-12481JWTRedirectAuthenticationHandler doesn't Retain Original Query StringMajorsecurityLarry McCayLarry McCay
HDFS-9257improve error message for “Absolute path required” in INode.java to contain the rejected pathTrivialnamenodeMarcell SzaboMarcell Szabo
HDFS-9253Refactor tests of libhdfs into a directoryMajor.Haohui MaiHaohui Mai
HADOOP-12450UserGroupInformation should not log at WARN level if no groups are foundMinorsecurityElliott ClarkElliott Clark
HADOOP-12460Add overwrite option for ‘get’ shell commandMajor.Keegan WittJagadesh Kiran N
HDFS-9250Add Precondition check to LocatedBlock#addCachedLocMajornamenodeXiao ChenXiao Chen
HDFS-9251Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.MajortestLei (Eddy) XuLei (Eddy) Xu
MAPREDUCE-6489Fail fast rogue tasks that write too much to local diskMajortaskMaysam YabandehMaysam Yabandeh
HDFS-8647Abstract BlockManager's rack policy into BlockPlacementPolicyMajor.Ming MaBrahma Reddy Battula
HDFS-7087Ability to list /.reservedMajor.Andrew WangXiao Chen
HDFS-9280Document NFS gateway export point parameterTrivialdocumentationZhe ZhangXiao Chen
HADOOP-12334Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retriesMajortoolsGaurav KanadeGaurav Kanade
HADOOP-7266Deprecate metrics v1BlockermetricsLuke LuAkira Ajisaka
YARN-2913Fair scheduler should have ability to set MaxResourceDefault for each queueMajor.Siqi LiSiqi Li
HDFS-9264Minor cleanup of operations on FsVolumeList#volumesMinor.Walter SuWalter Su
HDFS-8808dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandbyMajor.Gautam GopalakrishnanZhe Zhang
HDFS-9297Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()TrivialtestTony WuTony Wu
HDFS-4015Safemode should count and report orphaned blocksMajornamenodeTodd LipconAnu Engineer
YARN-3528Tests with 12345 as hard-coded port break jenkinsBlocker.Steve LoughranBrahma Reddy Battula
YARN-4285Display resource usage as percentage of queue and cluster in the RM UIMajorresourcemanagerVarun VasudevVarun Vasudev
HDFS-7284Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicasMajornamenodeHu Liu,Wei-Chiu Chuang
HADOOP-12472Make GenericTestUtils.assertExceptionContains robustMinortestSteve LoughranSteve Loughran
HDFS-9291Fix TestInterDatanodeProtocol to be FsDataset-agnostic.MinortestLei (Eddy) XuLei (Eddy) Xu
HDFS-8945Update the description about replica placement in HDFS Architecture documentationMinordocumentationMasatake IwasakiMasatake Iwasaki
HDFS-9292Make TestFileConcorruption independent to underlying FsDataset Implementation.Minor.Lei (Eddy) XuLei (Eddy) Xu
HDFS-9259Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenarioMajor.Ming MaMingliang Liu
HDFS-9299Give ReplicationMonitor a readable thread nameTrivialnamenodeStaffan FribergStaffan Friberg
HDFS-9307fuseConnect should be private to fuse_connect.cTrivialfuse-dfsColin P. McCabeMingliang Liu
HADOOP-12520Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests.Majorfs/azure, testChris NaurothChris Nauroth
HDFS-9311Support optional offload of NameNode HA service health checks to a separate RPC server.Majorha, namenodeChris NaurothChris Nauroth
HDFS-9255Consolidate block recovery related implementation into a single classMinordatanodeWalter SuWalter Su
YARN-2573Integrate ReservationSystem with the RM failover mechanismMajorcapacityscheduler, fairscheduler, resourcemanagerSubru KrishnanSubru Krishnan
HDFS-6200Create a separate jar for hdfs-clientMajorbuildHaohui MaiHaohui Mai
HDFS-8545Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific pathMinor.J.AndreinaJ.Andreina
HDFS-9229Expose size of NameNode directory as a metricMinornamenodeZhe ZhangSurendra Singh Lilhore
YARN-4310FairScheduler: Log skipping reservation messages at DEBUG levelMinorfairschedulerArun SureshArun Suresh
HDFS-9312Fix TestReplication to be FsDataset-agnostic.Minor.Lei (Eddy) XuLei (Eddy) Xu
HDFS-9308Add truncateMeta() and deleteMeta() to MiniDFSClusterMinortestTony WuTony Wu
HDFS-9331Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS useTrivialtestTony WuTony Wu
HDFS-9363Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.MinortestTony WuTony Wu
HDFS-9282Make data directory count and storage raw capacity related tests FsDataset-agnosticMinortestTony WuTony Wu
HADOOP-12344Improve validateSocketPathSecurity0 error messageTrivialnetCasey BrothertonCasey Brotherton
HDFS-9398Make ByteArraryManager log message in one-line formatMinorhdfs-clientMingliang LiuMingliang Liu
HDFS-9234WebHdfs : getContentSummary() should give quota for storage typesMajorwebhdfsSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-9369Use ctest to run tests for hadoop-hdfs-native-clientMinor.Haohui MaiHaohui Mai
HADOOP-12562Make hadoop dockerfile usable by YetusMajorbuildAllen WittenauerAllen Wittenauer
YARN-4287Capacity Scheduler: Rack Locality improvementMajorcapacityschedulerNathan RobertsNathan Roberts
MAPREDUCE-5485Allow repeating job commit by extending OutputCommitter APICritical.Nemon LouJunping Du
MAPREDUCE-6499Add elapsed time for retired job in JobHistoryServer WebUIMajorwebappsYiqun LinYiqun Lin
HDFS-9252Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.Major.Lei (Eddy) XuLei (Eddy) Xu
HADOOP-12568Update core-default.xml to describe posixGroups supportMinordocumentationWei-Chiu ChuangWei-Chiu Chuang
YARN-4279Mark ApplicationId and ApplicationAttemptId static methods as @Public, @UnstableMinorclientSteve LoughranSteve Loughran
HADOOP-12575Add build instruction for docker toolbox instead of boot2dockerTrivialdocumentationKai SasakiKai Sasaki
HDFS-8056Decommissioned dead nodes should continue to be counted as dead after NN restartMajor.Ming MaMing Ma
HADOOP-11901BytesWritable fails to support 2G chunks due to integer overflowMajor.Reynold XinReynold Xin
HDFS-9439Include status of closeAck into exception message in DataNode#runTrivial.Xiao ChenXiao Chen
HDFS-9402Switch DataNode.LOG to use slf4jMinor.Walter SuWalter Su
HDFS-3302Review and improve HDFS trash documentationMajordocumentationHarsh J
HADOOP-10035Cleanup TestFilterFileSystemMajor.Suresh SrinivasSuresh Srinivas
HADOOP-10555Add offset support to MurmurHashTrivial.Sergey ShelukhinSergey Shelukhin
HADOOP-10068Improve log4j regex in testFindContainingJarTrivial.Robert RatiRobert Rati
HDFS-9024Deprecate the TotalFiles metricMajor.Akira AjisakaAkira Ajisaka
HDFS-7988Replace usage of ExactSizeInputStream with LimitInputStream.Minor.Chris NaurothWalter Su
HDFS-9314Improve BlockPlacementPolicyDefault's picking of excess replicasMajor.Ming MaXiao Chen
MAPREDUCE-5870Support for passing Job priority through Application Submission Context in Mapreduce SideMajorclientSunil GSunil G
HDFS-9434Recommission a datanode with 500k blocks may pause NN for 30 secondsMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
YARN-4132Separate configs for nodemanager to resourcemanager connection timeout and retriesMajornodemanagerChang LiChang Li
HDFS-8512WebHDFS : GETFILESTATUS should return LocatedBlock with storage type infoMajorwebhdfsSumana SathishXiaoyu Yao
HADOOP-12600FileContext and AbstractFileSystem should be annotated as a Stable interface.BlockerfsChris NaurothChris Nauroth
HDFS-9269Update the documentation and wrapper for fuse-dfsMinorfuse-dfsWei-Chiu ChuangWei-Chiu Chuang
HDFS-9485Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of BlockMinornamenodeMingliang LiuMingliang Liu
HDFS-9490MiniDFSCluster should change block generation stamp via FsDatasetTestUtilsMinortestTony WuTony Wu
HDFS-8831Trash Support for deletion in HDFS encryption zoneMajorencryptionXiaoyu YaoXiaoyu Yao
HDFS-9474TestPipelinesFailover should not fail when printing debug messageMajor.Yongjun ZhangJohn Zhuge
YARN-3456Improve handling of incomplete TimelineEntitiesMinortimelineserverSteve LoughranVarun Saxena
HDFS-9527The return type of FSNamesystem.getBlockCollection should be changed to INodeFileMinornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-9472concat() API does not give proper exception messages on ./reserved relative pathMajornamenodeRakesh RRakesh R
HDFS-9532Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockActionTrivialdatanodeYongjun ZhangYongjun Zhang
HDFS-9528Cleanup namenode audit/log/exception messagesMinornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8860Remove unused Replica copyOnWrite codeMajor.Lei (Eddy) XuLei (Eddy) Xu
MAPREDUCE-6436JobHistory cache issueBlocker.Ryu KobayashiKai Sasaki
HADOOP-12639Imrpove JavaDoc for getTrimmedStringsTrivialutilBELUGA BEHRBELUGA BEHR
HDFS-9557Reduce object allocation in PB conversionMajorhdfs-clientDaryn SharpDaryn Sharp
YARN-4207Add a non-judgemental YARN app completion statusMajor.Sergey ShelukhinRich Haase
HDFS-9198Coalesce IBR processing in the NNMajornamenodeDaryn SharpDaryn Sharp
HDFS-9552Document types of permission checks performed for HDFS operations.MajordocumentationChris NaurothChris Nauroth
HADOOP-12570HDFS Secure Mode Documentation updatesMajordocumentationArpit AgarwalArpit Agarwal
YARN-4480Clean up some inappropriate importsMajor.Kai ZhengKai Zheng
YARN-4290Add -showDetails option to YARN Nodes CLI to print all nodes reports informationMajorclientWangda TanSunil G
YARN-4400AsyncDispatcher.waitForDrained should be finalTrivialyarnDaniel TempletonDaniel Templeton
MAPREDUCE-6584Remove trailing whitespaces from mapred-default.xmlMajordocumentationAkira AjisakaAkira Ajisaka
HADOOP-12686Update FileSystemShell documentation to mention the meaning of each columns of fs -duMinordocumentation, fsDaisuke KobayashiDaisuke Kobayashi
YARN-4544All the log messages about rolling monitoring interval are shown with WARN levelMinorlog-aggregation, nodemanagerTakashi OhnishiTakashi Ohnishi
YARN-4438Implement RM leader election with curatorMajor.Jian HeJian He
HDFS-9630DistCp minor refactoring and clean upMinordistcpKai ZhengKai Zheng
YARN-4582Label-related invalid resource request exception should be able to properly handled by applicationMajorschedulerBibin A ChundattBibin A Chundatt
HDFS-9569Log the name of the fsimage being loaded for better supportabilityTrivialnamenodeYongjun ZhangYongjun Zhang
MAPREDUCE-6473Job submission can take a long time during Cluster initializationMajorperformanceKuhu ShuklaKuhu Shukla
HDFS-9415Document dfs.cluster.administrators and dfs.permissions.superusergroupMajordocumentationArpit AgarwalXiaobing Zhou
HDFS-6054MiniQJMHACluster should not use static port to avoid binding failure in unit testMajortestBrandon LiYongjun Zhang
YARN-4492Add documentation for preemption supported in Capacity schedulerMinorcapacity schedulerNaganarasimha G RNaganarasimha G R
YARN-4371“yarn application -kill” should take multiple application idsMajor.Tsuyoshi OzawaSunil G
HDFS-9653Expose the number of blocks pending deletion through dfsadmin report commandMajorhdfs-client, toolsWeiwei YangWeiwei Yang
HADOOP-12731Remove useless boxing/unboxing codeMinorperformanceKousuke SarutaKousuke Saruta
HDFS-9654Code refactoring for HDFS-8578MinordatanodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-9706Log more details in debug logs in BlockReceiver's constructorMinor.Xiao ChenXiao Chen
HDFS-9638Improve DistCp Help and documentationMinordistcpWei-Chiu ChuangWei-Chiu Chuang
HDFS-9566Remove expensive ‘BlocksMap#getStorages(Block b, final DatanodeStorage.State state)’ methodMajornamenodeDaryn SharpDaryn Sharp
HDFS-9721Allow Delimited PB OIV tool to run upon fsimage that contains INodeReferenceMajor.Xiao ChenXiao Chen
HDFS-9669TcpPeerServer should respect ipc.server.listen.queue.sizeMajor.Elliott ClarkElliott Clark
HDFS-9715Check storage ID uniqueness on datanode startupMajordatanodeLei (Eddy) XuLei (Eddy) Xu
YARN-4662Document some newly added metricsMajor.Jian HeJian He
HDFS-9629Update the footer of Web UI to show year 2016Major.Xiao ChenXiao Chen
MAPREDUCE-6566Add retry support to mapreduce CLI toolMajor.Varun VasudevVarun Vasudev
HDFS-9726Refactor IBR code to a new classMinordatanodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-12772NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid ‘loc’ valuesMinor.Kuhu ShuklaKuhu Shukla
HADOOP-12758Extend CSRF Filter with UserAgent ChecksMajorsecurityLarry McCayLarry McCay
HDFS-9686Remove useless boxing/unboxing codeMinorperformanceKousuke SarutaKousuke Saruta
MAPREDUCE-6626Reuse ObjectMapper instance in MapReduceMinorperformanceYiqun LinYiqun Lin
HADOOP-12788OpensslAesCtrCryptoCodec should log which random number generator is used.Minor.Wei-Chiu ChuangWei-Chiu Chuang
HADOOP-12764Increase default value of KMS maxHttpHeaderSize and make it configurableMinor.Zhe ZhangZhe Zhang
HADOOP-12776Remove getaclstatus call for non-acl commands in getfacl.Major.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-9768Reuse objectMapper instance in HDFS to improve the performanceMajorperformanceYiqun LinYiqun Lin
HDFS-9644Update encryption documentation to reflect nested EZsMajordocumentation, encryptionZhe ZhangZhe Zhang
HDFS-9700DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocolMajorhdfs-clientGary HelmlingGary Helmling
HDFS-9797Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG LevelMinorhdfs-clientInigo GoiriInigo Goiri
YARN-4682AMRM client to log when AMRM token updatedMajorclientSteve LoughranPrabhu Joseph
HADOOP-12805Annotate CanUnbuffer with @InterfaceAudience.PublicMajor.Ted YuTed Yu
YARN-4690Skip object allocation in FSAppAttempt#getResourceUsage when possibleMajor.Ming MaMing Ma
HADOOP-10865Add a Crc32 chunked verification benchmark for both directly and non-directly buffer casesMinorutilTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-4946Allow preferLocalNode in BlockPlacementPolicyDefault to be configurableMajornamenodeJames KinleyNathan Roberts
HADOOP-11031Design Document for Credential Provider APIMajorsiteLarry McCayLarry McCay
HADOOP-12828Print user when services are startedTrivial.Brandon LiWei-Chiu Chuang
HADOOP-12794Support additional compression levels for GzipCodecMajorioRavi MutyalaRavi Mutyala
HDFS-9425Expose number of blocks per volume as a metricMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12668Support excluding weak Ciphers in HttpServer2 through ssl-server.confCriticalsecurityVijay SinghVijay Singh
HADOOP-12555WASB to read credentials from a credential providerMinorfs/azureChris NaurothLarry McCay
HDFS-8578On upgrade, Datanode should process all storage/data dirs in parallelCriticaldatanodeRaju BairishettiVinayakumar B
HADOOP-12535Run FileSystem contract tests with hadoop-azure.Majorfs/azure, testChris Naurothmadhumita chakraborty
HDFS-9854Log cipher suite negotiation more verboselyMajorencryptionWei-Chiu ChuangWei-Chiu Chuang
HDFS-9843Document distcp options required for copying between encrypted locationsMajordistcp, documentation, encryptionXiaoyu YaoXiaoyu Yao
HADOOP-12824Collect network and disk usage on the node running WindowsMajor.Inigo GoiriInigo Goiri
YARN-4720Skip unnecessary NN operations in log aggregationMajor.Ming MaJun Gong
HDFS-9831Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122Majordocumentation, webhdfsXiaoyu YaoXiaobing Zhou
HDFS-9710Change DN to send block receipt IBRs in batchesMajordatanodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
MAPREDUCE-6622Add capability to set JHS job cache to a task-based limitCriticaljobhistoryserverRay ChiangRay Chiang
HADOOP-12825Log slow name resolutionsMajor.Sidharta SeethanaSidharta Seethana
YARN-4671There is no need to acquire CS lock when completing a containerMajor.MENG DINGMENG DING
HADOOP-12853Change WASB documentation regarding page blob supportMinorfs/azuremadhumita chakrabortymadhumita chakraborty
HDFS-9887WebHdfs socket timeouts should be configurableMajorfs, webhdfsAustin DonnellyAustin Donnelly
HADOOP-12859Disable hiding field style checks in class settersMajor.Kai ZhengKai Zheng
HDFS-9534Add CLI command to clear storage policy from a path.MajortoolsChris NaurothXiaobing Zhou
HADOOP-12793Write a new group mapping service guideMajordocumentationWei-Chiu ChuangWei-Chiu Chuang
HADOOP-12470In-page TOC of documentation should be automatically generated by doxia macroMajordocumentationMasatake IwasakiMasatake Iwasaki
HDFS-9889Update balancer/mover document about HDFS-6133 featureMinor.Yongjun ZhangYongjun Zhang
MAPREDUCE-6648Add yarn.app.mapreduce.am.log.level to mapred-default.xmlTrivialdocumentationHarsh JHarsh J
HDFS-9906Remove spammy log spew when a datanode is restartedMajornamenodeElliott ClarkBrahma Reddy Battula
HADOOP-12901Add warning log when KMSClientProvider cannot create a connection to the KMS serverMinor.Xiao ChenXiao Chen
HADOOP-12789log classpath of ApplicationClassLoader at INFO levelMinorutilSangjin LeeSangjin Lee
HDFS-9882Add heartbeatsTotal in Datanode metricsMinordatanodeHua LiuHua Liu
HADOOP-12860Expand section “Data Encryption on HTTP” in SecureMode documentationMinor.Wei-Chiu ChuangWei-Chiu Chuang
YARN-4465SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabledMinor.Bibin A ChundattBibin A Chundatt
HADOOP-12904Update Yetus to 0.2.0BlockerbuildAllen WittenauerAllen Wittenauer
HADOOP-12798Update changelog and release notes (2016-03-04)MajordocumentationAllen WittenauerAllen Wittenauer
HADOOP-12905Clean up CHANGES.txt RAT exclusions from pom.xml files.TrivialbuildChris NaurothChris Nauroth
HDFS-9927Document the new OIV ReverseXML processorMinordocumentationWei-Chiu ChuangWei-Chiu Chuang
HDFS-9942Add an HTrace span when refreshing the groups for a usernameMajor.Colin P. McCabeColin P. McCabe
HDFS-9941Do not log StandbyException on NN, other minor logging fixesMajornamenodeArpit AgarwalArpit Agarwal
HADOOP-12923Move the test code in ipc.Client to testMinoripcTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-9405Warmup NameNode EDEK caches in background threadMajorencryption, namenodeZhe ZhangXiao Chen
HDFS-9951Use string constants for XML tags in OfflineImageReconstructorMinor.Yiqun LinYiqun Lin
HADOOP-12947Update documentation Hadoop Groups Mapping to add static group mapping, negative cacheMinordocumentation, securityWei-Chiu ChuangWei-Chiu Chuang
YARN-4117End to end unit test with mini YARN cluster for AMRMProxy ServiceMajornodemanager, resourcemanagerKishore ChaliparambilGiovanni Matteo Fumarola
HADOOP-10965Print fully qualified path in CommandWithDestination error messagesMinor.André KelpeJohn Zhuge
MAPREDUCE-6663[NNBench] Refactor nnbench as a Tool implementation.Major.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12886Exclude weak ciphers in SSLFactory through ssl-server.xmlMajor.Wei-Chiu ChuangWei-Chiu Chuang
YARN-4884Fix missing documentation about rmadmin command regarding node labelsMinor.Kai SasakiKai Sasaki
HADOOP-12916Allow RPC scheduler/callqueue backoff using response timesMajoripcXiaoyu YaoXiaoyu Yao
HADOOP-12950ShutdownHookManager should have a timeout for each of the Registered shutdown hookMajor.Xiaoyu YaoXiaoyu Yao
HADOOP-11661Deprecate FileUtil#copyMergeMajorutilBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-11687Ignore x-* and response headers when copying an Amazon S3 objectMajorfs/s3Denis JannotHarsh J
HADOOP-11212NetUtils.wrapException to handle SocketException explicitlyMajorutilSteve LoughranSteve Loughran
HADOOP-12672RPC timeout should not override IPC ping intervalMajoripcMasatake IwasakiMasatake Iwasaki
HDFS-10235[NN UI] Last contact for Live Nodes should be relative timeMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-8813RPC Server and Client classes need InterfaceAudience and InterfaceStability annotationsTrivialipcBrandon LiBrandon Li
YARN-4756Unnecessary wait in Node Status Updater during rebootMajor.Eric BadgerEric Badger
HADOOP-12951Improve documentation on KMS ACLs and delegation tokensMajor.Xiao ChenXiao Chen
HADOOP-12994Specify PositionedReadable, add contract tests, fix problemsMajorfsSteve LoughranSteve Loughran
YARN-4630Remove useless boxing/unboxing codeMinoryarnKousuke SarutaKousuke Saruta
HDFS-10279Improve validation of the configured number of tolerated failed volumesMajor.Yiqun LinYiqun Lin
HADOOP-12822Change “Metrics intern cache overflow” log level from WARN to INFOMinormetricsAkira AjisakaAndras Bokor
HADOOP-12969Mark IPC.Client and IPC.Server as @Public, @EvolvingMinoripcXiaobing ZhouXiaobing Zhou
HADOOP-12963Allow using path style addressing for accessing the s3 endpointMinorfs/s3Andrew BaptistStephen Montgomery
HDFS-10280Document new dfsadmin command -evictWritersMinordocumentationWei-Chiu ChuangWei-Chiu Chuang
HDFS-10292Add block id when client got Unable to close file exceptionMinor.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-9412getBlocks occupies FSLock and takes too long to completeMajor.He TianyiHe Tianyi
HDFS-10302BlockPlacementPolicyDefault should use default replication considerload valueTrivial.Yiqun LinYiqun Lin
HDFS-10264Logging improvements in FSImageFormatProtobuf.SaverMajornamenodeKonstantin ShvachkoXiaobing Zhou
HADOOP-12985Support MetricsSource interface for DecayRpcScheduler MetricsMajor.Xiaoyu YaoXiaoyu Yao
HDFS-9894Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivativesMajor.Xiaobing ZhouXiaobing Zhou
HADOOP-12891S3AFileSystem should configure Multipart Copy threshold and chunk sizeMajorfs/s3Andrew OlsonAndrew Olson
HADOOP-13033Add missing Javadoc enries to Interns.javaMinormetricsAndras BokorAndras Bokor
HDFS-10298Document the usage of distcp -diff optionMajordistcp, documentationAkira AjisakaTakashi Ohnishi
HADOOP-13039Add documentation for configuration property ipc.maximum.data.length for controlling maximum RPC message size.MajordocumentationChris NaurothMingliang Liu
HDFS-10330Add Corrupt Blocks Information in Metasave OutputMajor.Kuhu ShuklaKuhu Shukla
HADOOP-5470RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed fileMinorutilColin EvansAndras Bokor
HDFS-3702Add an option for NOT writing the blocks locally if there is a datanode on the same box as the clientMinorhdfs-clientNicolas LiochonLei (Eddy) Xu
HDFS-10297Increase default balance bandwidth and concurrent movesMinorbalancer & moverJohn ZhugeJohn Zhuge
HADOOP-12957Limit the number of outstanding async callsMajoripcXiaobing ZhouXiaobing Zhou
HDFS-9902Support different values of dfs.datanode.du.reserved per storage typeMajordatanodePan YuxuanBrahma Reddy Battula
HADOOP-13103Group resolution from LDAP may fail on javax.naming.ServiceUnavailableExceptionMinorsecurityTsz Wo Nicholas SzeTsz Wo Nicholas Sze
MAPREDUCE-6678Allow ShuffleHandler readahead without drop-behindMajornodemanagerNathan RobertsNathan Roberts
HADOOP-12982Document missing S3A and S3 propertiesMinordocumentation, fs/s3, toolsWei-Chiu ChuangWei-Chiu Chuang
YARN-4995FairScheduler: Display per-queue demand on the scheduler pageMinor.xupengxupeng
HADOOP-12868Fix hadoop-openstack undeclared and unused dependenciesMajortoolsAllen WittenauerMasatake Iwasaki
HADOOP-12971FileSystemShell doc should explain relative pathCriticaldocumentationJohn ZhugeJohn Zhuge
HADOOP-13148TestDistCpViewFs to include IOExceptions in test error reportsMinortools/distcpSteve LoughranSteve Loughran
HADOOP-13146Refactor RetryInvocationHandlerMinorioTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-10383Safely close resources in DFSTestUtilMajortestMingliang LiuMingliang Liu
YARN-4002make ResourceTrackerService.nodeHeartbeat more concurrentCritical.Hong ZhiguoHong Zhiguo
HDFS-10417Improve error message from checkBlockLocalPathAccessMinordatanodeTianyin XuTianyin Xu
HADOOP-13168Support Future.get with timeout in ipc async callsMajoripcTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-13145In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.Majortools/distcpChris NaurothChris Nauroth
HADOOP-13198Add support for OWASP's dependency-checkMinorbuild, securityMike YoderMike Yoder
HDFS-10217show ‘blockScheduled’ tooltip in datanodes table.Major.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-13199Add doc for distcp -filtersTrivialdocumentationJohn ZhugeJohn Zhuge
HADOOP-13193Upgrade to Apache Yetus 0.3.0Majordocumentation, testAllen WittenauerKengo Seki
HDFS-10341Add a metric to expose the timeout number of pending replication blocksMajor.Akira AjisakaAkira Ajisaka
HADOOP-13105Support timeouts in LDAP queries in LdapGroupsMapping.MajorsecurityChris NaurothMingliang Liu
HADOOP-12807S3AFileSystem should read AWS credentials from environment variablesMinorfs/s3Tobin BakerTobin Baker
MAPREDUCE-5044Have AM trigger jstack on task attempts that timeout before killing themMajormr-amJason LoweEric Payne
HADOOP-10048LocalDirAllocator should avoid holding locks while accessing the filesystemMajor.Jason LoweJason Lowe
MAPREDUCE-6714Refactor UncompressedSplitLineReader.fillBuffer()Major.Daniel TempletonDaniel Templeton
HADOOP-12943Add -w -r options in dfs -test commandMajorfs, scripts, toolsWeiwei YangWeiwei Yang
HDFS-10493Add links to datanode web UI in namenode datanodes pageMajornamenode, uiWeiwei YangWeiwei Yang
HADOOP-13296Cleanup javadoc for PathMinordocumentationDaniel TempletonDaniel Templeton
HDFS-7597DelegationTokenIdentifier should cache the TokenIdentifier to UGI mappingCriticalwebhdfsDaryn SharpDaryn Sharp
HADOOP-13307add rsync to Dockerfile so that precommit archive worksTrivialbuildAllen WittenauerAllen Wittenauer
HADOOP-13067cleanup the dockerfileMajor.Allen WittenauerAllen Wittenauer
HADOOP-13227AsyncCallHandler should use an event driven architecture to handle async callsMajorio, ipcTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-13263Reload cached groups in background after expiryMajor.Stephen O'DonnellStephen O'Donnell
HDFS-10440Improve DataNode web UIMajordatanode, uiWeiwei YangWeiwei Yang
HADOOP-13239Deprecate s3:// in branch-2Majorfs/s3Mingliang LiuMingliang Liu
HDFS-10582Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands DocMinordocumentationPan YuxuanPan Yuxuan
HDFS-10488Update WebHDFS documentation regarding CREATE and MKDIR default permissionsMinordocumentation, webhdfsWellington ChevreuilWellington Chevreuil
HDFS-10300TestDistCpSystem should share MiniDFSClusterTrivialtestJohn ZhugeJohn Zhuge
HADOOP-13290Appropriate use of generics in FairCallQueueMajoripcKonstantin ShvachkoJonathan Hung
HADOOP-13289Remove unused variables in TestFairCallQueueMinortestKonstantin ShvachkoYe Zhou
HDFS-10628Log HDFS Balancer exit message to its own logMinorbalancer & moverJiayi ZhouJiayi Zhou
HADOOP-13298Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/Minor.Xiao ChenTsuyoshi Ozawa
YARN-4883Make consistent operation name in AdminServiceMinorresourcemanagerKai SasakiKai Sasaki
YARN-1126Add validation of users input nodes-states options to nodes CLIMajor.Wei YanWei Yan
HDFS-10287MiniDFSCluster should implement AutoCloseableMinortestJohn ZhugeAndras Bokor
HDFS-10225DataNode hot swap drives should disallow storage type changes.MajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-10660Expose storage policy apis via HDFSAdmin interfaceMajor.Rakesh RRakesh R
HDFS-9937Update dfsadmin command line help and HdfsQuotaAdminGuideMinor.Wei-Chiu ChuangKai Sasaki
HDFS-10667Report more accurate info about data corruption locationMajordatanode, hdfsYongjun ZhangYuanbo Liu
HDFS-10676Add namenode metric to measure time spent in generating EDEKsMajornamenodeHanisha KoneruHanisha Koneru
MAPREDUCE-6746Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsetsMinor.Vincent PoonVincent Poon
HDFS-10703HA NameNode Web UI should show last checkpoint timeMinoruiJohn ZhugeJohn Zhuge
MAPREDUCE-6729Accurately compute the test execute time in DFSIOMinorbenchmarks, performance, testmingleizhangmingleizhang
HADOOP-13444Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsetsMinor.Vincent PoonVincent Poon
YARN-5456container-executor support for FreeBSD, NetBSD, and others if conf path is absoluteMajornodemanager, securityAllen WittenauerAllen Wittenauer
MAPREDUCE-6730Use StandardCharsets instead of String overload in TextOutputFormatMinor.Sahil KangSahil Kang
HDFS-10707Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsetsMinor.Vincent PoonVincent Poon
HADOOP-13442Optimize UGI group lookupsMajor.Daryn SharpDaryn Sharp
HADOOP-13466Add an AutoCloseableLock classMajor.Chen LiangChen Liang
YARN-5483Optimize RMAppAttempt#pullJustFinishedContainersMajor.sandfleesandflee
HADOOP-13190Mention LoadBalancingKMSClientProvider in KMS HA documentationMajordocumentation, kmsWei-Chiu ChuangWei-Chiu Chuang
HDFS-10677Über-jira: Enhancements to NNThroughputBenchmark toolMajorbenchmarks, toolsMingliang LiuMingliang Liu
HDFS-10342BlockManager#createLocatedBlocks should not check corrupt replicas if none are corruptMajorhdfsDaryn SharpKuhu Shukla
HDFS-10682Replace FsDatasetImpl object lock with a separate lock objectMajordatanodeChen LiangChen Liang
HADOOP-13503Improve SaslRpcClient failure loggingMajorsecurityXiaobing ZhouXiaobing Zhou
HADOOP-13527Add Spark to CallerContext LimitedPrivate scopeMinoripcWeiqing YangWeiqing Yang
MAPREDUCE-6587Remove unused params in connection-related methods of FetcherMinor.Yiqun LinYiqun Lin
HADOOP-13538Deprecate getInstance and initialize methods with Path in TrashPolicyMinor.Yiqun LinYiqun Lin
HDFS-8986Add option to -du to calculate directory space usage excluding snapshotsMajorsnapshotsGautam GopalakrishnanXiao Chen
HDFS-10798Make the threshold of reporting FSNamesystem lock contention configurableMajorlogging, namenodeZhe ZhangErik Krogen
YARN-5550TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERNMinorclient, testJonathan HungJonathan Hung
HDFS-10814Add assertion for getNumEncryptionZones when no EZ is createdMinortestVinitha Reddy GankidiVinitha Reddy Gankidi
HDFS-10817Add Logging for Long-held NN Read LocksMajorlogging, namenodeErik KrogenErik Krogen
HADOOP-13465Design Server.Call to be extensible for unified call queueMajoripcDaryn SharpDaryn Sharp
HDFS-10833Fix JSON errors in WebHDFS.md examplesTrivialdocumentationAndrew WangAndrew Wang
HDFS-10742Measure lock time in FsDatasetImplMajordatanodeChen LiangChen Liang
HDFS-10831Add log when URLConnectionFactory.openConnection failedMinorwebhdfsyunjiong zhaoyunjiong zhao
HADOOP-13598Add eol=lf for unix format files in .gitattributesMajor.Akira AjisakaYiqun Lin
HADOOP-13580If user is unauthorized, log “unauthorized” instead of “Invalid signed text:”MinorsecurityWei-Chiu ChuangWei-Chiu Chuang
HDFS-10489Deprecate dfs.encryption.key.provider.uri for HDFS encryption zonesMinor.Xiao ChenXiao Chen
YARN-5540scheduler spends too much time looking at empty prioritiesMajorcapacity scheduler, fairscheduler, resourcemanagerNathan RobertsJason Lowe
HADOOP-13169Randomize file list in SimpleCopyListingMinortools/distcpRajesh BalamohanRajesh Balamohan
HDFS-10875Optimize du -x to cache intermediate resultMajorsnapshotsXiao ChenXiao Chen
YARN-4591YARN Web UIs should provide a robots.txtTrivial.Lars FranckeSidharta Seethana
YARN-5622TestYarnCLI.testGetContainers fails due to mismatched date formatsMinor.Eric BadgerEric Badger
HDFS-10876Dispatcher#dispatch should log IOException stacktraceTrivialbalancer & moverWei-Chiu ChuangManoj Govindassamy
YARN-3692Allow REST API to set a user generated message when killing an applicationMajor.Rajat JainRohith Sharma K S
HDFS-10869Remove the unused method InodeId#checkId()MajornamenodeJagadesh Kiran NJagadesh Kiran N
YARN-3877YarnClientImpl.submitApplication swallows exceptionsMinorclientSteve LoughranVarun Saxena
HADOOP-13658Replace config key literal strings with config key names I: hadoop commonMinorconfChen LiangChen Liang
HADOOP-13537Support external calls in the RPC call queueMajoripcDaryn SharpDaryn Sharp
HADOOP-13317Add logs to KMS server-side to improve supportabilityMinorkmsXiao ChenSuraj Acharya
HDFS-10940Reduce performance penalty of block caching when not usedMajornamenodeDaryn SharpDaryn Sharp
YARN-4855Should check if node exists when replace nodelabelsMinor.Tao JieTao Jie
HDFS-10690Optimize insertion/removal of replica in ShortCircuitCacheMajorhdfs-clientFenghua HuFenghua Hu
HADOOP-13685Document -safely option of rm command.Major.Xiaoyu YaoXiaoyu Yao
MAPREDUCE-6741add MR support to redact job conf propertiesMajormrv2Haibo ChenHaibo Chen
HDFS-10963Reduce log level when network topology cannot find enough datanodes.Minor.Xiao ChenXiao Chen
HADOOP-13323Downgrade stack trace on FS load from Warn to debugMinorfsSteve LoughranSteve Loughran
HADOOP-13150Avoid use of toString() in output of HDFS ACL shell commands.Minor.Chris NaurothChris Nauroth
HADOOP-13689Do not attach javadoc and sources jars during non-dist buildMajor.Andrew WangAndrew Wang
HADOOP-13641Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentationMinor.Xiao ChenHuafeng Wang
HDFS-10933Refactor TestFsckMinor.Takanobu AsanumaTakanobu Asanuma
HADOOP-13684Snappy may complain Hadoop is built without snappy if libhadoop is not found.Minor.Wei-Chiu ChuangWei-Chiu Chuang
HADOOP-13698Document caveat for KeyShell when underlying KeyProvider does not delete a keyMinordocumentation, kmsXiao ChenXiao Chen
HDFS-10789Route webhdfs through the RPC call queueMajoripc, webhdfsDaryn SharpDaryn Sharp
HDFS-10903Replace config key literal strings with config key names II: hadoop hdfsMinor.Mingliang LiuChen Liang
HADOOP-13710Supress CachingGetSpaceUsed from logging interrupted exception stacktraceMinorfsWei-Chiu ChuangHanisha Koneru
YARN-5599Publish AM launch command to ATSMajor.Daniel TempletonRohith Sharma K S
HDFS-11012Unnecessary INFO logging on DFSClients for InvalidTokenMinorfsHarsh JHarsh J
HDFS-11003Expose “XmitsInProgress” through DataNodeMXBeanMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-13724Fix a few typos in site markdown documentsMinordocumentationAndrew WangDing Fei
HDFS-11009Add a tool to reconstruct block meta file from CLIMajordatanodeXiao ChenXiao Chen
HDFS-9480Expose nonDfsUsed via StorageTypeStatsMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12082Support multiple authentication schemes via AuthenticationFilterMajorsecurityHrishikesh GadreHrishikesh Gadre
HADOOP-13669KMS Server should log exceptions before throwingMajorkmsXiao ChenSuraj Acharya
HADOOP-13502Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests.MinortestChris NaurothChris Nauroth
HADOOP-13017Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0Majorfs, ioSteve LoughranSteve Loughran
HDFS-11055Update default-log4j.properties for httpfs to imporve test loggingMajorhttpfs, testWei-Chiu ChuangWei-Chiu Chuang
YARN-4963capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurableMajorcapacityschedulerNathan RobertsNathan Roberts
HDFS-11047Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNodeMajordatanodeXiaobing ZhouXiaobing Zhou
MAPREDUCE-6799Document mapreduce.jobhistory.webapp.https.address in mapred-default.xmlMinordocumentation, jobhistoryserverAkira AjisakaYiqun Lin
HADOOP-12325RPC Metrics : Add the ability track and log slow RPCsMajoripc, metricsAnu EngineerAnu Engineer
HDFS-11074Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorageMajordatanodeArpit AgarwalHanisha Koneru
MAPREDUCE-6795Update the document for JobConf#setNumReduceTasksMajordocumentationAkira AjisakaYiqun Lin
HADOOP-13603Ignore package line length checkstyle ruleMajorbuildShane KumpfShane Kumpf
HADOOP-13583Incorporate checkcompatibility script which runs Java API Compliance CheckerMajorscriptsAndrew WangAndrew Wang
HDFS-11080Update HttpFS to use ConfigRedactorMajor.Sean MackrorySean Mackrory
YARN-5697Use CliParser to parse options in RMAdminCLIMajor.Tao JieTao Jie
HADOOP-12453Support decoding KMS Delegation Token with its own IdentifierMajorkms, securityXiaoyu YaoXiaoyu Yao
HADOOP-7930Kerberos relogin interval in UserGroupInformation should be configurableMajorsecurityAlejandro AbdelnurRobert Kanter
YARN-5720Update document for “rmadmin -replaceLabelOnNode”Minor.Tao JieTao Jie
HADOOP-13782Make MutableRates metrics thread-local write, aggregate-on-readMajormetricsErik KrogenErik Krogen
HADOOP-13590Retry until TGT expires even if the UGI renewal thread encountered exceptionMajorsecurityXiao ChenXiao Chen
HDFS-11120TestEncryptionZones should waitActiveMinortestXiao ChenJohn Zhuge
HADOOP-13720Add more info to the msgs printed in AbstractDelegationTokenSecretManager for better supportabilityTrivialcommon, securityYongjun ZhangYongjun Zhang
HDFS-10941Improve BlockManager#processMisReplicatesAsync logMajornamenodeXiaoyu YaoChen Liang
HADOOP-13810Add a test to verify that Configuration handles &-encoded charactersMinortestSteve LoughranSteve Loughran
HADOOP-13742Expose “NumOpenConnectionsPerUser” as a metricMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-13646Remove outdated overview.htmlMinor.Akira AjisakaBrahma Reddy Battula
HADOOP-13166add getFileStatus(“/”) test to AbstractContractGetFileStatusTestMinorfs, testSteve LoughranSteve Loughran
HADOOP-11603Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initializedMinormetricsBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-10776Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projectsBlocker.Robert Joseph EvansVinod Kumar Vavilapalli
HDFS-11175Document uppercase key names are not supported in TransparentEncryption.mdMinordocumentationYuanbo LiuYiqun Lin
HADOOP-13790Make qbt script executableTrivialscriptsAndrew WangAndrew Wang
HDFS-8674Improve performance of postponed block scansCriticalnamenodeDaryn SharpDaryn Sharp
HDFS-10581Hide redundant table on NameNode WebUI when no nodes are decomissioningTrivialhdfs, uiWeiwei YangWeiwei Yang
HDFS-11217Annotate NameNode and DataNode MXBean interfaces as Private/StableMajor.Akira AjisakaJagadesh Kiran N
HADOOP-13900Remove snapshot version of SDK dependency from Azure Data Lake Store File SystemMajorfs/adlVishwajeet DusaneVishwajeet Dusane
HDFS-11249Redundant toString() in DFSConfigKeys.javaTrivial.Akira AjisakaJagadesh Kiran N
YARN-5882Test only changes from YARN-4126Major.Andrew WangJian He
HDFS-11262Remove unused variables in FSImage.javaTrivial.Akira AjisakaJagadesh Kiran N
YARN-4994Use MiniYARNCluster with try-with-resources in testsTrivialtestAndras BokorAndras Bokor
YARN-5709Cleanup leader election configs and pluggabilityCriticalresourcemanagerKarthik KambatlaKarthik Kambatla
HDFS-9483Documentation does not cover use of “swebhdfs” as URL scheme for SSL-secured WebHDFS.MajordocumentationChris NaurothSurendra Singh Lilhore
HDFS-11292log lastWrittenTxId etc info in logSyncAllMajorhdfsYongjun ZhangYongjun Zhang
HADOOP-13956Read ADLS credentials from Credential ProviderCriticalfs/adlJohn ZhugeJohn Zhuge
HADOOP-13962Update ADLS SDK to 2.1.4Majorfs/adlJohn ZhugeJohn Zhuge
HADOOP-13037Refactor Azure Data Lake Store as an independent FileSystemMajorfs/adlShrikant NaiduVishwajeet Dusane
HADOOP-13946Document how HDFS updates timestamps in the FS spec; compare with object storesMinordocumentation, fsSteve LoughranSteve Loughran
HDFS-10601Improve log message to include hostname when the NameNode is in safemodeMinor.Kuhu ShuklaKuhu Shukla

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-8818Should use equals() rather than == to compare String or Text in MD5MD5CRC32FileChecksum and TFileDumperMinorfs, ioBrandon LiBrandon Li
HADOOP-8436NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configuredMajorfsBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-9121InodeTree.java has redundant check for vName while throwing exceptionMajorfsArup MalakarArup Malakar
HADOOP-9242Duplicate surefire plugin config in hadoop-commonMajortestAndrey KlochkovAndrey Klochkov
HADOOP-8419GzipCodec NPE upon reset with IBM JDKMajorioLuke LuYu Li
HDFS-4366Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority BlocksMajor.Derek DagitDerek Dagit
HADOOP-11559Add links to RackAwareness and InterfaceClassification to site indexMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-11581Fix Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.LsMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-11568Description on usage of classpath in hadoop command is incomplete.TrivialtoolsArchana TArchana T
HADOOP-10027*Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectFieldMinornativeEric AbbottHui Zheng
HDFS-5356MiniDFSCluster shoud close all open FileSystems when shutdown()CriticaltesthaosdentRakesh R
YARN-3197Confusing log generated by CapacitySchedulerMinorcapacityschedulerHitesh ShahVarun Saxena
YARN-3243CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.Majorcapacityscheduler, resourcemanagerWangda TanWangda Tan
YARN-3305AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocationMajorschedulerRohith Sharma K SRohith Sharma K S
YARN-3205FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration.Majorresourcemanagerzhihai xuzhihai xu
MAPREDUCE-5807Print usage for TeraSort job.TrivialexamplesRohith Sharma K SRohith Sharma K S
YARN-3351AppMaster tracking URL is broken in HAMajorwebappAnubhav DhootAnubhav Dhoot
HDFS-7867Update action param from “start” to “prepare” in rolling upgrade javadocTrivial.J.AndreinaJ.Andreina
MAPREDUCE-6281Fix javadoc in TerasortTrivial.Albert ChuAlbert Chu
YARN-3269Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified pathMajor.Xuan GongXuan Gong
MAPREDUCE-6213NullPointerException caused by job history server addr not resolvableMinorapplicationmasterPeng ZhangPeng Zhang
MAPREDUCE-5448MapFileOutputFormat#getReaders bug with invisible files/foldersMinormrv2Maysam YabandehMaysam Yabandeh
MAPREDUCE-6242Progress report log is incredibly excessive in application masterMajorapplicationmasterJian FangVarun Saxena
HDFS-3325When configuring “dfs.namenode.safemode.threshold-pct” to a value greater or equal to 1 there is mismatch in the UI reportMinor.J.AndreinaJ.Andreina
YARN-3383AdminService should use “warn” instead of “info” to log exception when operation failsMajorresourcemanagerWangda TanLi Lu
YARN-3397yarn rmadmin should skip -failoverMinorresourcemanagerJ.AndreinaJ.Andreina
HADOOP-11724DistCp throws NPE when the target directory is root.Minor.Lei (Eddy) XuLei (Eddy) Xu
YARN-3400[JDK 8] Build Failure due to unreported exceptions in RPCUtilMajor.Robert KanterRobert Kanter
HDFS-7990IBR delete ack should not be delayedMajornamenodeDaryn SharpDaryn Sharp
HADOOP-11760Fix typo of javadoc in DistCpTrivial.Chen HeBrahma Reddy Battula
MAPREDUCE-6294Remove an extra parameter described in Javadoc of TockenCacheTrivial.Chen HeBrahma Reddy Battula
HDFS-7501TransactionsSinceLastCheckpoint can be negative on SBNsMajornamenodeHarsh JGautam Gopalakrishnan
HDFS-8002Website refers to /trash directoryMajordocumentationMike DrobBrahma Reddy Battula
HDFS-7261storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()Major.Ted YuBrahma Reddy Battula
HDFS-7997The first non-existing xattr should also throw IOExceptionMinor.zhouyingchaozhouyingchao
HDFS-6945BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removedCriticalnamenodeAkira AjisakaAkira Ajisaka
YARN-3425NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failedMinorresourcemanagerBibin A ChundattBibin A Chundatt
HDFS-7922ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutorsMajor.Rakesh RRakesh R
HDFS-8026Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunkMinor.Colin P. McCabeColin P. McCabe
YARN-3415Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queueCriticalfairschedulerRohit Agarwalzhihai xu
HADOOP-11797releasedocmaker.py needs to put ASF headers on outputMajorbuildAllen WittenauerAllen Wittenauer
HADOOP-11800Clean up some test methods in TestCodec.javaMajortestAkira AjisakaBrahma Reddy Battula
MAPREDUCE-4844Counters / AbstractCounters have constant references not declared finalMajor.Gera ShegalovBrahma Reddy Battula
YARN-3435AM container to be allocated Appattempt AM container shown as nullTrivialresourcemanagerBibin A ChundattBibin A Chundatt
YARN-3429TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMTokenMajortestzhihai xuzhihai xu
HDFS-5215dfs.datanode.du.reserved is not considered while computing available spaceMajordatanodeBrahma Reddy BattulaBrahma Reddy Battula
YARN-3457NPE when NodeManager.serviceInit fails and stopRecoveryStore calledMinornodemanagerBibin A ChundattBibin A Chundatt
YARN-3459Fix failiure of TestLog4jWarningErrorMetricsAppenderBlocker.Li LuVarun Vasudev
HDFS-8046Allow better control of getContentSummaryMajor.Kihwal LeeKihwal Lee
YARN-2890MiniYarnCluster should turn on timeline service if configured to do soMajor.Mit DesaiMit Desai
HDFS-7725Incorrect “nodes in service” metrics caused all writes to failMajor.Ming MaMing Ma
HDFS-8096DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfersMajordatanodeVinayakumar BVinayakumar B
YARN-3465Use LinkedHashMap to preserve order of resource requestsMajornodemanagerzhihai xuzhihai xu
HDFS-8099Change “DFSInputStream has been closed already” message to debug log levelMinorhdfs-clientCharles LambCharles Lamb
HDFS-8091ACLStatus and XAttributes not properly presented to INodeAttributesProvider before returning to clientMajornamenodeArun SureshArun Suresh
MAPREDUCE-6266Job#getTrackingURL should consistently return a proper URLMinor.Ray ChiangRay Chiang
HDFS-8081Split getAdditionalBlock() into two methods.Major.Konstantin ShvachkoKonstantin Shvachko
HDFS-7939Two fsimage_rollback_* files are created which are not deleted after rollback.Critical.J.AndreinaJ.Andreina
MAPREDUCE-6314TestPipeApplication fails on trunkMajortestVarun VasudevVarun Vasudev
YARN-3466Fix RM nodes web page to sort by node HTTP-address, #containers and node-label columnMajorresourcemanager, webappJason LoweJason Lowe
HDFS-7931DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabledMinorhdfs-clientArun SureshArun Suresh
HDFS-8111NPE thrown when invalid FSImage filename given for “hdfs oiv_legacy” cmdMinortoolsArchana TSurendra Singh Lilhore
HADOOP-11811Fix typos in hadoop-project/pom.xml and TestAccessControlListMinor.Chen HeBrahma Reddy Battula
YARN-3382Some of UserMetricsInfo metrics are incorrectly set to root queue metricsMajorwebappRohit AgarwalRohit Agarwal
YARN-3472Possible leak in DelegationTokenRenewer#allTokensMajor.Jian HeRohith Sharma K S
YARN-3394WebApplication proxy documentation is incompleteMinorresourcemanagerBibin A ChundattNaganarasimha G R
HADOOP-11819HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist.Minor.Rohith Sharma K SRohith Sharma K S
HDFS-6666Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.Minordatanode, namenode, securityChris NaurothVijay Bhat
HDFS-8055NullPointerException when topology script is missing.MajornamenodeAnu EngineerAnu Engineer
YARN-3266RMContext inactiveNodes should have NodeId as map keyMajorresourcemanagerChengbing LiuChengbing Liu
YARN-3436Fix URIs in documention of YARN web service REST APIsMinordocumentation, resourcemanagerBibin A ChundattBibin A Chundatt
HDFS-8127NameNode Failover during HA upgrade can cause DataNode to finalize upgradeBlockerhaJing ZhaoJing Zhao
YARN-3462Patches applied for YARN-2424 are inconsistent between trunk and branch-2Major.Sidharta SeethanaNaganarasimha G R
HDFS-8151Always use snapshot path as source when invalid snapshot names are used for diff based distcpMinordistcpSushmitha SreenivasanJing Zhao
HDFS-7934Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NNCriticaldocumentationJ.AndreinaJ.Andreina
HDFS-8149The footer of the Web UI “Hadoop, 2014” is oldMajor.Akira AjisakaBrahma Reddy Battula
HDFS-8142DistributedFileSystem encryption zone commands should resolve relative pathsMajor.Rakesh RRakesh R
MAPREDUCE-6300Task list sort by task id brokenMinor.Siqi LiSiqi Li
YARN-3021YARN's delegation-token handling disallows certain trust setups to operate properly over DistCpMajorsecurityHarsh JYongjun Zhang
HDFS-8153Error Message points to wrong parent directory in case of path component name length errorMajornamenodeAnu EngineerAnu Engineer
YARN-3493RM fails to come up with error “Failed to load/recover state” when mem settings are changedCriticalyarnSumana SathishJian He
HDFS-8043NPE in MiniDFSCluster teardownMajortestSteve LoughranBrahma Reddy Battula
HDFS-8173NPE thrown at DataNode shutdown when HTTP server was not able to createMinordatanodeArchana TSurendra Singh Lilhore
YARN-3497ContainerManagementProtocolProxy modifies IPC timeout conf without making a copyMajorclientJason LoweJason Lowe
MAPREDUCE-6238MR2 can't run local jobs with -libjars command options which is a regression from MR1Criticalmrv2zhihai xuzhihai xu
HDFS-8179DFSClient#getServerDefaults returns null within 1 hour of system startBlocker.Xiaoyu YaoXiaoyu Yao
HDFS-7993Provide each Replica details in fsckMajor.Ming MaJ.Andreina
HDFS-8163Using monotonicNow for block report scheduling causes test failures on recently restarted systemsBlockerdatanodeArpit AgarwalArpit Agarwal
HADOOP-11704DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize()Major.Anubhav DhootAnubhav Dhoot
YARN-3495Confusing log generated by FairSchedulerMajor.Brahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6293Set job classloader on uber-job's LocalContainerLauncher event threadMajormr-amSangjin LeeSangjin Lee
HADOOP-11846TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8Majorbuild, securitySteve LoughranLarry McCay
HADOOP-11859PseudoAuthenticationHandler fails with httpcomponents v4.4Major.Eugene KoifmanEugene Koifman
MAPREDUCE-6330Fix typo in Task Attempt API's URL in documentationsMinordocumentationRyu KobayashiRyu Kobayashi
HADOOP-11848Incorrect arguments to sizeof in DomainSocket.cMajornativeMalcolm KavalskyMalcolm Kavalsky
HADOOP-11868Invalid user logins trigger large backtraces in server logMajor.Chang LiChang Li
HADOOP-11861test-patch.sh rewrite addendum patchMajorbuildAnu EngineerAllen Wittenauer
HADOOP-11864JWTRedirectAuthenticationHandler breaks java8 javadocsMajorbuildSteve LoughranLarry McCay
HDFS-4448Allow HA NN to start in secure mode with wildcard address configuredMajorha, namenode, securityAaron T. MyersAaron T. Myers
YARN-3522DistributedShell uses the wrong user to put timeline dataBlockertimelineserverZhijie ShenZhijie Shen
HDFS-8147Mover should not schedule two replicas to the same DN storageMajorbalancer & moverSurendra Singh LilhoreSurendra Singh Lilhore
HADOOP-11872“hadoop dfs” command prints message about using “yarn jar” on Windows(branch-2 only)MinorscriptsVarun VasudevVarun Vasudev
HADOOP-11730Regression: s3n read failure recovery brokenMajorfs/s3Takenori SatoTakenori Sato
YARN-3516killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.Minornodemanagerzhihai xuzhihai xu
HADOOP-11802DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShmMajor.Eric PayneColin P. McCabe
HDFS-8070Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNodeBlockercachingGopal VColin P. McCabe
HDFS-8217During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.MajordatanodeVinayakumar BVinayakumar B
HDFS-8231StackTrace displayed at client while QuotaByStorageType exceedsMajorhdfs-clientJ.AndreinaJ.Andreina
HDFS-8191Fix byte to integer casting in SimulatedFSDataset#simulatedByteMinor.Zhe ZhangZhe Zhang
YARN-3387Previous AM‘s container complete message couldn’t pass to current am if am restarted and rm changedCriticalresourcemanagersandfleesandflee
HADOOP-11876Refactor code to make it more readable, minor maybePrintStats bugTrivialtools/distcpZoran DimitrijevicZoran Dimitrijevic
YARN-3444Fix typo capabililtyTrivialapplications/distributed-shellGabor LiptakGabor Liptak
YARN-3537NPE when NodeManager.serviceInit fails and stopRecoveryStore invokedMajornodemanagerBrahma Reddy BattulaBrahma Reddy Battula
HDFS-8211DataNode UUID is always null in the JMX counterMajordatanodeAnu EngineerAnu Engineer
MAPREDUCE-6333TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297Major.Siqi LiSiqi Li
HDFS-8206Fix the typos in hadoop-hdfs-httpfsMajor.Brahma Reddy BattulaBrahma Reddy Battula
YARN-3464Race condition in LocalizerRunner kills localizer before localizing all resourcesCriticalnodemanagerzhihai xuzhihai xu
MAPREDUCE-6252JobHistoryServer should not fail when encountering a missing directoryMajorjobhistoryserverCraig WelchCraig Welch
YARN-3530ATS throws exception on trying to filter results without otherinfo.CriticaltimelineserverSreenath SomarajapuramZhijie Shen
HDFS-8205CommandFormat#parse() should not parse option as value of optionBlocker.Peter ShiPeter Shi
HADOOP-11870[JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issuesMajorbuildRobert KanterRobert Kanter
MAPREDUCE-6324Uber jobs fail to update AMRM token when it rolls overBlockermr-amJason LoweJason Lowe
HDFS-8232Missing datanode counters when using Metrics2 sink interfaceMajordatanodeAnu EngineerAnu Engineer
MAPREDUCE-6334Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handlerBlocker.Eric PayneEric Payne
HDFS-8273FSNamesystem#Delete() should not call logSync() when holding the lockBlockernamenodeJing ZhaoHaohui Mai
YARN-3485FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policiesCriticalfairschedulerKarthik KambatlaKarthik Kambatla
HDFS-8269getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atimeBlocker.Yesha VoraHaohui Mai
YARN-3517RM web ui for dumping scheduler logs should be for admins onlyBlockerresourcemanager, securityVarun VasudevVarun Vasudev
HDFS-8214Secondary NN Web UI shows wrong date for Last CheckpointMajornamenodeCharles LambCharles Lamb
YARN-3533Test: Fix launchAM in MockRM to wait for attempt to be scheduledMajoryarnAnubhav DhootAnubhav Dhoot
MAPREDUCE-6339Job history file is not flushed correctly because isTimerActive flag is not set true when flushTimerTask is scheduled.Criticalmrv2zhihai xuzhihai xu
HADOOP-11821Fix findbugs warnings in hadoop-slsMajortoolsAkira AjisakaBrahma Reddy Battula
YARN-3564Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomlyMajor.Jian HeJian He
HADOOP-11891OsSecureRandom should lazily fill its reservoirMajorsecurityArun SureshArun Suresh
HADOOP-11866increase readability and reliability of checkstyle, shellcheck, and whitespace reportsMinor.Naganarasimha G RAllen Wittenauer
HDFS-8292Move conditional in fmt_time from dfs-dust.js to status.htmlMinornamenodeCharles LambCharles Lamb
HDFS-8300Fix unit test failures and findbugs warning caused by HDFS-8283Major.Jing ZhaoJing Zhao
HDFS-8276LazyPersistFileScrubber should be disabled if scrubber interval configured zeroMajornamenodeSurendra Singh LilhoreSurendra Singh Lilhore
HADOOP-11889Make checkstyle runnable from root projectMajorbuild, testGera ShegalovGera Shegalov
HDFS-8213DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htraceCritical.Billie RinaldiColin P. McCabe
HDFS-8229LAZY_PERSIST file gets deleted after NameNode restart.MajornamenodeSurendra Singh LilhoreSurendra Singh Lilhore
YARN-2893AMLaucher: sporadic job failures due to EOFException in readTokenStorageStreamMajorresourcemanagerGera Shegalovzhihai xu
HADOOP-11491HarFs incorrectly declared as requiring an authorityCriticalfsGera ShegalovBrahma Reddy Battula
HADOOP-11900Add failIfNoTests=false to hadoop-build-tools pomMajortestGera ShegalovGera Shegalov
MAPREDUCE-6345Documentation fix for when CRLA is enabled for MRAppMaster logsTrivialdocumentationRohit AgarwalRohit Agarwal
YARN-2454Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources.Major.Xu YangXu Yang
YARN-1993Cross-site scripting vulnerability in TextView.javaMajorwebappTed YuKenji Kikushima
MAPREDUCE-5905CountersStrings.toEscapedCompactStrings outputs unnecessary “null” stringsMinor.Akira AjisakaAkira Ajisaka
MAPREDUCE-6349Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASSMinor.Ray ChiangRay Chiang
HADOOP-9658SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loadedMajor.Zhijie ShenZhijie Shen
YARN-3097Logging of resource recovery on NM restart has redundanciesMinornodemanagerJason LoweEric Payne
HDFS-8290WebHDFS calls before namesystem initialization can cause NullPointerException.MinorwebhdfsChris NaurothChris Nauroth
MAPREDUCE-5649Reduce cannot use more than 2G memory for the final mergeMajormrv2stanley shiGera Shegalov
MAPREDUCE-6259IllegalArgumentException due to missing job submit timeMajorjobhistoryserverzhihai xuzhihai xu
YARN-3375NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunnerMinornodemanagerDevaraj KDevaraj K
YARN-2725Adding test cases of retrying requests about ZKRMStateStoreMajor.Tsuyoshi OzawaTsuyoshi Ozawa
MAPREDUCE-6165[JDK8] TestCombineFileInputFormat failed on JDK8Minor.Wei YanAkira Ajisaka
HADOOP-11328ZKFailoverController does not log Exception when doRun raises errorsMajorhaTianyin XuTianyin Xu
HADOOP-11916TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bugMinor.Ming MaMing Ma
YARN-3552RM Web UI shows -1 running containers for completed appsTrivialwebappRohith Sharma K SRohith Sharma K S
HADOOP-11120hadoop fs -rmr gives wrong adviceMajor.Allen WittenauerJuliet Hougland
YARN-3396Handle URISyntaxException in ResourceLocalizationServiceMajornodemanagerChengbing LiuBrahma Reddy Battula
YARN-2123Progress bars in Web UI always at 100% due to non-US localeMajorwebappJohannes SimonAkira Ajisaka
HDFS-8305HDFS INotify: the destination field of RenameOp should always end with the file nameMajor.Colin P. McCabeColin P. McCabe
HADOOP-11917test-patch.sh should work with ${BASEDIR}/patchprocess setupsBlocker.Allen WittenauerAllen Wittenauer
HDFS-7847Modify NNThroughputBenchmark to be able to operate on a remote NameNodeMajor.Colin P. McCabeCharles Lamb
HDFS-8219setStoragePolicy with folder behavior is different after cluster restartMajor.Peter ShiSurendra Singh Lilhore
HADOOP-11898add nfs3 and portmap starting command in hadoop-daemon.sh in branch-2Minorbin, nfsBrandon LiBrandon Li
HADOOP-11926test-patch.sh mv does wrong mathMajor.Allen WittenauerAllen Wittenauer
HADOOP-11912Extra configuration key used in TraceUtils should respect prefixMinor.Masatake IwasakiMasatake Iwasaki
YARN-3582NPE in WebAppProxyServletMajor.Jian HeJian He
HDFS-2484checkLease should throw FileNotFoundException when file does not existMajornamenodeKonstantin ShvachkoRakesh R
YARN-3385Race condition: KeeperException$NoNodeException will cause RM shutdown during ZK node deletion.Criticalresourcemanagerzhihai xuzhihai xu
HDFS-7833DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.MajordatanodeChris NaurothLei (Eddy) Xu
YARN-3577Misspelling of threshold in log4j.properties for testsMinortestBrahma Reddy BattulaBrahma Reddy Battula
HDFS-8325Misspelling of threshold in log4j.properties for testsMinortestBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-10387Misspelling of threshold in log4j.properties for tests in hadoop-common-projectMinorconf, testKenji KikushimaBrahma Reddy Battula
MAPREDUCE-6356Misspelling of threshold in log4j.properties for testsMinortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-3523Cleanup ResourceManagerAdministrationProtocol interface audienceMajorclient, resourcemanagerWangda TanNaganarasimha G R
HDFS-7980Incremental BlockReport will dramatically slow down the startup of a namenodeMajor.Hui ZhengWalter Su
HADOOP-11936Dockerfile references a removed imageMajor.Allen WittenauerAllen Wittenauer
YARN-3584[Log mesage correction] : MIssing space in Diagnostics messageTrivial.nijelnijel
HDFS-8321CacheDirectives and CachePool operations should throw RetriableException in safemodeMajor.Haohui MaiHaohui Mai
HDFS-8037CheckAccess in WebHDFS silently accepts malformed FsActions parametersMinorwebhdfsJake LowWalter Su
YARN-1832Fix wrong MockLocalizerStatus#equals implementationMinornodemanagerHong ZhiguoHong Zhiguo
YARN-3572Correct typos in WritingYarnApplications.mdMinordocumentationSandeep KhuranaGabor Liptak
HADOOP-11922Misspelling of threshold in log4j.properties for tests in hadoop-toolsMinor.Brahma Reddy BattulaGabor Liptak
HDFS-8257Namenode rollingUpgrade option is incorrect in documentMajordocumentationJ.AndreinaJ.Andreina
HDFS-8067haadmin prints out stale help messagesMinorhdfs-clientAjith SAjith S
YARN-3592Fix typos in RMNodeLabelsManagerTrivialresourcemanagerJunping DuSunil G
HDFS-8174Update replication count to live rep count in fsck reportMinor.J.AndreinaJ.Andreina
HDFS-6291FSImage may be left unclosed in BootstrapStandby#doRun()MinorhaTed YuSanghyun Yun
YARN-3358Audit log not present while refreshing Service ACLsMinorresourcemanagerVarun SaxenaVarun Saxena
YARN-3589RM and AH web UI display DOCTYPE wronglyMajorwebappRohith Sharma K SRohith Sharma K S
HDFS-7998HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrongMinordocumentationAjith SAjith S
HDFS-8222Remove usage of "dfsadmin -upgradeProgress " from document which is no longer supportedMajordocumentationJ.AndreinaJ.Andreina
HDFS-8187Remove usage of “-setStoragePolicy” and “-getStoragePolicy” using dfsadmin cmd (as it is not been supported)MajordocumentationJ.AndreinaJ.Andreina
HDFS-8175Provide information on snapshotDiff for supporting the comparison between snapshot and current statusMajordocumentationJ.AndreinaJ.Andreina
MAPREDUCE-6342Make POM project names consistentMinorbuildRohith Sharma K SRohith Sharma K S
HDFS-6576Datanode log is generating at root directory in security modeMinordatanode, scriptsSurendra Singh LilhoreSurendra Singh Lilhore
HADOOP-11877SnappyDecompressor's Logger class name is wrongMajorconfSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-3384DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecoveryMajorhdfs-clientBrahma Reddy BattulaUma Maheswara Rao G
YARN-3554Default value for maximum nodemanager connect wait time is too highMajor.Jason LoweNaganarasimha G R
HDFS-7894Rolling upgrade readiness is not updated in jmx until query command is issued.Critical.Kihwal LeeBrahma Reddy Battula
YARN-3600AM container link is broken (on a killed application, at least)Major.Sergey ShelukhinNaganarasimha G R
HDFS-8346libwebhdfs build fails during link due to unresolved external symbols.MajornativeChris NaurothChris Nauroth
HDFS-8274NFS configuration nfs.dump.dir not workingMajornfsAjith SAjith S
HDFS-8340Fix NFS documentation of nfs.wtmaxMinordocumentation, nfsAjith SAjith S
HADOOP-10356Corrections in winutils/chmod.cTrivialbinRené NyffeneggerRené Nyffenegger
HADOOP-7165listLocatedStatus(path, filter) is not redefined in FilterFsMajorfsHairong KuangHairong Kuang
MAPREDUCE-3383Duplicate job.getOutputValueGroupingComparator() in ReduceTaskMajor.Binglin ChangBinglin Chang
HDFS-8311DataStreamer.transfer() should timeout the socket InputStream.Majorhdfs-clientEsteban GutierrezEsteban Gutierrez
HDFS-8113Add check for null BlockCollection pointers in BlockInfoContiguous structuresMajornamenodeChengbing LiuChengbing Liu
HADOOP-9729The example code of org.apache.hadoop.util.Tool is incorrectMajorutilhellojinjiehellojinjie
MAPREDUCE-2094LineRecordReader should not seek into non-splittable, compressed streams.MajortaskNiels BasjesNiels Basjes
HDFS-8245Standby namenode doesn't process DELETED_BLOCK if the add block request is in edit log.Major.Rushabh S ShahRushabh S Shah
YARN-3018Unify the default value for yarn.scheduler.capacity.node-locality-delay in code and default xml fileTrivialcapacityschedulernijelnijel
HDFS-8326Documentation about when checkpoints are run is out of dateMajordocumentationMisty Stanley-JonesMisty Stanley-Jones
YARN-3604removeApplication in ZKRMStateStore should also disable watch.Minorresourcemanagerzhihai xuzhihai xu
YARN-3476Nodemanager can fail to delete local logs if log aggregation failsMajorlog-aggregation, nodemanagerJason LoweRohith Sharma K S
YARN-3473Fix RM Web UI configuration for some propertiesMinorresourcemanagerRay ChiangRay Chiang
HDFS-8097TestFileTruncate is failing intermittentlyMajortestRakesh RRakesh R
YARN-1912ResourceLocalizer started without any jvm memory controlMajornodemanagerstanley shiMasatake Iwasaki
MAPREDUCE-6359RM HA setup, “Cluster” tab links populated with AM hostname instead of RMMinor.Aroop Maliakkalyunjiong zhao
MAPREDUCE-6353Divide by zero error in MR AM when calculating available containersMajormr-amAnubhav DhootAnubhav Dhoot
YARN-3395FairScheduler: Trim whitespaces when using username for queuenameMajorfairschedulerzhihai xuzhihai xu
HDFS-8351Remove namenode -finalize option from documentMajordocumentationAkira AjisakaAkira Ajisaka
YARN-3587Fix the javadoc of DelegationTokenSecretManager in projects of yarn, etc.MinordocumentationAkira AjisakaGabor Liptak
HADOOP-11663Remove description about Java 6 from docsMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-11928Test-patch check for @author tags incorrectly flags removal of @author tagsMajor.Sean BusbeyKengo Seki
HADOOP-11951test-patch should give better info about failures to handle dev-support updates without resetrepo optionMinor.Sean BusbeySean Busbey
HADOOP-11947test-patch should return early from determine-issue when run in jenkins mode.Minor.Sean BusbeySean Busbey
HDFS-7916‘reportBadBlocks’ from datanodes to standby Node BPServiceActor goes for infinite loopCriticaldatanodeVinayakumar BRushabh S Shah
YARN-3434Interaction between reservations and userlimit can result in significant ULF violationMajorcapacityschedulerThomas GravesThomas Graves
HDFS-8362Java Compilation Error in TestHdfsConfigFields.javaMajor.Mohammad ArshadMohammad Arshad
MAPREDUCE-6360TestMapreduceConfigFields is placed in wrong dir, introducing compile errorMajor.Vinayakumar BMohammad Arshad
MAPREDUCE-6361NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same hostCritical.Junping DuJunping Du
YARN-3629NodeID is always printed as “null” in node manager initialization log.Major.nijelnijel
MAPREDUCE-6251JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner casesMajorjobhistoryserver, mrv2Craig WelchCraig Welch
MAPREDUCE-6366mapreduce.terasort.final.sync configuration in TeraSort doesn't workTrivialexamplesTakuya FukudomeTakuya Fukudome
HDFS-6300Prevent multiple balancers from running simultaneouslyCriticalbalancer & moverRakesh RRakesh R
HDFS-8358TestTraceAdmin failsMajor.Kihwal LeeMasatake Iwasaki
HADOOP-11966Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh.CriticalscriptsChris NaurothChris Nauroth
HDFS-8380Always call addStoredBlock on blocks which have been shifted from one storage to anotherMajor.Colin P. McCabeColin P. McCabe
HADOOP-8174Remove confusing comment in Path#isAbsolute()TrivialfsSuresh SrinivasSuresh Srinivas
HDFS-8150Make getFileChecksum fail for blocks under constructionCritical.Kihwal LeeJ.Andreina
MAPREDUCE-5708Duplicate String.format in YarnOutputFiles.getSpillFileForWriteMinor.Konstantin WeitzKonstantin Weitz
YARN-1519check if sysconf is implemented before using itMajornodemanagerRadim KolarRadim Kolar
HDFS-8371Fix test failure in TestHdfsConfigFields for spanreceiver propertiesMajor.Ray ChiangRay Chiang
MAPREDUCE-6273HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED stateMinorjobhistoryserverzhihai xuzhihai xu
YARN-2421RM still allocates containers to an app in the FINISHING stateMajorschedulerThomas GravesChang Li
YARN-3526ApplicationMaster tracking URL is incorrectly redirected on a QJM clusterMajorresourcemanager, webappWeiwei YangWeiwei Yang
HADOOP-11988Fix typo in the document for hadoop fs -findTrivialdocumentationAkira AjisakaKengo Seki
HADOOP-10582Fix the test case for copying to non-existent dir in TestFsShellCopyMinorfsKousuke SarutaKousuke Saruta
HDFS-8345Storage policy APIs must be exposed via the FileSystem interfaceMajorhdfs-clientArpit AgarwalArpit Agarwal
HDFS-8405Fix a typo in NamenodeFsckMinornamenodeTsz Wo Nicholas SzeTakanobu Asanuma
HDFS-6348SecondaryNameNode not terminating properly on runtime exceptionsMajornamenodeRakesh RRakesh R
YARN-3601Fix UT TestRMFailover.testRMWebAppRedirectCriticalresourcemanager, webappWeiwei YangWeiwei Yang
HDFS-8404Pending block replication can get stuck using older genstampMajornamenodeNathan RobertsNathan Roberts
HADOOP-11973Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLsMajorsecurityGregory ChananGregory Chanan
HADOOP-11963Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.TrivialdocumentationChris NaurothAnu Engineer
YARN-2821Distributed shell app master becomes unresponsive sometimesMajorapplications/distributed-shellVarun VasudevVarun Vasudev
YARN-3677Fix findbugs warnings in yarn-server-resourcemanagerMinorresourcemanagerAkira AjisakaVinod Kumar Vavilapalli
YARN-3681yarn cmd says “could not find main class ‘queue’” in windowsBlockeryarnSumana SathishVarun Saxena
YARN-3654ContainerLogsPage web UI should not have meta-refreshMajoryarnXuan GongXuan Gong
YARN-3694Fix dead link for TimelineServer REST APIMinordocumentationAkira AjisakaJagadesh Kiran N
YARN-3646Applications are getting stuck some times in case of retry policy foreverMajorclientRaju BairishettiRaju Bairishetti
HDFS-8421Move startFile() and related operations into FSDirWriteFileOpMajor.Haohui MaiHaohui Mai
HDFS-8451DFSClient probe for encryption testing interprets empty URI property for “enabled”BlockerencryptionSteve LoughranSteve Loughran
YARN-3675FairScheduler: RM quits when node removal races with continousscheduling on the same nodeCriticalfairschedulerAnubhav DhootAnubhav Dhoot
HADOOP-12014hadoop-config.cmd displays a wrong error messageMinorscriptsKengo SekiKengo Seki
HADOOP-11955Fix a typo in the cluster setup docTrivial.Kihwal LeeYanjun Wang
HDFS-8268Port conflict log for data node server is not sufficientMinordatanodeMohammad Shahid KhanMohammad Shahid Khan
YARN-3594WintuilsProcessStubExecutor.startStreamReader leaks streamsTrivialnodemanagerSteve LoughranLars Francke
HADOOP-11743maven doesn't clean all the site filesMinordocumentationAllen Wittenauerramtin
HADOOP-11927Fix “undefined reference to dlopen” error when compiling libhadooppipesMajorbuild, native, toolsXianyin XinXianyin Xin
YARN-3701Isolating the error of generating a single app report when getting all apps from generic history serviceBlockertimelineserverZhijie ShenZhijie Shen
YARN-3707RM Web UI queue filter doesn't workBlocker.Wangda TanWangda Tan
YARN-2238filtering on UI sticks even if I move away from the pageMajorwebappSangjin LeeJian He
HADOOP-8751NPE in Token.toString() when Token is constructed using null identifierMinorsecurityVlad RozovKanaka Kumar Avvaru
HADOOP-11969ThreadLocal initialization in several classes is not thread safeCriticalioSean BusbeySean Busbey
YARN-3626On Windows localized resources are not moved to the front of the classpath when they should beMajoryarnCraig WelchCraig Welch
HADOOP-9891CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundExceptionMinordocumentationSteve LoughranDarrell Taylor
HDFS-8431hdfs crypto class not found in WindowsCriticalscriptsSumana SathishAnu Engineer
HADOOP-12004test-patch breaks with reexec in certain situationsCritical.Allen WittenauerSean Busbey
YARN-3723Need to clearly document primaryFilter and otherInfo value typeCriticaltimelineserverZhijie ShenZhijie Shen
HDFS-8407libhdfs hdfsListDirectory must set errno to 0 on successMajornativeJuan YuMasatake Iwasaki
HDFS-8429Avoid stuck threads if there is an error in DomainSocketWatcher that stops the threadMajor.zhouyingchaozhouyingchao
HADOOP-11959WASB should configure client side socket timeout in storage client blob request optionsMajortoolsIvan MiticIvan Mitic
HADOOP-11934Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loopBlockersecurityMike YoderLarry McCay
HDFS-7401Add block info to DFSInputStream' WARN message when it adds node to deadNodesMinor.Ming MaMohammad Arshad
HADOOP-12042Users may see TrashPolicy if hdfs dfs -rm is runMajor.Allen WittenauerJ.Andreina
HDFS-7609Avoid retry cache collision when Standby NameNode loading editsCriticalnamenodeCarrey ZhanMing Ma
HADOOP-11885hadoop-dist dist-layout-stitching.sh does not work with dashMajorbuildAndrew WangAndrew Wang
YARN-3725App submission via REST API is broken in secure mode due to Timeline DT service address is emptyBlockerresourcemanager, timelineserverZhijie ShenZhijie Shen
HADOOP-12037Fix wrong classname in example configuration of hadoop-auth documentationTrivialdocumentationMasatake IwasakiMasatake Iwasaki
HDFS-8256fsck "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentationMajordocumentationJ.AndreinaJ.Andreina
HDFS-8486DN startup may cause severe data lossBlockerdatanodeDaryn SharpDaryn Sharp
HDFS-8386Improve synchronization of ‘streamer’ reference in DFSOutputStreamMajorhdfs-clientRakesh RRakesh R
HDFS-8513Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerantMinornamenodeAndrew WangAndrew Wang
HADOOP-11991test-patch.sh isn't re-executed even if smart-apply-patch.sh is modifiedMajortestKengo SekiKengo Seki
HDFS-8270create() always retried with hardcoded timeout when file already exists with open leaseMajorhdfs-clientAndrey StepachevJ.Andreina
HDFS-8470fsimage loading progress should update inode, delegation token and cache pool count.MinornamenodetongshiquanSurendra Singh Lilhore
HDFS-8523Remove usage information on unsupported operation “fsck -showprogress” from branch-2MajordocumentationJ.AndreinaJ.Andreina
HDFS-3716Purger should remove stale fsimage ckpt filesMinornamenodesuja sJ.Andreina
YARN-3751TestAHSWebServices fails after YARN-3467Major.Zhijie ShenSunil G
YARN-3585NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabledCritical.Peng ZhangRohith Sharma K S
MAPREDUCE-6374Distributed Cache File visibility should check permission of full pathMajor.Chang LiChang Li
YARN-3762FairScheduler: CME on FSParentQueue#getQueueUserAclInfoCriticalfairschedulerKarthik KambatlaKarthik Kambatla
YARN-3749We should make a copy of configuration when init MiniYARNCluster with multiple RMsMajor.Chun ChenChun Chen
MAPREDUCE-5965Hadoop streaming throws error if list of input files is high. Error is: “error=7, Argument list too long at if number of input file is high”Major.Arup MalakarWilfred Spiegelenburg
HADOOP-12018smart-apply-patch.sh fails if the patch edits CR+LF files and is created by ‘git diff --no-prefix’MinorbuildAkira AjisakaKengo Seki
HADOOP-12019update BUILDING.txt to include python for ‘mvn site’ in windowsMajor.Vinayakumar BVinayakumar B
MAPREDUCE-6382Don't escape HTML links in Diagnostics in JHS job overviewMajor.Siqi LiSiqi Li
HADOOP-12058Fix dead links to DistCp and Hadoop Archives pages.Minordocumentation, siteKazuho FujiiKazuho Fujii
HDFS-8463Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerExceptionMinor.Masatake IwasakiMasatake Iwasaki
YARN-3764CapacityScheduler should forbid moving LeafQueue from one parent to anotherBlocker.Wangda TanWangda Tan
HADOOP-11994smart-apply-patch wrongly assumes that git is infallibleMajortestAllen WittenauerKengo Seki
HADOOP-11924Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class initMajor.Gera ShegalovTsuyoshi Ozawa
YARN-3733Fix DominantRC#compare() does not work as expected if cluster resource is emptyBlockerresourcemanagerBibin A ChundattRohith Sharma K S
MAPREDUCE-6377JHS sorting on state column not working in webUiMinorjobhistoryserverBibin A Chundattzhihai xu
MAPREDUCE-6387Serialize the recently added Task#encryptedSpillKey field at the endMinor.Arun SureshArun Suresh
HADOOP-12056Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directoryMajorutilzhihai xuzhihai xu
HDFS-8522Change heavily recorded NN logs from INFO to DEBUG levelMajornamenodeXiaoyu YaoXiaoyu Yao
YARN-3655FairScheduler: potential livelock due to maxAMShare limitation and container reservationCriticalfairschedulerzhihai xuzhihai xu
HDFS-8539Hdfs doesnt have class ‘debug’ in windowsMajorscriptsSumana SathishAnu Engineer
YARN-3780Should use equals when compare Resource in RMNodeImpl#ReconnectNodeTransitionMinorresourcemanagerzhihai xuzhihai xu
YARN-3747TestLocalDirsHandlerService should delete the created test directory logDir2MinortestDavid MooreDavid Moore
HDFS-8554TestDatanodeLayoutUpgrade fails on Windows.MajortestChris NaurothChris Nauroth
YARN-3778Fix Yarn resourcemanger CLI usageMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12054RPC client should not retry for InvalidToken exceptionsCriticalipcDaryn SharpVarun Saxena
HDFS-8552Fix hdfs CLI usage message for namenode and zkfcMajor.Xiaoyu YaoBrahma Reddy Battula
HADOOP-12073Azure FileSystem PageBlobInputStream does not return -1 on EOFMajortoolsIvan MiticIvan Mitic
HDFS-8568TestClusterId#testFormatWithEmptyClusterIdOption is failingMajor.Rakesh RRakesh R
HADOOP-7817RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos()MajorfsKristofer TomasetteKanaka Kumar Avvaru
MAPREDUCE-6350JobHistory doesn't support fully-functional searchCriticaljobhistoryserverSiqi LiSiqi Li
MAPREDUCE-6389Fix BaileyBorweinPlouffe CLI usage messageTrivial.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12052IPC client downgrades all exception types to IOE, breaks callers trying to use themCritical.Steve LoughranBrahma Reddy Battula
YARN-3785Support for Resource as an argument during submitApp call in MockRM test classMinorresourcemanagerSunil GSunil G
HADOOP-12074in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOExceptionMinor.Lavkesh LahngirLavkesh Lahngir
HDFS-8566HDFS documentation about debug commands wrongly identifies them as “hdfs dfs” commandsMajordocumentationSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-8583Document that NFS gateway does not work with rpcbind on SLES 11MajordocumentationArpit AgarwalArpit Agarwal
HDFS-8572DN always uses HTTP/localhost@REALM principals in SPNEGOBlocker.Haohui MaiHaohui Mai
YARN-3794TestRMEmbeddedElector fails because of ambiguous LOG referenceMajortestChengbing LiuChengbing Liu
HDFS-8593Calculation of effective layout version mishandles comparison to current layout version in storage.MajornamenodeChris NaurothChris Nauroth
HDFS-8596TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of “datanode” attributeBlockerdatanodeYongjun ZhangYongjun Zhang
HDFS-8595TestCommitBlockSynchronization fails in branch-2.7MajortestArpit AgarwalArpit Agarwal
HDFS-8607TestFileCorruption doesn't work as expectedMajortestWalter SuWalter Su
HADOOP-12001Limiting LDAP search conflicts with posixGroup additionBlockersecurityPatrick WhitePatrick White
HADOOP-12078The default retry policy does not handle RetriableException correctlyCriticalipcArpit AgarwalArpit Agarwal
HDFS-8576Lease recovery should return true if the lease can be released and the file can be closedMajornamenodeJ.AndreinaJ.Andreina
HDFS-8592SafeModeException never get unwrappedMajor.Haohui MaiHaohui Mai
HADOOP-12095org.apache.hadoop.fs.shell.TestCount failsMajortestBrahma Reddy BattulaBrahma Reddy Battula
HDFS-4660Block corruption can happen during pipeline recoveryBlockerdatanodePeng ZhangKihwal Lee
HDFS-8548Minicluster throws NPE on shutdownMajor.Mike DrobSurendra Singh Lilhore
YARN-3714AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-idMinor.Masatake IwasakiMasatake Iwasaki
HDFS-8551Fix hdfs datanode CLI usage messageMajor.Xiaoyu YaoBrahma Reddy Battula
HADOOP-12076Incomplete Cache Mechanism in CredentialProvider APIMajorsecurityLarry McCayLarry McCay
YARN-3617Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning always -1Minor.Georg BerendtJ.Andreina
YARN-3804Both RM are on standBy state when kerberos user not in yarn.admin.aclCriticalresourcemanagerBibin A ChundattVarun Saxena
HDFS-8446Separate safemode related operations in GetBlockLocations()Minor.Haohui MaiHaohui Mai
HDFS-8615Correct HTTP method in WebHDFS documentMajordocumentationAkira AjisakaBrahma Reddy Battula
MAPREDUCE-6373The logger reports total input paths but it is referring to input filesTrivial.Andi Chirita AmdocsBibin A Chundatt
YARN-3824Fix two minor nits in member variable properties of YarnConfigurationTrivialyarnRay ChiangRay Chiang
HADOOP-12100ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermissionMajor.Robert KanterBibin A Chundatt
YARN-3802Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.Majorresourcemanagerzhihai xuzhihai xu
HDFS-8633Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeysMinordatanodeRay ChiangRay Chiang
HDFS-8626Reserved RBW space is not released if creation of RBW File failsBlocker.Kanaka Kumar AvvaruKanaka Kumar Avvaru
MAPREDUCE-6405NullPointerException in App Attempts pageMajor.Siqi LiSiqi Li
HADOOP-12103Small refactoring of DelegationTokenAuthenticationFilter to allow code sharingMinorsecurityYongjun ZhangYongjun Zhang
HDFS-8337Accessing httpfs via webhdfs doesn't work from a jar with kerberosMajorsecurity, webhdfsYongjun ZhangYongjun Zhang
MAPREDUCE-6403Fix typo in the usage of NNBenchTrivialdocumentationAkira AjisakaJagadesh Kiran N
HDFS-8480Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying themCritical.Zhe ZhangZhe Zhang
MAPREDUCE-5948org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters wellCritical.Kris GeusebroekAkira Ajisaka
HDFS-8542WebHDFS getHomeDirectory behavior does not match specificationMajorwebhdfsJakob HomanKanaka Kumar Avvaru
YARN-3842NMProxy should retry on NMNotYetReadyExceptionCritical.Karthik KambatlaRobert Kanter
YARN-3835hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xmlMinorresourcemanagerVamsee YarlagaddaVamsee Yarlagadda
MAPREDUCE-6410Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure clusterCritical.Zhang WeiVarun Saxena
MAPREDUCE-6400Multiple shuffle transfer fails because input is closed too earlyBlockertaskAkira AjisakaBrahma Reddy Battula
YARN-3809Failed to launch new attempts because ApplicationMasterLauncher's threads all hangMajorresourcemanagerJun GongJun Gong
YARN-3832Resource Localization fails on a cluster due to existing cache directoriesCriticalnodemanagerRanga SwamyBrahma Reddy Battula
YARN-3790usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the containerMajorfairscheduler, testRohith Sharma K Szhihai xu
HADOOP-11958MetricsSystemImpl fails to show backtrace when an error occursMajor.Jason LoweJason Lowe
HDFS-8646Prune cached replicas from DatanodeDescriptor state on replica invalidationMajorcachingAndrew WangAndrew Wang
YARN-3826Race condition in ResourceTrackerService leads to wrong diagnostics messagesMajorresourcemanagerChengbing LiuChengbing Liu
YARN-3745SerializedException should also try to instantiate internal exception with the default constructorMajor.Lavkesh LahngirLavkesh Lahngir
MAPREDUCE-6413TestLocalJobSubmission is failing with unknown hostMajortestJason Lowezhihai xu
HDFS-8665Fix replication check in DFSTestUtils#waitForReplicationTrivialtestAndrew WangAndrew Wang
HADOOP-8151Error handling in snappy decompressor throws invalid exceptionsMajorio, nativeTodd LipconMatt Foley
YARN-3850NM fails to read files from full disks which can lead to container logs being lost and other issuesBlockerlog-aggregation, nodemanagerVarun SaxenaVarun Saxena
HDFS-8656Preserve compatibility of ClientProtocol#rollingUpgrade after finalizationCriticalrolling upgradesAndrew WangAndrew Wang
YARN-3859LeafQueue doesn't print user properly for application addMinorcapacityschedulerDevaraj KVarun Saxena
HDFS-8681BlockScanner is incorrectly disabled by defaultBlockerdatanodeAndrew WangArpit Agarwal
YARN-3860rmadmin -transitionToActive should check the state of non-target nodeMajorresourcemanagerMasatake IwasakiMasatake Iwasaki
HDFS-8586Dead Datanode is allocated for write when client is from deadnodeCritical.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12119hadoop fs -expunge does not work for federated namespaceMajor.Vrushali CJ.Andreina
HDFS-8628Update missing command option for fetchdtMajordocumentationJ.AndreinaJ.Andreina
YARN-3695ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception.Major.Junping DuRaju Bairishetti
HADOOP-12089StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASBMajortoolsDuo XuDuo Xu
YARN-3770SerializedException should also handle java.lang.ErrorMajor.Lavkesh LahngirLavkesh Lahngir
HDFS-8687Remove the duplicate usage message from Dfsck.javaMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12107long running apps may have a huge number of StatisticsData instances under FileSystemCriticalfsSangjin LeeSangjin Lee
HDFS-8579Update HDFS usage with missing optionsMinor.J.AndreinaJ.Andreina
HADOOP-12154FileSystem#getUsed() returns the file length only from root ‘/’Major.tongshiquanJ.Andreina
YARN-3768ArrayIndexOutOfBoundsException with empty environment variablesMajoryarnJoe Fernerzhihai xu
HADOOP-10798globStatus() should always return a sorted list of filesMinor.Felix BorchersColin P. McCabe
HADOOP-12124Add HTrace support for FsShellMajor.Colin P. McCabeColin P. McCabe
HADOOP-12159Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespacesMajor.Ray ChiangRay Chiang
MAPREDUCE-6121JobResourceUpdater#compareFs() doesn't handle HA namespacesMajormrv2Thomas GravesRay Chiang
HADOOP-12116Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2MajorscriptsLi LuLi Lu
HADOOP-12164Fix TestMove and TestFsShellReturnCode failed to get command name using reflection.Minor.Lei (Eddy) XuLei (Eddy) Xu
YARN-3823Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores propertyMinor.Ray ChiangRay Chiang
YARN-3830AbstractYarnScheduler.createReleaseCache may try to clean a null attemptMajorschedulernijelnijel
HDFS-8706Fix typo in datanode startup options in HDFSCommands.htmlMajor.Brahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6420Interrupted Exception in LocalContainerLauncher should be logged in warn/info levelMajor.Chang LiChang Li
MAPREDUCE-6418MRApp should not shutdown LogManager during shutdownMajortestChang LiChang Li
YARN-3793Several NPEs when deleting local files on NM recoveryMajornodemanagerKarthik KambatlaVarun Saxena
HDFS-8666speedup TestMoverMajortestWalter SuWalter Su
HADOOP-12171Shorten overly-long htrace span names for serverMajortracingColin P. McCabeColin P. McCabe
YARN-3875FSSchedulerNode#reserveResource() doesn't print Application Id properly in logMinor.Bibin A ChundattBibin A Chundatt
YARN-3508Prevent processing preemption events on the main RM dispatcherMajorresourcemanager, schedulerJason LoweVarun Saxena
HADOOP-12173NetworkTopology#add calls NetworkTopology#toString alwaysMajor.Inigo GoiriInigo Goiri
HDFS-8577Avoid retrying to recover lease on a file which does not existMajor.J.AndreinaJ.Andreina
YARN-3882AggregatedLogFormat should close aclScanner and ownerScanner after create them.Minornodemanagerzhihai xuzhihai xu
MAPREDUCE-6425ShuffleHandler passes wrong “base” parameter to getMapOutputInfo if mapId is not in the cache.Majormrv2, nodemanagerzhihai xuzhihai xu
HADOOP-12186ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple timesMajorhazhihai xuzhihai xu
HDFS-8686WebHdfsFileSystem#getXAttr(Path p, final String name) doesn't work if namespace is in capitalsMajorwebhdfsJagadesh Kiran NKanaka Kumar Avvaru
YARN-3837javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth optionsMinortimelineserverSteve LoughranBibin A Chundatt
HADOOP-12117Potential NPE from Configuration#loadProperty with allowNullValueProperties set.Minorconfzhihai xuzhihai xu
MAPREDUCE-6038A boolean may be set error in the Word Count v2.0 in MapReduce TutorialMinor.Pei MaTsuyoshi Ozawa
YARN-3892NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit failsMinor.Bibin A ChundattBibin A Chundatt
YARN-3690[JDK8] ‘mvn site’ failsMajorapi, siteAkira AjisakaBrahma Reddy Battula
HADOOP-12202releasedocmaker drops missing component and assignee entriesBlockeryetusAllen WittenauerAllen Wittenauer
HDFS-8642Make TestFileTruncate more reliableMinor.Rakesh RRakesh R
HADOOP-11878FileContext.java # fixRelativePart should check for not null for a more informative exceptionMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12201Add tracing to FileSystem#createFileSystem and Globber#globMajor.Colin P. McCabeColin P. McCabe
HADOOP-12200TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profileMinortestMasatake IwasakiMasatake Iwasaki
MAPREDUCE-6426TestShuffleHandler#testGetMapOutputInfo is failingMajortestDevaraj Kzhihai xu
HDFS-8729Fix testTruncateWithDataNodesRestartImmediately occasionally failedMinor.Walter SuWalter Su
YARN-3888ApplicationMaster link is broken in RM WebUI when appstate is NEWMinorresourcemanagerBibin A ChundattBibin A Chundatt
HDFS-8749Fix findbugs warning in BlockManager.javaMinor.Akira AjisakaBrahma Reddy Battula
HDFS-2956calling fetchdt without a --renewer argument throws NPEMajorsecurityTodd LipconVinayakumar B
HDFS-8751Remove setBlocks API from INodeFile and misc code cleanupMajornamenodeZhe ZhangZhe Zhang
YARN-3849Too much of preemption activity causing continuos killing of containers across queuesCriticalcapacityschedulerSunil GSunil G
YARN-3917getResourceCalculatorPlugin for the default should intercept all exceptionsMajor.Gera ShegalovGera Shegalov
YARN-3894RM startup should fail for wrong CS xml NodeLabel capacity configurationCriticalcapacityschedulerBibin A ChundattBibin A Chundatt
MAPREDUCE-6421Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpressionMajor.Ray ChiangBrahma Reddy Battula
HADOOP-12191Bzip2Factory is not thread safeMajorioJason LoweBrahma Reddy Battula
HDFS-7608hdfs dfsclient newConnectedPeer has no write timeoutMajorfuse-dfs, hdfs-clientzhangshilongXiaoyu Yao
HADOOP-12153ByteBufferReadable doesn't declare @InterfaceAudience and @InterfaceStabilityMinorfsSteve LoughranBrahma Reddy Battula
HDFS-8778TestBlockReportRateLimiting#testLeaseExpiration can deadlockMajortestArpit AgarwalArpit Agarwal
HADOOP-10615FileInputStream in JenkinsHash#main() is never closedMinor.Ted YuChen He
HADOOP-12240Fix tests requiring native library to be skipped in non-native profileMinortestMasatake IwasakiMasatake Iwasaki
YARN-3805Update the documentation of Disk Checker based on YARN-90MinordocumentationMasatake IwasakiMasatake Iwasaki
HDFS-8767RawLocalFileSystem.listStatus() returns null for UNIX pipefileCritical.Haohui MaiKanaka Kumar Avvaru
YARN-3885ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 levelBlockeryarnAjith SAjith S
YARN-3453Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashingMajorfairschedulerAshwin ShankarArun Suresh
YARN-3535Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLEDCriticalcapacityscheduler, fairscheduler, resourcemanagerPeng ZhangPeng Zhang
YARN-3905Application History Server UI NPEs when accessing apps run after RM restartMajortimelineserverEric PayneEric Payne
HADOOP-12235hadoop-openstack junit & mockito dependencies should be “provided”Minorbuild, fs/swiftSteve LoughranTed Yu
HADOOP-12209Comparable type should be in FileStatusMinorfsYong ZhangYong Zhang
HADOOP-12088KMSClientProvider uses equalsIgnoreCase(“application/json”)MajorkmsSteve LoughranBrahma Reddy Battula
HADOOP-12051ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage in logging/span eventsMinoripcSteve LoughranVarun Saxena
HADOOP-12237releasedocmaker.py doesn't work behind a proxyMajoryetusTsuyoshi OzawaTsuyoshi Ozawa
HDFS-7582Enforce maximum number of ACL entries separately per access and default.MajornamenodeVinayakumar BVinayakumar B
HDFS-8773Few FSNamesystem metrics are not documented in the Metrics pageMajordocumentationRakesh RRakesh R
YARN-3878AsyncDispatcher can hang while stopping if it is configured for draining events on stopCritical.Varun SaxenaVarun Saxena
HDFS-7728Avoid updating quota usage while loading editsMajor.Jing ZhaoJing Zhao
HADOOP-11962Sasl message with MD5 challenge text shouldn't be LOG out even in debug level.Criticalipc, securityJunping DuJunping Du
HADOOP-12017Hadoop archives command should use configurable replication factor when closingMajor.Zhe ZhangBibin A Chundatt
HADOOP-12239StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASBMajorfs/azure, toolsDuo XuDuo Xu
YARN-3932SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resourcesMajorresourcemanagerBibin A ChundattBibin A Chundatt
YARN-3954TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml fails in trunkMajor.Varun SaxenaVarun Saxena
YARN-2019Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStoreCritical.Junping DuJian He
HDFS-8797WebHdfsFileSystem creates too many connections for preadMajorwebhdfsJing ZhaoJing Zhao
YARN-3941Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to schedulerMajorcapacityschedulerSunil GSunil G
YARN-3900Protobuf layout of yarn_security_token causes errors in other protos that include itMajor.Anubhav DhootAnubhav Dhoot
YARN-3845Scheduler page does not render RGBA color combinations in IE11Minor.Jagadesh Kiran NMohammad Shahid Khan
HDFS-8806Inconsistent metrics: number of missing blocks with replication factor 1 not properly clearedMajor.Zhe ZhangZhe Zhang
YARN-3967Fetch the application report from the AHS if the RM does not know about itMajor.Mit DesaiMit Desai
YARN-3957FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500MajorfairschedulerAnubhav DhootAnubhav Dhoot
YARN-3925ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.Criticalnodemanagerzhihai xuzhihai xu
YARN-3973Recent changes to application priority management break reservation system from YARN-1051MajorresourcemanagerCarlo CurinoCarlo Curino
YARN-3958TestYarnConfigurationFields should be moved to hadoop-yarn-api moduleMajor.Varun SaxenaVarun Saxena
HDFS-8810Correct assertions in TestDFSInotifyEventInputStream class.MinortestSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-8785TestDistributedFileSystem is failing in trunkMajortestArpit AgarwalXiaoyu Yao
YARN-2194Cgroups cease to work in RHEL7CriticalnodemanagerWei YanWei Yan
YARN-3846RM Web UI queue filter is not workingMajoryarnMohammad Shahid KhanMohammad Shahid Khan
HADOOP-12245References to misspelled REMAINING_QUATA in FileSystemShell.mdMinordocumentationGera ShegalovGabor Liptak
YARN-3982container-executor parsing of container-executor.cfg broken in trunk and branch-2BlockernodemanagerVarun VasudevVarun Vasudev
HADOOP-12175FsShell must load SpanReceiverHost to support tracingMajortracingMasatake IwasakiMasatake Iwasaki
HDFS-8670Better to exclude decommissioned nodes for namenode NodeUsage JMXMajor.Ming MaJ.Andreina
HADOOP-109454-digit octal umask permissions throws a parse errorMajorfsJason LoweChang Li
YARN-3919NPEs' while stopping service after exception during CommonNodeLabelsManager#startTrivialresourcemanagerVarun SaxenaVarun Saxena
YARN-3963AddNodeLabel on duplicate label addition shows successMinor.Bibin A ChundattBibin A Chundatt
MAPREDUCE-6433launchTime may be negativeMajorjobhistoryserver, mrv2Allen Wittenauerzhihai xu
YARN-3990AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnectedCriticalresourcemanagerRohith Sharma K SBibin A Chundatt
HDFS-6860BlockStateChange logs are too noisyMajornamenodeArpit AgarwalChang Li
HADOOP-12268AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation.Majortestzhihai xuzhihai xu
HDFS-8847change TestHDFSContractAppend to not override testRenameFileBeingAppended method.Majortestzhihai xuzhihai xu
HDFS-8850VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocksMajordatanodeColin P. McCabeColin P. McCabe
HDFS-8844TestHDFSCLI does not cleanup the test directoryMinortestAkira AjisakaMasatake Iwasaki
HADOOP-12274Remove direct download link from BUILDING.txtMinordocumentationCaleb SevernCaleb Severn
HADOOP-12302Fix native compilation on Windows after HADOOP-7824Blocker.Vinayakumar BVinayakumar B
YARN-3983Make CapacityScheduler to easier extend application allocation logicMajor.Wangda TanWangda Tan
HADOOP-12304Applications using FileContext fail with the default file system configured to be wasb/s3/etc.BlockerfsChris NaurothChris Nauroth
HADOOP-11932MetricsSinkAdapter hangs when being stoppedCritical.Jian HeBrahma Reddy Battula
HDFS-8856Make LeaseManager#countPath O(1)MajornamenodeArpit AgarwalArpit Agarwal
HDFS-8772Fix TestStandbyIsHot#testDatanodeRestarts which occasionally failsMajor.Walter SuWalter Su
YARN-3966Fix excessive loggings in CapacitySchedulerMajor.Jian HeJian He
HDFS-8866Typo in docs: Rumtime -> RuntimeTrivialdocumentation, webhdfsJakob HomanGabor Liptak
YARN-3999RM hangs on draining eventsMajor.Jian HeJian He
YARN-4026FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requestsMajor.Wangda TanWangda Tan
HDFS-8879Quota by storage type usage incorrectly initialized upon namenode restartMajornamenodeKihwal LeeXiaoyu Yao
HADOOP-12258Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regressionCriticalfszhihai xuzhihai xu
YARN-4005Completed container whose app is finished is not removed from NMStateStoreMajor.Jun GongJun Gong
YARN-4047ClientRMService getApplications has high scheduler lock contentionMajorresourcemanagerJason LoweJason Lowe
YARN-3987am container complete msg ack to NM once RM receive itMajorresourcemanagersandfleesandflee
HADOOP-12322typos in rpcmetrics.javaTrivialipcAnu EngineerAnu Engineer
HDFS-8565Typo in dfshealth.html - “Decomissioning”Trivial.nijelnijel
MAPREDUCE-5817Mappers get rescheduled on node transition even after all reducers are completedMajorapplicationmasterSangjin LeeSangjin Lee
HDFS-8891HDFS concat should keep srcs orderBlocker.Yong ZhangYong Zhang
MAPREDUCE-6439AM may fail instead of retrying if RM shuts down during the allocate callCritical.Anubhav DhootAnubhav Dhoot
HDFS-8845DiskChecker should not traverse the entire treeMajor.Chang LiChang Li
HDFS-8852HDFS architecture documentation of version 2.x is outdated about append write supportMajordocumentationHong Dai ThanhAjith S
YARN-3857Memory leak in ResourceManager with SIMPLE modeCriticalresourcemanagermujunchaomujunchao
YARN-4028AppBlock page key update and diagnostics value null on recoveryMinor.Bibin A ChundattBibin A Chundatt
HDFS-8908TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanodeMinortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8867Enable optimized block reportsMajor.Rushabh S ShahDaryn Sharp
HADOOP-12317Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOSTCritical.Anubhav DhootAnubhav Dhoot
HDFS-8863The remaining space check in BlockPlacementPolicyDefault is flawedCritical.Kihwal LeeKihwal Lee
HDFS-8922Link the native_mini_dfs test library with libdl, since IBM Java requires itMajorbuildAyappanAyappan
HDFS-8809HDFS fsck reports under construction blocks as “CORRUPT”MajortoolsSudhir PrakashJing Zhao
MAPREDUCE-6454MapReduce doesn't set the HADOOP_CLASSPATH for jar lib in distributed cache.Critical.Junping DuJunping Du
MAPREDUCE-6357MultipleOutputs.write() API should document that output committing is not utilized when input path is absoluteMajordocumentationIvan MiticDustin Cote
YARN-3986getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface insteadMajorschedulerVarun SaxenaVarun Saxena
HADOOP-12347Fix mismatch parameter name in javadocs of AuthToken#setMaxInactivesTrivial.Xiaoyu YaoXiaoyu Yao
HDFS-8942Update hyperlink to rack awareness page in HDFS Architecture documentationTrivialdocumentationMasatake IwasakiMasatake Iwasaki
YARN-3896RMNode transitioned from RUNNING to REBOOTED because its response id had not been reset synchronouslyMajorresourcemanagerJun GongJun Gong
HDFS-8930Block report lease may leak if the 2nd full block report comes when NN is still in safemodeMinor.Jing ZhaoJing Zhao
HDFS-8932NPE thrown in NameNode when try to get “TotalSyncCount” metric before editLogStream initializationMajor.Surendra Singh LilhoreSurendra Singh Lilhore
HADOOP-12352Delay in checkpointing Trash can leave trash for 2 intervals before deletingTrivialtrashCasey BrothertonCasey Brotherton
HDFS-8846Add a unit test for INotify functionality across a layout version upgradeMajornamenodeZhe ZhangZhe Zhang
HDFS-8896DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManagerMinortestWalter SuWalter Su
HDFS-8961Surpress findbug warnings of o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager in hdfs-clientMajor.Haohui MaiMingliang Liu
HADOOP-12362Set hadoop.tmp.dir and hadoop.log.dir in pomMajor.Charlie HelinCharlie Helin
HDFS-8969Clean up findbugs warnings for HDFS-8823 and HDFS-8932MajornamenodeAnu EngineerAnu Engineer
HDFS-8963Fix incorrect sign extension of xattr length in HDFS-8900Critical.Haohui MaiColin P. McCabe
YARN-1556NPE getting application report with a null appIdMinorclientSteve LoughranWeiwei Yang
MAPREDUCE-6452NPE when intermediate encrypt enabled for LocalRunnerMajor.Bibin A Chundattzhihai xu
HDFS-8950NameNode refresh doesn't remove DataNodes that are no longer in the allowed listMajordatanode, namenodeDaniel TempletonDaniel Templeton
HADOOP-12346Increase some default timeouts / retries for S3a connectorMajorfs/s3Sean MackrorySean Mackrory
HADOOP-12359hadoop fs -getmerge doc is wrongMajordocumentationDaniel TempletonJagadesh Kiran N
HADOOP-10365BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally blockMinorutilTed YuKiran Kumar M R
HDFS-8995Flaw in registration bookeeping can make DN die on reconnectCritical.Kihwal LeeKihwal Lee
HDFS-8388Time and Date format need to be in sync in NameNode UI pageMinor.Archana TSurendra Singh Lilhore
YARN-4073Unused ApplicationACLsManager in ContainerManagerImplTrivial.Naganarasimha G RNaganarasimha G R
HDFS-9003ForkJoin thread pool leaksMajor.Kihwal LeeKihwal Lee
HDFS-8885ByteRangeInputStream used in webhdfs does not override available()MinorwebhdfsShradha RevankarShradha Revankar
HADOOP-10318Incorrect reference to nodeFile in RumenToSLSConverter error messageMinor.Ted YuWei Yan
HADOOP-12213Interrupted exception can occur when Client#stop is calledMinor.Oleg ZhurakouskyKuhu Shukla
HDFS-9009Send metrics logs to NullAppender by defaultMajorloggingArpit AgarwalArpit Agarwal
HDFS-8964When validating the edit log, do not read at or beyond the file offset that is being writtenMajorjournal-node, namenodeZhe ZhangZhe Zhang
HDFS-8939Test(S)WebHdfsFileContextMainOperations failing on branch-2MajorwebhdfsJakob HomanChris Nauroth
YARN-4103RM WebServices missing scheme for appattempts logLinksMajor.Jonathan EaglesJonathan Eagles
YARN-4105Capacity Scheduler headroom for DRF is wrongMajorcapacityschedulerChang LiChang Li
MAPREDUCE-6442Stack trace is missing when error occurs in client protocol provider's constructorMajorclientChang LiChang Li
YARN-3591Resource localization on a bad disk causes subsequent containers failureMajor.Lavkesh LahngirLavkesh Lahngir
YARN-4121Typos in capacity scheduler documentation.TrivialdocumentationKai SasakiKai Sasaki
YARN-4096App local logs are leaked if log aggregation fails to initialize for the appMajorlog-aggregation, nodemanagerJason LoweJason Lowe
HADOOP-12388Fix components' version information in the web page ‘About the Cluster’MinorutilJun GongJun Gong
HDFS-9033dfsadmin -metasave prints “NaN” for cache used%Major.Archana TBrahma Reddy Battula
HDFS-8716introduce a new config specifically for safe mode block countMajor.Chang LiChang Li
HDFS-8581ContentSummary on / skips further counts on yielding lockMinornamenodetongshiquanJ.Andreina
HDFS-6763Initialize file system-wide quota once on transitioning to activeMajorha, namenodeDaryn SharpKihwal Lee
MAPREDUCE-6474ShuffleHandler can possibly exhaust nodemanager file descriptorsMajormrv2, nodemanagerNathan RobertsKuhu Shukla
YARN-4106NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RMMajor.Bibin A ChundattBibin A Chundatt
YARN-4115Reduce loglevel of ContainerManagementProtocolProxy to DebugMinor.Anubhav DhootAnubhav Dhoot
HADOOP-12348MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter.Majormetricszhihai xuzhihai xu
HDFS-9042Update document for the Storage policy nameMinordocumentationJ.AndreinaJ.Andreina
HDFS-9036In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true.Major.J.AndreinaJ.Andreina
HADOOP-12407Test failing: hadoop.ipc.TestSaslRPCCriticalsecurity, testSteve LoughranSteve Loughran
HADOOP-12087[JDK8] Fix javadoc errors caused by incorrect or illegal tagsMajordocumentationAkira AjisakaAkira Ajisaka
HDFS-9069TestNameNodeMetricsLogger failing -port in useCriticaltestSteve LoughranSteve Loughran
HDFS-8996Consolidate validateLog and scanLog in FJM#EditLogFileMajorjournal-node, namenodeZhe ZhangZhe Zhang
YARN-4151Fix findbugs errors in hadoop-yarn-server-common moduleMajor.MENG DINGMENG DING
HDFS-9067o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunkCritical.Haohui MaiSurendra Singh Lilhore
MAPREDUCE-6472MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasksMajormr-amJason LoweNaganarasimha G R
HADOOP-12374Description of hdfs expunge command is confusingMajordocumentation, trashWeiwei YangWeiwei Yang
YARN-4078getPendingResourceRequestForAttempt is present in AbstractYarnScheduler should be present in YarnScheduler interface insteadMinorresourcemanagerNaganarasimha G RNaganarasimha G R
HDFS-9072Fix random failures in TestJMXGetCriticaltestJ.AndreinaJ.Andreina
HDFS-9073Fix failures in TestLazyPersistLockedMemory#testReleaseOnEvictionCriticaltestJ.AndreinaJ.Andreina
YARN-3433Jersey tests failing with Port in Use -againCriticalbuild, testSteve LoughranBrahma Reddy Battula
HADOOP-12417TestWebDelegationToken failing with port in useMajortestSteve LoughranMingliang Liu
MAPREDUCE-6481LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.Criticalmrv2zhihai xuzhihai xu
MAPREDUCE-5002AM could potentially allocate a reduce container to a map attemptMajormr-amJason LoweChang Li
MAPREDUCE-5982Task attempts that fail from the ASSIGNED state can disappearMajormr-amJason LoweChang Li
HADOOP-12386RetryPolicies.RETRY_FOREVER should be able to specify a retry intervalMajor.Wangda TanSunil G
YARN-3697FairScheduler: ContinuousSchedulingThread can fail to shutdownCriticalfairschedulerzhihai xuzhihai xu
HDFS-6955DN should reserve disk space for a full block when creating tmp filesMajordatanodeArpit AgarwalKanaka Kumar Avvaru
HDFS-5802NameNode does not check for inode type before traversing down a pathTrivialnamenodeHarsh JXiao Chen
MAPREDUCE-6460TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException failsMajortestzhihai xuzhihai xu
YARN-4167NPE on RMActiveServices#serviceStop when store is nullMinor.Bibin A ChundattBibin A Chundatt
YARN-4113RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVERCritical.Wangda TanSunil G
YARN-4188MoveApplicationAcrossQueuesResponse should be an abstract classMinorresourcemanagerGiovanni Matteo FumarolaGiovanni Matteo Fumarola
HDFS-9043Doc updation for commands in HDFS FederationMinordocumentationJ.AndreinaJ.Andreina
HDFS-9013Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunkMajornamenodeSurendra Singh LilhoreSurendra Singh Lilhore
YARN-3975WebAppProxyServlet should not redirect to RM page if AHS is enabledMajor.Mit DesaiMit Desai
HADOOP-12438Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystemTrivialtestChris NaurothChris Nauroth
HDFS-9128TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows.TrivialtestChris NaurothChris Nauroth
YARN-4152NM crash with NPE when LogAggregationService#stopContainer called for absent containerCriticallog-aggregation, nodemanagerBibin A ChundattBibin A Chundatt
YARN-4044Running applications information changes such as movequeue is not published to TimeLine serverCriticalresourcemanager, timelineserverSunil GSunil G
HDFS-9076Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten()Majorhdfs-clientSurendra Singh LilhoreSurendra Singh Lilhore
MAPREDUCE-6484Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.Majorclient, securityzhihai xuzhihai xu
HADOOP-12437Allow SecurityUtil to lookup alternate hostnamesMajornet, securityArpit AgarwalArpit Agarwal
HADOOP-12252LocalDirAllocator should not throw NPE with empty string configuration.Minorfszhihai xuzhihai xu
YARN-3624ApplicationHistoryServer reverses the order of the filters it getsMajortimelineserverMit DesaiMit Desai
HDFS-9123Copying from the root to a subdirectory should be forbiddenMinorfsWei-Chiu ChuangWei-Chiu Chuang
MAPREDUCE-6480archive-logs tool may miss applicationsMajor.Robert KanterRobert Kanter
HDFS-9107Prevent NN's unrecoverable death spiral after full GCCriticalnamenodeDaryn SharpDaryn Sharp
HDFS-9133ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOFMajorhdfs-clientColin P. McCabeColin P. McCabe
HDFS-9080update htrace version to 4.0.1MajortracingColin P. McCabeColin P. McCabe
YARN-4204ConcurrentModificationException in FairSchedulerQueueInfoMajor.Anubhav DhootAnubhav Dhoot
HDFS-9106Transfer failure during pipeline recovery causes permanent write failuresCritical.Kihwal LeeKihwal Lee
HDFS-9147Fix the setting of visibleLength in ExternalBlockReaderMajorhdfs-clientColin P. McCabeColin P. McCabe
MAPREDUCE-6492AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTaskCritical.Bibin A ChundattBibin A Chundatt
HADOOP-12440TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting downMinor.Xiao ChenXiao Chen
HDFS-9092Nfs silently drops overlapping write requests and causes data copying to failMajornfsYongjun ZhangYongjun Zhang
YARN-4180AMLauncher does not retry on failures when talking to NMCriticalresourcemanagerAnubhav DhootAnubhav Dhoot
HDFS-9141Thread leak in Datanode#refreshVolumesMajordatanodeUma Maheswara Rao GUma Maheswara Rao G
YARN-4066Large number of queues choke fair schedulerMajorfairschedulerJohan GustavssonJohan Gustavsson
HADOOP-12447Clean up some htrace integration issuesMajortracingColin P. McCabeColin P. McCabe
HDFS-9174Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThreadCritical.Yi LiuYi Liu
HDFS-9001DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated clusterMajor.Daniel TempletonDaniel Templeton
HADOOP-12448TestTextCommand: use mkdirs rather than mkdir to create test directoryMajortestColin P. McCabeColin P. McCabe
MAPREDUCE-6494Permission issue when running archive-logs tool as different usersMajor.Robert KanterRobert Kanter
MAPREDUCE-6497Fix wrong value of JOB_FINISHED event in JobHistoryEventHandlerMajor.Shinichi YamashitaShinichi Yamashita
HADOOP-10296Incorrect null check in SwiftRestClient#buildException()Minor.Ted YuKanaka Kumar Avvaru
HADOOP-8437getLocalPathForWrite should throw IOException for invalid pathsMajorfsBrahma Reddy BattulaBrahma Reddy Battula
MAPREDUCE-6485MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to runCriticalapplicationmasterBob.zhaoXianyin Xin
HDFS-9191Typo in Hdfs.java. NoSuchElementException is misspelledTrivialdocumentationCatherine PalmerCatherine Palmer
HDFS-9100HDFS Balancer does not respect dfs.client.use.datanode.hostnameMajorbalancer & moverYongjun ZhangCasey Brotherton
YARN-3619ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationExceptionMajornodemanagerJason Lowezhihai xu
HDFS-9193Fix incorrect references the usages of the DN in dfshealth.jsMinor.Chang LiChang Li
HADOOP-11098[JDK8] Max Non Heap Memory default changed between JDK7 and 8Major.Travis ThompsonTsuyoshi Ozawa
HADOOP-12441Fix kill command behavior under some Linux distributions.Critical.Wangda TanWangda Tan
HADOOP-12452Fix tracing documention reflecting the update to htrace-4MajordocumentationMasatake IwasakiMasatake Iwasaki
YARN-4176Resync NM nodelabels with RM periodically for distributed nodelabelsMajor.Bibin A ChundattBibin A Chundatt
HDFS-7899Improve EOF error messageMinorhdfs-clientHarsh JJagadesh Kiran N
MAPREDUCE-6503archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOMEMajor.Robert KanterRobert Kanter
YARN-4209RMStateStore FENCED state doesn't work due to updateFencedState called by stateMachine.doTransitionCriticalresourcemanagerzhihai xuzhihai xu
HDFS-9196Fix TestWebHdfsContentLengthMajor.Tsuyoshi OzawaMasatake Iwasaki
HDFS-9178Slow datanode I/O can cause a wrong node to be marked badCritical.Kihwal LeeKihwal Lee
HADOOP-12465Incorrect javadoc in WritableUtils.javaMinordocumentationMartin PetricekJagadesh Kiran N
HDFS-9176TestDirectoryScanner#testThrottling often fails.MinortestYi LiuDaniel Templeton
HDFS-9211Fix incorrect version in hadoop-hdfs-native-client/pom.xml from HDFS-9170 branch-2 backportMajorbuildEric PayneEric Payne
HDFS-9137DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceededMajordatanodeUma Maheswara Rao GUma Maheswara Rao G
HDFS-8164cTime is 0 in VERSION file for newly formatted NameNode.MinornamenodeChris NaurothXiao Chen
YARN-4235FairScheduler PrimaryGroup does not handle empty groups returned for a userMajorfairschedulerAnubhav DhootAnubhav Dhoot
MAPREDUCE-6302Preempt reducers after a configurable timeout irrespective of headroomCritical.mai shurongKarthik Kambatla
HDFS-9142Separating Configuration object for namenode(s) in MiniDFSClusterMajor.Siqi LiSiqi Li
HDFS-8941DistributedFileSystem listCorruptFileBlocks API should resolve relative pathMajorhdfs-clientRakesh RRakesh R
HDFS-9222Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-clientMajor.Haohui MaiMingliang Liu
YARN-4201AMBlacklist does not work for miniclusterMajorresourcemanagerJun GongJun Gong
HDFS-9215Suppress the RAT warnings in hdfs-native-client moduleMinor.Haohui MaiHaohui Mai
HDFS-9224TestFileTruncate fails intermittently with BindExceptionMajortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-4017container-executor overuses PATH_MAXMajornodemanagerAllen WittenauerSidharta Seethana
HDFS-8676Delayed rolling upgrade finalization can cause heartbeat expiration and write failuresCritical.Kihwal LeeWalter Su
HADOOP-12474MiniKMS should use random ports for Jetty server by defaultMajor.Mingliang LiuMingliang Liu
HADOOP-12449TestDNS and TestNetUtils failing if no networkMinortestSteve LoughranSteve Loughran
HADOOP-11515Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7MajorbuildJohannes ZillmannTsuyoshi Ozawa
HDFS-9235hdfs-native-client build getting errors when built with cmake 2.6Minorhdfs-clientEric PayneEric Payne
HDFS-8779WebUI fails to display block IDs that are larger than 2^53 - 1MinorwebhdfsWalter SuHaohui Mai
HDFS-9187Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystemMajortracingstackColin P. McCabe
HDFS-1172Blocks in newly completed files are considered under-replicated too quicklyMajornamenodeTodd LipconMasatake Iwasaki
YARN-4250NPE in AppSchedulingInfo#isRequestLabelChangedMajorresourcemanager, schedulerBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-12478Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath()CriticalutilSteve LoughranSteve Loughran
HDFS-9220Reading small file (< 512 bytes) that is open for append fails due to incorrect checksumBlocker.Bogdan RaducanuJing Zhao
HADOOP-12479ProtocMojo does not log the reason for a protoc compilation failure.MinorbuildChris NaurothChris Nauroth
HADOOP-11628SPNEGO auth does not work with CNAMEs in JDK8BlockersecurityDaryn SharpDaryn Sharp
YARN-2597MiniYARNCluster should propagate reason for AHS not startingMajortestSteve LoughranSteve Loughran
YARN-4155TestLogAggregationService.testLogAggregationServiceWithInterval failingCriticaltestSteve LoughranBibin A Chundatt
HADOOP-10941Proxy user verification NPEs if remote host is unresolvableCriticalipc, securityDaryn SharpBenoy Antony
HADOOP-12483Maintain wrapped SASL ordering for postponed IPC responsesCriticalipcDaryn SharpDaryn Sharp
HDFS-9237NPE at TestDataNodeVolumeFailureToleration#tearDownMajortestBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-12464Interrupted client may try to fail-over and retryMajoripcKihwal LeeKihwal Lee
YARN-4270Limit application resource reservation on nodes for non-node/rack specific requestsMajorfairschedulerArun SureshArun Suresh
HDFS-9208Disabling atime may fail clients like distCpMajor.Kihwal LeeKihwal Lee
HDFS-9270TestShortCircuitLocalRead should not leave socket after unit testMinortestMasatake IwasakiMasatake Iwasaki
HADOOP-12418TestRPC.testRPCInterruptedSimple fails intermittentlyMajortestSteve LoughranKihwal Lee
MAPREDUCE-6495Docs for archive-logs toolMajordocumentationRobert KanterRobert Kanter
HDFS-3059ssl-server.xml causes NullPointerMinordatanode, securityEvert LammertsXiao Chen
HDFS-9274Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistentTrivialdatanodeYi LiuYi Liu
MAPREDUCE-6518Set SO_KEEPALIVE on shuffle connectionsMajormrv2, nodemanagerNathan RobertsChang Li
HDFS-9225Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRackMinortestMasatake IwasakiMasatake Iwasaki
HDFS-9273ACLs on root directory may be lost after NN restartCriticalnamenodeXiao ChenXiao Chen
YARN-4000RM crashes with NPE if leaf queue becomes parent queue during restartMajorcapacityscheduler, resourcemanagerJason LoweVarun Saxena
HADOOP-9692Improving log message when SequenceFile reader throws EOFException on zero-length fileMajor.Chu TongZhe Zhang
YARN-4256YARN fair scheduler vcores with decimal valuesMinorfairschedulerPrabhu JosephJun Gong
HADOOP-12484Single File Rename Throws Incorrectly In Potential Race Condition ScenariosMajortoolsGaurav KanadeGaurav Kanade
HDFS-9286HttpFs does not parse ACL syntax correctly for operation REMOVEACLENTRIESMajorfsWei-Chiu ChuangWei-Chiu Chuang
YARN-4009CORS support for ResourceManager REST APIMajor.Prakash RamachandranVarun Vasudev
YARN-4041Slow delegation token renewal can severely prolong RM recoveryMajorresourcemanagerJason LoweSunil G
HDFS-9290DFSClient#callAppend() is not backward compatible for slightly older NameNodesBlocker.Tony WuTony Wu
HDFS-9301HDFS clients can't construct HdfsConfiguration instancesMajor.Steve LoughranMingliang Liu
YARN-4294[JDK8] Fix javadoc errors caused by wrong reference and illegal tagBlockerbuild, documentationAkira AjisakaAkira Ajisaka
YARN-4289TestDistributedShell failing with bind exceptionMajortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-4296DistributedShell Log.info is not friendlyMajorapplications/distributed-shellXiaowei WangXiaowei Wang
YARN-4246NPE while listing app attemptMajor.Varun Saxenanijel
YARN-4223Findbugs warnings in hadoop-yarn-server-nodemanager projectMinornodemanagerVarun SaxenaVarun Saxena
HADOOP-12513Dockerfile lacks initial ‘apt-get update’TrivialbuildAkihiro SudaAkihiro Suda
YARN-4284condition for AM blacklisting is too narrowMajorresourcemanagerSangjin LeeSangjin Lee
HDFS-9268fuse_dfs chown crashes when uid is passed as -1Minor.Wei-Chiu ChuangColin P. McCabe
HDFS-9284fsck command should not print exception trace when file not foundMajor.Jagadesh Kiran NJagadesh Kiran N
HDFS-9305Delayed heartbeat processing causes storm of subsequent heartbeatsMajordatanodeChris NaurothArpit Agarwal
YARN-4169Fix racing condition of TestNodeStatusUpdaterForLabelsCriticaltestSteve LoughranNaganarasimha G R
YARN-4300[JDK8] Fix javadoc errors caused by wrong tagsBlockerbuild, documentationAkira AjisakaAkira Ajisaka
YARN-4302SLS not able start due to NPE in SchedulerApplicationAttempt#getResourceUsageReportMajor.Bibin A ChundattBibin A Chundatt
HADOOP-12178NPE during handling of SASL setup if problem with SASL resolver classMinoripcSteve LoughranSteve Loughran
HADOOP-11685StorageException complaining " no lease ID" during HBase distributed log splittingMajortoolsDuo XuDuo Xu
HDFS-9231fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshotMajorsnapshotsXiao ChenXiao Chen
HDFS-9302WebHDFS truncate throws NullPointerException if newLength is not providedMinorwebhdfsKarthik PalaniappanJagadesh Kiran N
YARN-4251TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failingMajortestBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-12519hadoop-azure tests should avoid creating a metrics configuration file in the module root directory.Minorfs/azure, testChris NaurothChris Nauroth
HDFS-9279Decomissioned capacity should not be considered for configured/used capacityMajor.Kuhu ShuklaKuhu Shukla
HDFS-9044Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node GroupMajor.J.AndreinaJ.Andreina
YARN-4130Duplicate declaration of ApplicationId in RMAppManager#submitApplication methodTrivialresourcemanagerKai SasakiKai Sasaki
YARN-4288NodeManager restart should keep retrying to register to RM while connection exception happens during RM failed over.CriticalnodemanagerJunping DuJunping Du
MAPREDUCE-6515Update Application priority in AM side from AM-RM heartbeatMajorapplicationmasterSunil GSunil G
HDFS-9332Fix Precondition failures from NameNodeEditLogRoller while saving namespaceMajor.Andrew WangAndrew Wang
YARN-4313Race condition in MiniMRYarnCluster when getting history server addressMajor.Jian HeJian He
YARN-4312TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time outMajor.Varun SaxenaVarun Saxena
YARN-4320TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188Major.Varun SaxenaVarun Saxena
MAPREDUCE-6528Memory leak for HistoryFileManager.getJobSummary()CriticaljobhistoryserverJunping DuJunping Du
MAPREDUCE-6451DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamicMajordistcpKuhu ShuklaKuhu Shukla
HADOOP-12533Introduce FileNotFoundException in WASB for read and seek APIMajortoolsDushyanthDushyanth
HADOOP-12508delete fails with exception when lease is held on blobBlockerfs/azureGaurav KanadeGaurav Kanade
HDFS-9329TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer sizeMinortestZhe ZhangZhe Zhang
HDFS-9313Possible NullPointerException in BlockManager if no excess replica can be chosenMajor.Ming MaMing Ma
HADOOP-12542TestDNS fails on Windows after HADOOP-12437.MajornetChris NaurothChris Nauroth
YARN-4326Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188Major.MENG DINGMENG DING
HDFS-9289Make DataStreamer#block thread safe and verify genStamp in commitBlockCritical.Chang LiChang Li
YARN-4127RM fail with noAuth error if switched from failover mode to non-failover modeMajorresourcemanagerJian HeVarun Saxena
HDFS-9351checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs()MajornamenodeYongjun ZhangXiao Chen
HADOOP-12296when setnetgrent returns 0 in linux, exception should be thrownMajor.Chang LiChang Li
HDFS-9357NN UI renders icons of decommissioned DN incorrectlyCritical.Archana TSurendra Singh Lilhore
HADOOP-12540TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown.Majorfs/azure, testChris NaurothGaurav Kanade
HDFS-9360Storage type usage isn't updated properly after file deletionMajor.Ming MaMing Ma
HDFS-9378hadoop-hdfs-client tests do not write logs.MinortestChris NaurothChris Nauroth
HDFS-4937ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()MajornamenodeKihwal LeeKihwal Lee
HDFS-9372Remove dead code in DataStorage.recoverTransitionReadMajordatanodeDuo ZhangDuo Zhang
HDFS-9384TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.MinortestChris NaurothChris Nauroth
HDFS-6481DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDsMinornamenodeTed YuTsz Wo Nicholas Sze
HDFS-9318considerLoad factor can be improvedMajor.Kuhu ShuklaKuhu Shukla
HDFS-9236Missing sanity check for block size during block recoveryMajordatanodeTony WuTony Wu
HDFS-9394branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing.Criticalhdfs-clientChris NaurothMingliang Liu
HADOOP-12526[Branch-2] there are duplicate dependency definitions in pom'sMajorbuildSangjin LeeSangjin Lee
MAPREDUCE-5763Warn message about httpshuffle in NM logsMajor.Sandy RyzaAkira Ajisaka
HDFS-9383TestByteArrayManager#testByteArrayManager failsMajor.Kihwal LeeTsz Wo Nicholas Sze
HDFS-9249NPE is thrown if an IOException is thrown in NameNode constructorMinornamenodeWei-Chiu ChuangWei-Chiu Chuang
HDFS-2261AOP unit tests are not getting compiled or runMinortestGiridharan KesavanHaohui Mai
HDFS-9401Fix findbugs warnings in BlockRecoveryWorkerMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12482Race condition in JMX cache updateMajor.Tony WuTony Wu
HDFS-9364Unnecessary DNS resolution attempts when creating NameNodeProxiesMajorha, performanceXiao ChenXiao Chen
HADOOP-12560Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344MajornativeColin P. McCabeMingliang Liu
HDFS-9245Fix findbugs warnings in hdfs-nfs/WriteCtxMajornfsMingliang LiuMingliang Liu
YARN-4241Fix typo of property name in yarn-default.xmlMajordocumentationAnthony RojasAnthony Rojas
MAPREDUCE-6533testDetermineCacheVisibilities of TestClientDistributedCacheManager is brokenMajor.Chang LiChang Li
HDFS-9396Total files and directories on jmx and web UI on standby is uninitializedBlocker.Kihwal LeeKihwal Lee
MAPREDUCE-6540TestMRTimelineEventHandling failsMajortestSangjin LeeSangjin Lee
YARN-4347Resource manager fails with Null pointer exceptionMajoryarnYesha VoraJian He
HADOOP-12545Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCpMajordocumentationMohammad ArshadMohammad Arshad
YARN-4354Public resource localization fails with NPEBlockernodemanagerJason LoweJason Lowe
HDFS-9413getContentSummary() on standby should throw StandbyExceptionCritical.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-9358TestNodeCount#testNodeCount timed outMajortestWei-Chiu ChuangMasatake Iwasaki
HDFS-9397Fix typo for readChecksum() LOG.warn in BlockSender.javaTrivial.Enrique FloresEnrique Flores
HDFS-9400TestRollingUpgradeRollback fails on branch-2.Blocker.Chris NaurothBrahma Reddy Battula
YARN-4367SLS webapp doesn't loadMajorscheduler-load-simulatorKarthik KambatlaKarthik Kambatla
HDFS-9431DistributedFileSystem#concat fails if the target path is relative.Majorhdfs-clientKazuho FujiiKazuho Fujii
YARN-2859ApplicationHistoryServer binds to default port 8188 in MiniYARNClusterCriticaltimelineserverHitesh ShahVinod Kumar Vavilapalli
YARN-4374RM capacity scheduler UI rounds user limit factorMajorcapacityschedulerChang LiChang Li
YARN-3769Consider user limit when calculating total pending resource for preemption policy in Capacity SchedulerMajorcapacityschedulerEric PayneEric Payne
HDFS-9443Disabling HDFS client socket cache causes logging message printed to console for CLI commands.Trivialhdfs-clientChris NaurothChris Nauroth
HADOOP-11218Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactoryCriticalkmsRobert KanterVijay Singh
HADOOP-12467Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scriptsMinorscriptsRadhey ShahRadhey Shah
HADOOP-12181Fix intermittent test failure of TestZKSignerSecretProviderMinor.Masatake IwasakiMasatake Iwasaki
HDFS-6885Fix wrong use of BytesWritable in FSEditLogOp#RenameOpMinornamenodeYi LiuYi Liu
HADOOP-12098Remove redundant test dependencies in Hadoop ArchivesMinor.Varun SaxenaVarun Saxena
HDFS-7897Shutdown metrics when stopping JournalNodeMajor.zhouyingchaozhouyingchao
HADOOP-11149Increase the timeout of TestZKFailoverControllerMajortestRajat JainSteve Loughran
HADOOP-11677Add cookie flags for logs and static contextsMajor.nijelnijel
HDFS-9356Decommissioning node does not have Last Contact value in the UIMajor.Archana TSurendra Singh Lilhore
HADOOP-12313NPE in JvmPauseMonitor when calling stop() before start()Critical.Rohith Sharma K SGabor Liptak
HDFS-9428Fix intermittent failure of TestDNFencing.testQueueingWithAppendMinortestMasatake IwasakiMasatake Iwasaki
HDFS-9435TestBlockRecovery#testRBWReplicas is failing intermittentlyMajor.Rakesh RRakesh R
HADOOP-12577Bump up commons-collections version to 3.2.2 to address a security flawBlockerbuild, securityWei-Chiu ChuangWei-Chiu Chuang
YARN-4344NMs reconnecting with changed capabilities can lead to wrong cluster resource calculationsCriticalresourcemanagerVarun VasudevVarun Vasudev
HADOOP-9822create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructorMinor.Tsuyoshi OzawaTsuyoshi Ozawa
YARN-4298Fix findbugs warnings in hadoop-yarn-commonMinor.Varun SaxenaSunil G
YARN-4387Fix typo in FairScheduler log messageMinorfairschedulerXin WangXin Wang
HDFS-6101TestReplaceDatanodeOnFailure fails occasionallyMajortestArpit AgarwalWei-Chiu Chuang
HDFS-8855Webhdfs client leaks active NameNode connectionsMajorwebhdfsBob HansenXiaobing Zhou
HDFS-8335FSNamesystem should construct FSPermissionChecker only if permission is enabledMajor.David BrysonGabor Liptak
MAPREDUCE-5883“Total megabyte-seconds” in job counters is slightly misleadingMinor.Nathan RobertsNathan Roberts
YARN-4365FileSystemNodeLabelStore should check for root dir existence on startupMajorresourcemanagerJason LoweKuhu Shukla
HDFS-8807dfs.datanode.data.dir does not handle spaces between storageType and URI correctlyMajordatanodeAnu EngineerAnu Engineer
HADOOP-12415hdfs and nfs builds broken on -missing compile-time dependency on nettyMajornfsKonstantin BoudnikTom Zeng
MAPREDUCE-6553Replace ‘\u2b05’ with ‘<-’ in rendering job configurationMinorjobhistoryserverAkira AjisakaGabor Liptak
HADOOP-12598add XML namespace declarations for some hadoop/tools modulesMinorbuild, toolsXin WangXin Wang
YARN-4380TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittentlyMajortestTsuyoshi OzawaVarun Saxena
MAPREDUCE-6557Some tests in mapreduce-client-app are writing outside of targetBlockerbuildAllen WittenauerAkira Ajisaka
HDFS-9459hadoop-hdfs-native-client fails test build on Windows after transition to ctest.Blockerbuild, testChris NaurothChris Nauroth
HDFS-9407TestFileTruncate fails with BindExceptionMajortestBrahma Reddy BattulaBrahma Reddy Battula
HDFS-9467Fix data race accessing writeLockHeldTimeStamp in FSNamesystemMajornamenodeMingliang LiuMingliang Liu
MAPREDUCE-6549multibyte delimiters with LineRecordReader cause duplicate recordsMajormrv1, mrv2Dustin CoteWilfred Spiegelenburg
MAPREDUCE-6550archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutorMajor.Robert KanterRobert Kanter
HADOOP-12468Partial group resolution failure should not result in user lockoutMinorsecurityWei-Chiu ChuangWei-Chiu Chuang
HDFS-9426Rollingupgrade finalization is not backward compatibleBlocker.Kihwal LeeKihwal Lee
HADOOP-10406TestIPC.testIpcWithReaderQueuing may failMajoripcTsz Wo Nicholas SzeXiao Chen
HDFS-9470Encryption zone on root not loaded from fsimage after NN restartCritical.Xiao ChenXiao Chen
HDFS-9336deleteSnapshot throws NPE when snapshotname is nullMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12609Fix intermittent failure of TestDecayRpcSchedulerMinoripc, testMasatake IwasakiMasatake Iwasaki
HDFS-6533TestBPOfferService#testBasicFunctionalitytest fails intermittentlyMajordatanode, hdfs-clientYongjun ZhangWei-Chiu Chuang
YARN-4398Yarn recover functionality causes the cluster running slowly and the cluster usage rate is far below 100MajorresourcemanagerNING DINGNING DING
HDFS-9294DFSClient deadlock when close file and failed to renew leaseBlockerhdfs-clientDENG FEIBrahma Reddy Battula
HADOOP-12565Replace DSA with RSA for SSH key type in SingleCluster.mdMinordocumentationAlexander VeitMingliang Liu
YARN-4408NodeManager still reports negative running containersMajornodemanagerRobert KanterRobert Kanter
HDFS-9430Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started.Major.Brahma Reddy BattulaBrahma Reddy Battula
YARN-4392ApplicationCreatedEvent event time resets after RM restart/failoverCritical.Xuan GongNaganarasimha G R
YARN-4422Generic AHS sometimes doesn't show started, node, or logs on App pageMajor.Eric PayneEric Payne
YARN-4424Fix deadlock in RMAppImplBlocker.Yesha VoraJian He
HADOOP-12617SPNEGO authentication request to non-default realm gets default realm name inserted in target server principalMajorsecurityMatt FoleyMatt Foley
YARN-4431Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RMMajornodemanagerJunping DuJunping Du
YARN-4421Remove dead code in RmAppImpl.RMAppRecoveredTransitionTrivialresourcemanagerDaniel TempletonDaniel Templeton
HADOOP-12618NPE in TestSequenceFileMajortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-4434NodeManager Disk Checker parameter documentation is not correctMinordocumentation, nodemanagerTakashi OhnishiWeiwei Yang
HADOOP-12602TestMetricsSystemImpl#testQSize occasionally failMajortestWei-Chiu ChuangMasatake Iwasaki
HDFS-9519Some coding improvement in SecondaryNameNode#mainMajornamenodeYongjun ZhangXiao Chen
HDFS-9514TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowedMajorhdfs-client, testSteve LoughranWei-Chiu Chuang
HDFS-9535Newly completed blocks in IBR should not be considered under-replicated too quicklyMajornamenodeJing ZhaoMingliang Liu
YARN-4418AM Resource Limit per partition can be updated to ResourceUsage as wellMajorresourcemanagerSunil GSunil G
YARN-4403(AM/NM/Container)LivelinessMonitor should use monotonic time when calculating periodCritical.Junping DuJunping Du
YARN-4402TestNodeManagerShutdown And TestNodeManagerResync fails with bind exceptionMajortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-4439Clarify NMContainerStatus#toString method.Major.Jian HeJian He
YARN-4440FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler timeMajorfairschedulerYiqun LinYiqun Lin
HDFS-9516truncate file fails with data dirs on multiple disksMajordatanodeBogdan RaducanuPlamen Jeliazkov
HDFS-8894Set SO_KEEPALIVE on DN server socketsMajordatanodeNathan RobertsKanaka Kumar Avvaru
YARN-4461Redundant nodeLocalityDelay log in LeafQueueTrivialcapacityschedulerJason LoweEric Payne
YARN-4452NPE when submit Unmanaged applicationCritical.Naganarasimha G RNaganarasimha G R
HDFS-9565TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race conditionMinorfs, testWei-Chiu ChuangWei-Chiu Chuang
YARN-4225Add preemption status to yarn queue -status for capacity schedulerMinorcapacity scheduler, yarnEric PayneEric Payne
HDFS-9515NPE when MiniDFSCluster#shutdown is invoked on uninitialized referenceMinor.Wei-Chiu ChuangWei-Chiu Chuang
HDFS-9572Prevent DataNode log spam if a client connects on the data transfer port but sends no data.MajordatanodeChris NaurothChris Nauroth
HDFS-9533seen_txid in the shared edits directory is modified during bootstrappingMajorha, namenodeKihwal LeeKihwal Lee
HDFS-9571Fix ASF Licence warnings in Jenkins reportsMajortestBrahma Reddy BattulaBrahma Reddy Battula
HDFS-9393After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicyMajor.J.AndreinaJ.Andreina
HDFS-9347Invariant assumption in TestQuorumJournalManager.shutdown() is wrongMajortestWei-Chiu ChuangWei-Chiu Chuang
HADOOP-12656MiniKdc throws “address in use” BindExceptionMajor.Wei-Chiu ChuangWei-Chiu Chuang
HADOOP-12636Prevent ServiceLoader failure init for unused FileSystemsMajorfsInigo GoiriInigo Goiri
MAPREDUCE-6583Clarify confusing sentence in MapReduce tutorial documentMinordocumentationchris snowKai Sasaki
HDFS-9505HDFS Architecture documentation needs to be refreshed.MajordocumentationChris NaurothMasatake Iwasaki
YARN-4454NM to nodelabel mapping going wrong after RM restartCritical.Bibin A ChundattBibin A Chundatt
HDFS-9580TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.Majordatanode, namenode, testWei-Chiu ChuangWei-Chiu Chuang
YARN-4477FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling.MajorfairschedulerTao JieTao Jie
HDFS-9589Block files which have been hardlinked should be duplicated before the DataNode appends to the themMajordatanodeColin P. McCabeColin P. McCabe
HDFS-9458TestBackupNode always binds to port 50070, which can cause bind failures.MajortestChris NaurothXiao Chen
YARN-4109Exception on RM scheduler page loading with labelsMinor.Bibin A ChundattMohammad Shahid Khan
MAPREDUCE-6419JobHistoryServer doesn‘t sort properly based on Job ID when Job id’s exceed 9999MajorwebappsDevaraj KMohammad Shahid Khan
HDFS-9597BaseReplicationPolicyTest should update data node stats after adding a data nodeBlockerdatanodeWei-Chiu ChuangWei-Chiu Chuang
HADOOP-12681start-build-env.sh fails in branch-2BlockerbuildAkira AjisakaKengo Seki
HDFS-7163WebHdfsFileSystem should retry reads according to the configured retry policy.MajorwebhdfsEric PayneEric Payne
HADOOP-12559KMS connection failures should trigger TGT renewalMajorsecurityZhe ZhangZhe Zhang
MAPREDUCE-6574MR AM should print host of failed tasks.Major.Wangda TanMohammad Shahid Khan
MAPREDUCE-6589TestTaskLog outputs a log under directory other than target/test-dirMajortestAkira AjisakaAkira Ajisaka
YARN-4315NaN in Queue percentage for cluster apps pageMinor.Bibin A ChundattBibin A Chundatt
YARN-1382Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leakMajorresourcemanagerAlejandro AbdelnurRohith Sharma K S
HADOOP-12682Fix TestKMS#testKMSRestart* failureMajor.Wei-Chiu ChuangWei-Chiu Chuang
HADOOP-12608Fix exception message in WASB when connecting with anonymous credentialMajortoolsDushyanthDushyanth
YARN-4524Cleanup AppSchedulingInfoMajorschedulerKarthik KambatlaKarthik Kambatla
YARN-4510Fix SLS startup failure caused by NPECritical.Bibin A ChundattBibin A Chundatt
MAPREDUCE-6593TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPEMajor.Tsuyoshi OzawaNaganarasimha G R
HDFS-9445Datanode may deadlock while handling a bad volumeBlocker.Kihwal LeeWalter Su
HADOOP-12658Clear javadoc and check style issues around DomainSocketTrivial.Kai ZhengKai Zheng
HADOOP-12604Exception may be swallowed in KMSClientProviderMajorkmsYongjun ZhangYongjun Zhang
HDFS-9605Add links to failed volumes to explorer.html in HDFS Web UIMinor.Archana TArchana T
MAPREDUCE-6577MR AM unable to load native library without MR_AM_ADMIN_USER_ENV setCriticalmr-amSangjin LeeSangjin Lee
HADOOP-12689S3 filesystem operations stopped working correctlyMajortoolsMatthew PaduanoMatthew Paduano
YARN-4546ResourceManager crash due to scheduling opportunity overflowCriticalresourcemanagerJason LoweJason Lowe
HADOOP-12634Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copyCritical.Gaurav KanadeGaurav Kanade
HDFS-9600do not check replication if the block is under constructionCritical.Phil YangPhil Yang
HDFS-9619SimulatedFSDataset sometimes can not find blockpool for the correct namenodeMajordatanode, testWei-Chiu ChuangWei-Chiu Chuang
HADOOP-12675Fix description about retention period in usage of expunge commandMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-12613TestFind.processArguments occasionally failsMajortestWei-Chiu ChuangWei-Chiu Chuang
MAPREDUCE-6508TestNetworkedJob fails consistently due to delegation token changes on RM.MajortestRohith Sharma K SAkira Ajisaka
HDFS-9574Reduce client failures during datanode restartMajor.Kihwal LeeKihwal Lee
HDFS-9493Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunkMajortestMingliang LiuTony Wu
HADOOP-12678Handle empty rename pending metadata file during atomic rename in redo pathCriticalfs/azuremadhumita chakrabortymadhumita chakraborty
HADOOP-12590TestCompressorDecompressor failing without stack tracesCriticaltestSteve LoughranJohn Zhuge
HADOOP-12587Hadoop AuthToken refuses to work without a maxinactive attribute in issued tokenBlockersecuritySteve LoughranBenoy Antony
HADOOP-12551Introduce FileNotFoundException for WASB FileSystem APIMajortoolsDushyanthDushyanth
MAPREDUCE-6068Illegal progress value warnings in map tasksMajormrv2, taskTodd LipconBinglin Chang
HDFS-9639Inconsistent Logging in BootstrapStandbyMinorhaBELUGA BEHRXiaobing Zhou
HDFS-9584NPE in distcp when ssl configuration file does not exist in class path.MajordistcpSurendra Singh LilhoreSurendra Singh Lilhore
HADOOP-12584Disable browsing the static directory in HttpServer2MajorsecurityRobert KanterRobert Kanter
YARN-4567javadoc failing on java 8BlockerbuildSteve LoughranSteve Loughran
YARN-4414Nodemanager connection errors are retried at multiple levelsMajornodemanagerJason LoweChang Li
HADOOP-12603TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally failMajortestWei-Chiu ChuangWei-Chiu Chuang
YARN-4534Remove the redundant symbol in yarn rmadmin help msgTrivial.Yiqun LinYiqun Lin
HADOOP-12700Remove unused import in TestCompressorDecompressor.javaMinor.John ZhugeJohn Zhuge
MAPREDUCE-6601Fix typo in Job#setUseNewAPITrivial.Kai SasakiKai Sasaki
YARN-3446FairScheduler headroom calculation should exclude nodes in the blacklistMajorfairschedulerzhihai xuzhihai xu
HDFS-9648TestStartup.testImageChecksum is broken by HDFS-9569's message changeTrivialnamenodeWei-Chiu ChuangWei-Chiu Chuang
HADOOP-12706TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionallyMajortestJason LoweSangjin Lee
YARN-4581AHS writer thread leak makes RM crash while RM is recoveringMajorresourcemanagersandfleesandflee
MAPREDUCE-6554MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistoryCritical.Bibin A ChundattBibin A Chundatt
YARN-4389“yarn.am.blacklisting.enabled” and “yarn.am.blacklisting.disable-failure-threshold” should be app specific rather than a setting for whole YARN clusterCriticalapplicationsJunping DuSunil G
HDFS-9612DistCp worker threads are not terminated after jobs are done.MajordistcpWei-Chiu ChuangWei-Chiu Chuang
HADOOP-12712Fix some cmake plugin and native build warningsMinornativeColin P. McCabeColin P. McCabe
YARN-4538QueueMetrics pending cores and memory metrics wrongMajor.Bibin A ChundattBibin A Chundatt
YARN-4596SystemMetricPublisher should not swallow error messages from TimelineClient#putEntitiesMajortimelineserverLi LuLi Lu
YARN-4502Fix two AM containers get allocated when AM restartCritical.Yesha VoraVinod Kumar Vavilapalli
HDFS-9623Update example configuration of block state change log in log4j.propertiesMinorloggingMasatake IwasakiMasatake Iwasaki
YARN-4565When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs onlyMajorcapacity scheduler, capacityschedulerKaram SinghWangda Tan
HADOOP-12356Fix computing CPU usage statistics on WindowsMajorutilYunqi ZhangInigo Goiri
HDFS-9661Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbwMajordatanodeadeade
HDFS-9655NN should start JVM pause monitor before loading fsimageCritical.John ZhugeJohn Zhuge
YARN-4559Make leader elector and zk store share the same curator clientMajor.Jian HeJian He
HADOOP-12605Fix intermittent failure of TestIPC.testIpcWithReaderQueuingMinortestMasatake IwasakiMasatake Iwasaki
HDFS-9625set replication for empty file failed when set storage policyMajornamenodeDENG FEIDENG FEI
HADOOP-12423Handle failure of registering shutdownhook by ShutdownHookManager in static blockMinorfsAbhishek AgarwalAbhishek Agarwal
HDFS-9634webhdfs client side exceptions don't provide enough detailsMajorwebhdfsEric PayneEric Payne
YARN-4608Redundant code statement in WritingYarnApplicationsMinordocumentationKai SasakiKai Sasaki
HADOOP-7161Remove unnecessary oro package from dependency management sectionMinorbuildTodd LipconSean Busbey
YARN-4610Reservations continue looking for one app causes other apps to starveBlockercapacityschedulerJason LoweJason Lowe
HADOOP-12659Incorrect usage of config parameters in token manager of KMSMajorsecurityTianyin XuMingliang Liu
MAPREDUCE-6605Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xmlMajordocumentationDong ZhenKai Sasaki
YARN-4605Spelling mistake in the help message of “yarn applicationattempt” commandTrivialclient, yarnManjunath BallurWeiwei Yang
HDFS-9682Fix a typo “aplication” in HttpFS documentTrivialdocumentationWeiwei YangWeiwei Yang
HADOOP-12730Hadoop streaming -mapper and -reducer options are wrongly documented as requiredMajordocumentationDeepakVohraKengo Seki
HDFS-8898Create API and command-line argument to get quota and quota usage without detailed content summaryMajorfsJoep RottinghuisMing Ma
YARN-4598Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILLMajornodemanagertangshangwentangshangwen
YARN-4592Remove unused GetContainerStatus protoMinor.Chang LiChang Li
YARN-4520FinishAppEvent is leaked in leveldb if no app's container running on this nodeMajornodemanagersandfleesandflee
MAPREDUCE-6610JobHistoryEventHandler should not swallow timeline responseTrivial.Li LuLi Lu
HDFS-9690ClientProtocol.addBlock is not idempotent after HDFS-8071MajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-12743Fix git environment check during test-patchMajor.Ray ChiangAllen Wittenauer
HADOOP-12735core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuidMinor.Ray ChiangRay Chiang
MAPREDUCE-6619HADOOP_CLASSPATH is overwritten in MR containerMajormrv2shanyu zhaoJunping Du
HDFS-8999Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.MajornamenodeJitendra Nath PandeyTsz Wo Nicholas Sze
MAPREDUCE-6595Fix findbugs warnings in OutputCommitter and FileOutputCommitterMajor.Akira AjisakaAkira Ajisaka
MAPREDUCE-6563Streaming documentation contains a stray ‘%’ character.TrivialdocumentationChris NaurothChris Nauroth
YARN-4519potential deadlock of CapacityScheduler between decrease container and assign containersMajorcapacityschedulersandfleeMENG DING
MAPREDUCE-6616Fail to create jobhistory file if there are some multibyte characters in the job nameMajorjobhistoryserverAkira AjisakaKousuke Saruta
YARN-4411RMAppAttemptImpl#createApplicationAttemptReport throws IllegalArgumentExceptionMajorresourcemanageryarntimeBibin A Chundatt
YARN-4617LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policyMajorcapacity schedulerRohith Sharma K SRohith Sharma K S
YARN-4428Redirect RM page to AHS page when AHS turned on and RM page is not availableMajor.Chang LiChang Li
MAPREDUCE-6618YarnClientProtocolProvider leaking the YarnClient thread.Major.Xuan GongXuan Gong
HDFS-9210Fix some misuse of %n in VolumeScanner#printStatsMinordatanodeXiaoyu YaoXiaoyu Yao
HDFS-9701DN may deadlock when hot-swapping under loadMajor.Xiao ChenXiao Chen
YARN-3102Decommisioned Nodes not listed in Web UIMinorresourcemanagerBibin A ChundattKuhu Shukla
HDFS-9406FSImage may get corrupted after deleting snapshotMajornamenodeStanislav AnticYongjun Zhang
HDFS-9718HAUtil#getConfForOtherNodes should unset independent generic keys before initializeMajornamenodeDENG FEIDENG FEI
HDFS-9708FSNamesystem.initAuditLoggers() doesn't trim classnamesMinorfsSteve LoughranMingliang Liu
MAPREDUCE-6621Memory Leak in JobClient#submitJobInternal()Major.Xuan GongXuan Gong
HADOOP-12755Fix typo in defaultFS warning messageTrivial.Andrew WangAndrew Wang
HDFS-9739DatanodeStorage.isValidStorageId() is brokenCriticalhdfs-clientKihwal LeeMingliang Liu
HDFS-9740Use a reasonable limit in DFSTestUtil.waitForMetric()MajortestKihwal LeeChang Li
HADOOP-12761incremental maven build is not really incrementalMinorbuildSangjin LeeSangjin Lee
HDFS-9748When addExpectedReplicasToPending is called twice, pendingReplications should avoid duplicationMinor.Walter SuWalter Su
HDFS-9730Storage ID update does not happen when there is a layout changeMajordatanodeKihwal LeeTsz Wo Nicholas Sze
HDFS-9724Degraded performance in WebHDFS listing as it does not reuse ObjectMapperCriticalperformanceAkira AjisakaAkira Ajisaka
HADOOP-12766The default value of “hadoop.workaround.non.threadsafe.getpwuid” is different between core-default.xml and NativeIO.javaMinor.Akira AjisakaAkira Ajisaka
HDFS-9761Rebalancer sleeps too long between iterationsBlockerbalancer & moverAdrian BridgettMingliang Liu
HDFS-9713DataXceiver#copyBlock should return if block is pinnedMajordatanodeUma Maheswara Rao GUma Maheswara Rao G
HADOOP-12773HBase classes fail to load with client/job classloader enabledMajorutilSangjin LeeSangjin Lee
HDFS-9777Fix typos in DFSAdmin command line and documentationTrivialhdfs-clientWei-Chiu ChuangWei-Chiu Chuang
HDFS-9784Example usage is not correct in Transparent Encryption documentMajordocumentationTakashi OhnishiTakashi Ohnishi
HDFS-9752Permanent write failures may happen to slow writers during datanode rolling upgradesCritical.Kihwal LeeWalter Su
HDFS-9760WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handlerMajorwebhdfsRyan SassonRyan Sasson
HDFS-9779TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack valueMinortestKuhu ShuklaKuhu Shukla
HADOOP-12792TestUserGroupInformation#testGetServerSideGroups fails in chrootMinorsecurity, testEric BadgerEric Badger
HDFS-9788Incompatible tag renumbering in HeartbeatResponseProtoBlockerrolling upgradesAndrew WangAndrew Wang
HADOOP-12795KMS does not log detailed stack trace for unexpected errors.MajorkmsChris NaurothChris Nauroth
HADOOP-12699TestKMS#testKMSProvider intermittently fails during ‘test rollover draining’Major.Xiao ChenXiao Chen
HDFS-9790HDFS Balancer should exit with a proper message if upgrade is not finalizedMajor.Xiaobing ZhouXiaobing Zhou
HDFS-9801ReconfigurableBase should update the cached configurationMajordatanodeArpit AgarwalArpit Agarwal
HADOOP-12780During WASB atomic rename handle crash when one directory has been renamed but not file under it.Criticalfs/azuremadhumita chakrabortymadhumita chakraborty
HADOOP-12589Fix intermittent test failure of TestCopyPreserveFlagMajortestTsuyoshi OzawaMasatake Iwasaki
HADOOP-12786“hadoop key” command usage is not documentedMajordocumentationAkira AjisakaXiao Chen
HDFS-9765TestBlockScanner#testVolumeIteratorWithCaching fails intermittentlyMajortestMingliang LiuAkira Ajisaka
HDFS-9456BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacementMajor.Junping DuXiaobing Zhou
HADOOP-12810FileSystem#listLocatedStatus causes unnecessary RPC callsMajorfs, fs/s3Ryan BlueRyan Blue
MAPREDUCE-6341Fix typo in mapreduce tutorialTrivial.John Michael LuyJohn Michael Luy
HADOOP-12787KMS SPNEGO sequence does not work with WEBHDFSMajorkms, securityXiaoyu YaoXiaoyu Yao
HDFS-9815Move o.a.h.fs.Hdfs to hadoop-hdfs-clientBlocker.Haohui MaiVinayakumar B
HDFS-9799Reimplement getCurrentTrashDir to remove incompatibilityBlocker.Zhe ZhangZhe Zhang
YARN-4654Yarn node label CLI should parse “=” correctly when trying to remove all labels on a nodeMajor.Wangda TanNaganarasimha G R
HDFS-6832Fix the usage of ‘hdfs namenode’ commandMinor.Akira AjisakaManjunath Ballur
HDFS-8923Add -source flag to balancer usage messageTrivialbalancer & mover, documentationChris TrezzoChris Trezzo
HDFS-9764DistCp doesn't print value for several arguments including -numListstatusThreadsMinordistcpYongjun ZhangWei-Chiu Chuang
MAPREDUCE-6637Testcase Failure : TestFileInputFormat.testSplitLocationInfoMajortestBrahma Reddy BattulaBrahma Reddy Battula
HDFS-9839Reduce verbosity of processReport loggingMajornamenodeArpit AgarwalArpit Agarwal
HDFS-7452skip StandbyException log for getCorruptFiles()Minor.Brahma Reddy BattulaBrahma Reddy Battula
YARN-4707Remove the extra char (>) from SecureContainer.mdMajordocumentationBrahma Reddy BattulaBrahma Reddy Battula
YARN-4386refreshNodesGracefully() should send recommission event to active RMNodes onlyMinorgracefulKuhu ShuklaKuhu Shukla
HDFS-9842dfs.datanode.balance.bandwidthPerSec should accept friendly size unitsMinorbalancer & moverYiqun LinYiqun Lin
YARN-4709NMWebServices produces incorrect JSON for containersCritical.Varun SaxenaVarun Saxena
MAPREDUCE-6635Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsExceptionCritical.Sergey ShelukhinJunping Du
HDFS-9549TestCacheDirectives#testExceedsCapacity is flakyMajor.Wei-Chiu ChuangXiao Chen
YARN-2046Out of band heartbeats are sent only on container kill and possibly too earlyMajornodemanagerJason LoweMing Ma
HDFS-9844Correct path creation in getTrashRoot to handle root dirBlockerencryptionZhe ZhangZhe Zhang
YARN-4722AsyncDispatcher logs redundant event queue sizesMajor.Jason LoweJason Lowe
HADOOP-12716KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8MajorsecurityXiaoyu YaoXiaoyu Yao
HDFS-9855Modify TestAuditLoggerWithCommands to workaround the absence of HDFS-8332MajortestKuhu ShuklaKuhu Shukla
YARN-4723NodesListManager$UnknownNodeId ClassCastExceptionCriticalresourcemanagerJason LoweKuhu Shukla
HADOOP-12849TestSymlinkLocalFSFileSystem fails intermittentlyMajortestMingliang LiuMingliang Liu
HADOOP-12831LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0MinorfsSteve LoughranMingliang Liu
HADOOP-12846Credential Provider Recursive DependenciesMajor.Larry McCayLarry McCay
HDFS-9864Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs docMajordocumentationBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-12622RetryPolicies (other than FailoverOnNetworkExceptionRetry) should put on retry failed reason or the log from RMProxy's retry could be very misleading.Criticalauto-failoverJunping DuJunping Du
YARN-4748ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReportMajortimelineserverLi LuLi Lu
HADOOP-12851S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProvidersMajorfs/s3Larry McCayLarry McCay
HADOOP-12843Fix findbugs warnings in hadoop-common (branch-2)Major.Akira AjisakaAkira Ajisaka
HDFS-9870Remove unused imports from DFSUtilMajor.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-8791block ID-based DN storage layout can be very slow for datanode on ext4BlockerdatanodeNathan RobertsChris Trezzo
HDFS-9880TestDatanodeRegistration fails occasionallyMajortestKihwal LeeKihwal Lee
HDFS-9881DistributedFileSystem#getTrashRoot returns incorrect path for encryption zonesCritical.Andrew WangAndrew Wang
HDFS-9766TestDataNodeMetrics#testDataNodeTimeSpend fails intermittentlyMajortestMingliang LiuXiao Chen
HDFS-9851Name node throws NPE when setPermission is called on a path that does not existCriticalnamenodeDavid YanBrahma Reddy Battula
HDFS-9886Configuration properties for hedged read is brokenBlocker.Akira AjisakaAkira Ajisaka
HADOOP-12870Fix typo admininistration in CommandsManual.mdMinordocumentationAkira AjisakaJohn Zhuge
HDFS-9048DistCp documentation is out-of-datedMajor.Haohui MaiDaisuke Kobayashi
HADOOP-12871Fix dead link to NativeLibraries.html in CommandsManual.mdMinordocumentationAkira AjisakaBrahma Reddy Battula
HADOOP-12872Fix formatting in ServiceLevelAuth.mdTrivialdocumentationAkira AjisakaBrahma Reddy Battula
MAPREDUCE-4785TestMRApp occasionally failsMajormrv2, testJason LoweHaibo Chen
HADOOP-12717NPE when trying to rename a directory in Windows Azure Storage FileSystemBlocker.Robert YokotaRobert Yokota
YARN-4763RMApps Page crashes with NPEMajorwebappBibin A ChundattBibin A Chundatt
YARN-4761NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair schedulerMajorfairschedulerSangjin LeeSangjin Lee
YARN-4744Too many signal to container failure in case of LCEMajor.Bibin A ChundattSidharta Seethana
YARN-4760proxy redirect to history server uses wrong URLMajorwebappJason LoweEric Badger
HDFS-9865TestBlockReplacement fails intermittently in trunkMajortestYiqun LinYiqun Lin
HDFS-9812Streamer threads leak if failure happens when closing DFSOutputStreamMajorhdfs-clientYiqun LinYiqun Lin
HADOOP-12688Fix deadlinks in Compatibility.mdMajordocumentationAkira AjisakaGabor Liptak
HADOOP-12903IPC Server should allow suppressing exception logging by type, not log ‘server too busy’ messagesMajoripcArpit AgarwalArpit Agarwal
HDFS-9934ReverseXML oiv processor should bail out if the XML file‘s layoutVersion doesn’t match oiv'sMajortoolsColin P. McCabeColin P. McCabe
HDFS-9933ReverseXML should be capitalized in oiv usage messageMinortoolsColin P. McCabeColin P. McCabe
HDFS-9953Download File from UI broken after paginationBlockernamenodeBrahma Reddy BattulaBrahma Reddy Battula
HDFS-9904testCheckpointCancellationDuringUpload occasionally failsMajortestKihwal LeeYiqun Lin
MAPREDUCE-6579JobStatus#getFailureInfo should not output diagnostic information when the job is runningBlockertestRohith Sharma K SAkira Ajisaka
MAPREDUCE-6645TestWordStats outputs logs under directories other than target/test-dirMajortestAkira AjisakaGabor Liptak
HDFS-9874Long living DataXceiver threads cause volume shutdown to block.CriticaldatanodeRushabh S ShahRushabh S Shah
HDFS-3677dfs.namenode.edits.dir.required missing from hdfs-default.xmlMajordocumentation, namenodeTodd LipconMark Yang
HDFS-7166SbNN Web UI shows #Under replicated blocks and #pending deletion blocksMajorhaJuan YuWei-Chiu Chuang
YARN-4686MiniYARNCluster.start() returns before cluster is completely startedMajortestRohith Sharma K SEric Badger
MAPREDUCE-6363[NNBench] Lease mismatch error when running with multiple mappersCriticalbenchmarksBrahma Reddy BattulaBibin A Chundatt
HDFS-10189PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINEMinordatanodeJoe PallasJoe Pallas
MAPREDUCE-6580Test failure : TestMRJobsWithProfilerMajor.Rohith Sharma K SEric Badger
MAPREDUCE-6656[NNBench] OP_DELETE operation isn't working after MAPREDUCE-6363Blocker.J.AndreinaJ.Andreina
HDFS-10193fuse_dfs segfaults if uid cannot be resolved to a usernameMajorfuse-dfsJohn ThiltgesJohn Thiltges
HDFS-10199Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failingMinor.Tibor KissTibor Kiss
YARN-4820ResourceManager web redirects in HA mode drops query parametersMajor.Varun VasudevVarun Vasudev
YARN-4850test-fair-scheduler.xml isn't valid xmlBlockerfairscheduler, testAllen WittenauerYufei Gu
HADOOP-12962KMS key names are incorrectly encoded when creating keyMajor.Xiao ChenXiao Chen
HADOOP-12958PhantomReference for filesystem statistics can trigger OOMMajor.Jason LoweSangjin Lee
HADOOP-12873Remove MRv1 terms from HttpAuthentication.mdMajordocumentationAkira AjisakaBrahma Reddy Battula
HDFS-10182Hedged read might overwrite user's bufMajor.zhouyingchaozhouyingchao
YARN-4773Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabledMinornodemanagerJason LoweJun Gong
MAPREDUCE-6662Clear ASF Warnings on test data filesMinor.Vinayakumar BVinayakumar B
HDFS-9871“Bytes Being Moved” -ve(-1 B) when cluster was already balanced.Major.Brahma Reddy BattulaBrahma Reddy Battula
YARN-4863AHS Security login should be in serviceInit() instead of serviceStart()MajortimelineserverJunping DuJunping Du
HDFS-10197TestFsDatasetCache failing intermittently due to timeoutMajortestYiqun LinYiqun Lin
HDFS-9478Reason for failing ipc.FairCallQueue contruction should be thrownMinor.Archana TAjith S
HDFS-10228TestHDFSCLI failsMajortestAkira AjisakaAkira Ajisaka
YARN-4865Track Reserved resources in ResourceUsage and QueueCapacitiesMajorresourcemanagerSunil GSunil G
HADOOP-12972Lz4Compressor#getLibraryName returns the wrong version numberTrivialnativeJohn ZhugeColin P. McCabe
HDFS-5177blocksScheduled count should be decremented for abandoned blocksMajornamenodeVinayakumar BVinayakumar B
HDFS-10223peerFromSocketAndKey performs SASL exchange before setting connection timeoutsMajor.Colin P. McCabeColin P. McCabe
HDFS-10221Add .json to the rat exclusionsBlockerbuildMing MaMing Ma
HADOOP-12902JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilterMajordocumentationRobert KanterGabor Liptak
YARN-4183Clarify the behavior of timeline service config propertiesMajor.Mit DesaiNaganarasimha G R
HDFS-10253Fix TestRefreshCallQueue failure.Major.Brahma Reddy BattulaXiaoyu Yao
YARN-4746yarn web services should convert parse failures of appId, appAttemptId and containerId to 400MinorwebappSteve LoughranBibin A Chundatt
HDFS-9599TestDecommissioningStatus.testDecommissionStatus occasionally failsMajornamenodeWei-Chiu ChuangYiqun Lin
YARN-4706UI Hosting Configuration in TimelineServer doc is brokenCriticaldocumentationAkira AjisakaAkira Ajisaka
HDFS-10178Permanent write failures can happen if pipeline recoveries occur for the first packetCritical.Kihwal LeeKihwal Lee
HDFS-8496Calling stopWriter() with FSDatasetImpl lock held may block other threadsMajor.zhouyingchaoColin P. McCabe
HDFS-9917IBR accumulate more objects when SNN was down for sometime.Critical.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-10239Fsshell mv fails if port usage doesn't match in src and destination pathsMajor.Kuhu ShuklaKuhu Shukla
YARN-4893Fix some intermittent test failures in TestRMAdminServiceBlocker.Junping DuBrahma Reddy Battula
YARN-4916TestNMProxy.tesNMProxyRPCRetry fails.Minor.Tibor KissTibor Kiss
YARN-4915Fix typo in YARN Secure Containers documentationTrivialdocumentation, yarnTakashi OhnishiTakashi Ohnishi
YARN-4917Fix typos in documentation of Capacity Scheduler.MinordocumentationTakashi OhnishiTakashi Ohnishi
HDFS-10261TestBookKeeperHACheckpoints doesn't handle ephemeral HTTP portsMajor.Eric BadgerEric Badger
YARN-4699Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a nodeCriticalcapacity schedulerSunil GSunil G
HADOOP-12022fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bitsBlockerbuildAllen WittenauerAllen Wittenauer
MAPREDUCE-6670TestJobListCache#testEviction sometimes fails on Windows with timeoutMinortestGergely NovákGergely Novák
HDFS-6520hdfs fsck -move passes invalid length value when creating BlockReaderMajor.Shengjun XinXiao Chen
HDFS-10267Extra “synchronized” on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverCloseMajordatanodeColin P. McCabeColin P. McCabe
YARN-4740AM may not receive the container complete msg when it restartsMajor.sandfleesandflee
MAPREDUCE-6633AM should retry map attempts if the reduce task encounters commpression related errors.Major.Rushabh S ShahRushabh S Shah
YARN-4938MiniYarnCluster should not request transitionToActive to RM on non-HA environmentMajortestAkira AjisakaEric Badger
HADOOP-12406AbstractMapWritable.readFields throws ClassNotFoundException with custom writablesBlockerioNadeem DoubaNadeem Douba
HADOOP-12993Change ShutdownHookManger complete shutdown log from INFO to DEBUGMinor.Xiaoyu YaoXiaoyu Yao
HDFS-10277PositionedReadable test testReadFullyZeroByteFile failing in HDFSMajortestSteve LoughranSteve Loughran
HDFS-10271Extra bytes are getting released from reservedSpace for appendCritical.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-12964Http server vulnerable to clickjackingMajor.Haibo ChenHaibo Chen
YARN-4794Deadlock in NMClientImplCritical.Sumana SathishJian He
HDFS-9772TestBlockReplacement#testThrottler doesn't work as expectedMinor.Yiqun LinYiqun Lin
HDFS-10270TestJMXGet:testNameNode() failsMinortestAndras BokorGergely Novák
HDFS-10216distcp -diff relative path exceptionMajordistcpJohn ZhugeTakashi Ohnishi
YARN-4924NM recovery race can lead to container not cleaned upMajornodemanagerNathan Robertssandflee
HADOOP-12989Some tests in org.apache.hadoop.fs.shell.find occasionally time outMajortestAkira AjisakaTakashi Ohnishi
HADOOP-13026Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticatorCritical.Xuan GongXuan Gong
YARN-4940yarn node -list -all failed if RM start with decommissioned nodeMajor.sandfleesandflee
YARN-4965Distributed shell AM failed due to ClientHandlerException thrown by jerseyCritical.Sumana SathishJunping Du
YARN-4934Reserved Resource for QueueMetrics needs to be handled correctly in few casesMajorcapacity schedulerSunil GSunil G
HDFS-10291TestShortCircuitLocalRead failingMajortestSteve LoughranSteve Loughran
HDFS-10275TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectlyMajortestYiqun LinYiqun Lin
MAPREDUCE-6649getFailureInfo not returning any failure infoMajor.Eric BadgerEric Badger
HDFS-10265OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tagMinortoolsWan ChangWan Chang
HDFS-9744TestDirectoryScanner#testThrottling occasionally time out after 300 secondsMinordatanodeWei-Chiu ChuangYiqun Lin
HDFS-10308TestRetryCacheWithHA#testRetryCacheOnStandbyNN failingMajortestRakesh RRakesh R
HDFS-10312Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.MajornamenodeChris NaurothChris Nauroth
MAPREDUCE-6680JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)MajorjobhistoryserverJunping DuJunping Du
HDFS-9670DistCp throws NPE when source is rootMajordistcpYongjun ZhangJohn Zhuge
HADOOP-13042Restore lost leveldbjni LICENSE and NOTICE changesMajor.Andrew WangAndrew Wang
HADOOP-13043Add LICENSE.txt entries for bundled javascript dependenciesMajor.Andrew WangAndrew Wang
HDFS-10319Balancer should not try to pair storages with different typesMinorbalancer & moverTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-10309Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)Minorbalancer & moverAmit AnandAmit Anand
HDFS-9555LazyPersistFileScrubber should still sleep if there are errors in the clear progressMajor.Phil YangPhil Yang
HADOOP-13052ChecksumFileSystem mishandles crc file permissionsMajorfsDaryn SharpDaryn Sharp
HDFS-9905WebHdfsFileSystem#runWithRetry should display original stack trace on errorMajortestKihwal LeeWei-Chiu Chuang
HADOOP-11418Property “io.compression.codec.lzo.class” does not work with other value besides defaultMajoriofang fang chenYuanbo Liu
HDFS-10318TestJMXGet hides the real error in case of test failureMinortestAndras BokorAndras Bokor
YARN-4556TestFifoScheduler.testResourceOverCommit failsMajorscheduler, testAkihiro SudaAkihiro Suda
HDFS-10329Bad initialisation of StringBuffer in RequestHedgingProxyProvider.javaMinorhaMax SchaeferYiqun Lin
HDFS-10313Distcp need to enforce the order of snapshot names passed to -diffMajordistcpYongjun ZhangYiqun Lin
MAPREDUCE-6199AbstractCounters are not reset completely on deserializationMajor.Anubhav DhootAnubhav Dhoot
HADOOP-13030Handle special characters in passwords in KMS startup scriptMajorkmsXiao ChenXiao Chen
YARN-4955Add retry for SocketTimeoutException in TimelineClientCritical.Xuan GongXuan Gong
HDFS-9958BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.Major.Kuhu ShuklaKuhu Shukla
YARN-5008LeveldbRMStateStore database can grow substantially leading to long recovery timesMajorresourcemanagerJason LoweJason Lowe
YARN-5009NMLeveldbStateStoreService database can grow substantially leading to longer recovery timesMajornodemanagerJason LoweJason Lowe
HADOOP-12378Fix findbugs warnings in hadoop-tools moduleMajortoolsAkira AjisakaAkira Ajisaka
HDFS-10260TestFsDatasetImpl#testCleanShutdownOfVolume often failsMajordatanode, testWei-Chiu ChuangRushabh S Shah
HDFS-10335Mover$Processor#chooseTarget() always chooses the first matching target storage groupCriticalbalancer & moverMingliang LiuMingliang Liu
MAPREDUCE-6672TestTeraSort fails on WindowsMinortestTibor KissTibor Kiss
HDFS-10347Namenode report bad block method doesn't log the bad block or datanode.MinornamenodeRushabh S ShahRushabh S Shah
HADOOP-13072WindowsGetSpaceUsed constructor should be publicMajor.Vinayakumar BVinayakumar B
MAPREDUCE-6537Include hadoop-pipes examples in the release tarballBlockerpipesAllen WittenauerKai Sasaki
HDFS-10353Fix hadoop-hdfs-native-client compilation on WindowsBlockerbuildBrahma Reddy BattulaBrahma Reddy Battula
HDFS-10344DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .TrashMajor.Namit MaheshwariXiaoyu Yao
HADOOP-13080Refresh time in SysInfoWindows is in nanosecondsMajorutilInigo GoiriInigo Goiri
YARN-4834ProcfsBasedProcessTree doesn't track daemonized processesMajornodemanagerNathan RobertsNathan Roberts
HDFS-10320Rack failures may result in NN terminateMajor.Xiao ChenXiao Chen
MAPREDUCE-6675TestJobImpl.testUnusableNode failedMajormrv2Haibo ChenHaibo Chen
YARN-4311Removing nodes from include and exclude lists will not remove them from decommissioned nodes listMajor.Kuhu ShuklaKuhu Shukla
YARN-4984LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.Criticallog-aggregationJunping DuJunping Du
HADOOP-13098Dynamic LogLevel setting page should accept case-insensitive log level stringMajor.Junping DuJunping Du
HDFS-10324Trash directory in an encryption zone should be pre-created with correct permissionsMajorencryptionWei-Chiu ChuangWei-Chiu Chuang
MAPREDUCE-6514Job hangs as ask is not updated after ramping down of all reducersBlockerapplicationmasterVarun SaxenaVarun Saxena
HDFS-2043TestHFlush failing intermittentlyMajortestAaron T. MyersYiqun Lin
HADOOP-12751While using kerberos Hadoop incorrectly assumes names with ‘@’ to be non-simpleCriticalsecurityBolke de BruinBolke de Bruin
MAPREDUCE-6689MapReduce job can infinitely increase number of reducer resource requestsBlocker.Wangda TanWangda Tan
YARN-4747AHS error 500 due to NPE when container start event is missingMajortimelineserverJason LoweVarun Saxena
HDFS-9939Increase DecompressorStream skip buffer sizeMajor.Yongjun ZhangJohn Zhuge
YARN-5048DelegationTokenRenewer#skipTokenRenewal may throw NPEMajor.Jian HeJian He
YARN-4926Change nodelabel rest API invalid reponse status to 400Major.Bibin A ChundattBibin A Chundatt
HDFS-10372Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolumeMajortestRushabh S ShahRushabh S Shah
MAPREDUCE-6684High contention on scanning of user directory under immediate_done in Job History ServerCriticaljobhistoryserverHaibo ChenHaibo Chen
HDFS-6187Update the document of hftp/hsftp in branch-2 to mention that they are deprecatedMajor.Haohui MaiGergely Novák
YARN-4768getAvailablePhysicalMemorySize can be inaccurate on linuxMajornodemanagerNathan RobertsNathan Roberts
HADOOP-13125FS Contract tests don't report FS initialization errors wellMinortestSteve LoughranSteve Loughran
YARN-5029RM needs to send update event with YarnApplicationState as Running to ATS/AHSCritical.Xuan GongXuan Gong
HADOOP-13116Jets3tNativeS3FileSystemContractTest does not run.MinortestChris NaurothChris Nauroth
MAPREDUCE-6639Process hangs in LocatedFileStatusFetcher if FileSystem.get throwsMajormrv2Ryan BlueRyan Blue
HADOOP-11180Change log message “token.Token: Cannot find class for token kind kms-dt” to debugMajorkms, securityYi LiuYi Liu
MAPREDUCE-6558multibyte delimiters with compressed input files generate duplicate recordsMajormrv1, mrv2Wilfred SpiegelenburgWilfred Spiegelenburg
HADOOP-13083The number of javadocs warnings is limited to 100Critical.Li LuGergely Novák
MAPREDUCE-6513MR job got hanged forever when one NM unstable for some timeCriticalapplicationmaster, resourcemanagerBob.zhaoVarun Saxena
HDFS-10333Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunkMajorhdfsYongjun ZhangYiqun Lin
HADOOP-12942hadoop credential commands non-obviously use password of “none”MajorsecurityMike YoderMike Yoder
YARN-4325Nodemanager log handlers fail to send finished/failed events in some casesCritical.Junping DuJunping Du
HDFS-10242Cannot create space quota of zeroMajordocumentation, fsTakashi OhnishiTakashi Ohnishi
MAPREDUCE-6693ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limitCritical.Bibin A ChundattAjith S
HADOOP-13163Reuse pre-computed filestatus in Distcp-CopyMapperMinortools/distcpRajesh BalamohanRajesh Balamohan
HDFS-10303DataStreamer#ResponseProcessor calculates packet ack latency incorrectly.Majorhdfs-clientSurendra Singh LilhoreSurendra Singh Lilhore
MAPREDUCE-6698Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUserMajorjobhistoryserverHaibo ChenHaibo Chen
HADOOP-13159Fix potential NPE in Metrics2 source for DecayRpcSchedulerMajoripcXiaoyu YaoXiaoyu Yao
HDFS-10397Distcp should ignore -delete option if -diff option is provided instead of exitingMajordistcpMingliang LiuMingliang Liu
HDFS-10381DataStreamer DataNode exclusion log message should be warningMinorhdfs-clientJohn ZhugeJohn Zhuge
HDFS-9226MiniDFSCluster leaks dependency Mockito via DataNodeTestUtilsMajortestJosh ElserJosh Elser
HADOOP-13138Unable to append to a SequenceFile with Compression.NONE.Critical.Gervais MickaëlVinayakumar B
YARN-4925ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpressionMajor.Bibin A ChundattBibin A Chundatt
HADOOP-13157Follow-on improvements to hadoop credential commandsMajorsecurityMike YoderMike Yoder
YARN-3840Resource Manager web ui issue when sorting application by id (with application having id > 9999)MajorresourcemanagerLINTEVarun Saxena
HADOOP-13177Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib.MinorbuildChris NaurothChris Nauroth
HADOOP-12767update apache httpclient version to 4.5.2; httpcore to 4.4.4MajorbuildArtem AlievArtem Aliev
YARN-5100The YarnApplicationState is always running in ATS no matter the application is running or finishes.Blocker.Xuan GongXuan Gong
HADOOP-13183S3A proxy tests fail after httpclient/httpcore upgrade.Majorfs/s3Chris NaurothSteve Loughran
YARN-5020Fix Documentation for Yarn Capacity Scheduler on Resource CalculatorMinor.Jo DesmetTakashi Ohnishi
HDFS-10424DatanodeLifelineProtocol not able to use under security clusterBlocker.gu-chiChris Nauroth
HDFS-10438When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server.Minorha, namenodeKWON BYUNGCHANGChris Nauroth
HDFS-10439Update setOwner doc in HdfsPermissionsGuideMinordocumentationJohn ZhugeJohn Zhuge
MAPREDUCE-6607Enable regex pattern matching when mapreduce.task.files.preserve.filepattern is setMinorapplicationmasterMaysam YabandehKai Sasaki
YARN-5103With NM recovery enabled, restarting NM multiple times results in AM restartCriticalyarnSumana SathishJunping Du
YARN-5055max apps per user can be larger than max per queueMinorcapacityscheduler, resourcemanagerJason LoweEric Badger
YARN-3971Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recoveryCriticalresourcemanagerBibin A ChundattBibin A Chundatt
HDFS-9365Balancer does not work with the HDFS-6376 HA setupMajorbalancer & moverTsz Wo Nicholas SzeTsz Wo Nicholas Sze
YARN-3344Fix warning - procfs stat file is not in the expected formatMajor.Jon BringhurstRavindra Kumar Naik
YARN-4459container-executor should only kill process groupsMajornodemanagerJun GongJun Gong
YARN-5166javadoc:javadoc goal fails on hadoop-yarn-clientMajor.Andras BokorAndras Bokor
HDFS-10276HDFS should not expose path info that user has no permission to see.Major.Kevin CoxYuanbo Liu
YARN-5132Exclude generated protobuf sources from YARN Javadoc buildCritical.Subru KrishnanSubru Krishnan
HADOOP-13132Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProviderMajorkmsMiklos SzurapWei-Chiu Chuang
HDFS-10415TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is calledMajortestSangjin LeeMingliang Liu
HADOOP-13137TraceAdmin should support Kerberized clusterMajortracingWei-Chiu ChuangWei-Chiu Chuang
HDFS-9476TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally failMajor.Wei-Chiu ChuangMasatake Iwasaki
HDFS-10367TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception.MajortestBrahma Reddy BattulaBrahma Reddy Battula
HDFS-10471DFSAdmin#SetQuotaCommand's help msg is not correctMinordocumentationYiqun LinYiqun Lin
YARN-5098Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation tokenMajoryarnYesha VoraJian He
HADOOP-13155Implement TokenRenewer to renew and cancel delegation tokens in KMSMajorkms, securityXiao ChenXiao Chen
HDFS-10481HTTPFS server should correctly impersonate as end user to open fileMajorhttpfsXiao ChenXiao Chen
HDFS-10485Fix findbugs warning in FSEditLog.javaMajor.Akira AjisakaAkira Ajisaka
HDFS-10458getFileEncryptionInfo should return quickly for non-encrypted clusterMajorencryption, namenodeZhe ZhangZhe Zhang
YARN-5206RegistrySecurity includes id:pass in exception text if considered invalidMinorclient, securitySteve LoughranSteve Loughran
HDFS-10220A large number of expired leases can make namenode unresponsive and cause failoverMajornamenodeNicolas FraisonNicolas Fraison
HADOOP-13249RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleepMajoripczhihai xuzhihai xu
HADOOP-13213Small Documentation bug with AuthenticatedURL in hadoop-authMinordocumentationTom EllisTom Ellis
HADOOP-13079Add -q option to Ls to print ? instead of non-printable charactersMajor.John ZhugeJohn Zhuge
HDFS-10516Fix bug when warming up EDEK cache of more than one encryption zoneMajorencryption, namenodeXiao ChenXiao Chen
HADOOP-13270BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocksCritical.Haibo ChenKai Sasaki
HADOOP-13179GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safeMinor.hongbin mahongbin ma
HADOOP-13244o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctorMinoripcXiaoyu YaoKai Sasaki
HADOOP-13245Fix up some misc create-release issuesBlockerbuildAllen WittenauerAllen Wittenauer
HDFS-10505OIV's ReverseXML processor should support ACLsMajortoolsColin P. McCabeSurendra Singh Lilhore
HDFS-10525Fix NPE in CacheReplicationMonitor#rescanCachedBlockMapMajorcachingXiao ChenXiao Chen
YARN-5237Fix missing log files issue in rolling log aggregation.Major.Siddharth SethXuan Gong
HDFS-10532Typo in RollingUpgrade docsMajordocumentationArpit AgarwalYiqun Lin
HADOOP-3733“s3:” URLs break when Secret Key contains a slash, even if encodedMinorfs/s3Stuart SierraSteve Loughran
HDFS-9466TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flakyMajorfs, hdfs-clientWei-Chiu ChuangWei-Chiu Chuang
HADOOP-13255KMSClientProvider should check and renew tgt when doing delegation token operations.MajorkmsXiao ChenXiao Chen
HADOOP-13285DecayRpcScheduler MXBean should only report decayed CallVolumeSummaryMajoripcNamit MaheshwariXiaoyu Yao
HADOOP-13149Windows distro build fails on dist-copynativelibs.BlockerbuildChris NaurothChris Nauroth
YARN-5246NMWebAppFilter web redirects drop query parametersMajor.Varun VasudevVarun Vasudev
HDFS-10474hftp copy fails when file name with Chinese+special char in branch-2Critical.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-13192org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctlyCriticalutilbindebinde
HDFS-10448CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1MajorcachingYiqun LinYiqun Lin
YARN-5197RM leaks containers if running container disappears from node updateMajorresourcemanagerJason LoweJason Lowe
HADOOP-13287TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains ‘+’.Minorfs/s3, testChris NaurothChris Nauroth
HDFS-10556DistCpOptions should be validated automaticallyMajordistcpMingliang LiuMingliang Liu
MAPREDUCE-6725Javadoc for CLI#listEvents() contains no-existent paramMinorclient, documentationShen YinjieShen Yinjie
HDFS-7959WebHdfs logging is missing on DatanodeCritical.Kihwal LeeKihwal Lee
MAPREDUCE-6542HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafeMajorjobhistoryserverzhangyubiaozhangyubiao
HADOOP-13251Authenticate with Kerberos credentials when renewing KMS delegation tokenMajorkmsXiao ChenXiao Chen
HADOOP-13316Enforce Kerberos authentication for required ops in DelegationTokenAuthenticatorBlockerkms, securityXiao ChenXiao Chen
HDFS-9852hdfs dfs -setfacl error message is misleadingMinor.Wei-Chiu ChuangWei-Chiu Chuang
YARN-5262Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeatMajorresourcemanagerRohith Sharma K SRohith Sharma K S
HADOOP-12345Pad hostname correctly in CredentialsSys.javaCriticalnfsPradeep Nayak Udupi KadbetPradeep Nayak Udupi Kadbet
HADOOP-13314Remove ‘package-info.java’ from 'test\java\org\apache\hadoop\fs\shell' to remove eclipse compile errorTrivial.Vinayakumar BVinayakumar B
HDFS-10589Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent paramsMinordocumentation, hdfsShen YinjieShen Yinjie
YARN-5286Add RPC port info in RM web service's response when getting app statusMajor.Jun GongJun Gong
YARN-5214Pending on synchronized method DirectoryCollection#checkDirs can hang NM's NodeStatusUpdaterCriticalnodemanagerJunping DuJunping Du
HADOOP-13350Additional fix to LICENSE and NOTICEBlockerbuildXiao ChenXiao Chen
HDFS-10592Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunningMajortestRakesh RRakesh R
HADOOP-13320Fix arguments check in documentation for WordCount v2.0Minordocumentationniccolo becchiniccolo becchi
YARN-5314ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStoreMajortimelineserverKaram SinghLi Lu
YARN-4939the decommissioning Node should keep alive if NM restartMajor.sandfleesandflee
HADOOP-12893Verify LICENSE.txt and NOTICE.txtBlockerbuildAllen WittenauerXiao Chen
HADOOP-13352Make X-FRAME-OPTIONS configurable in HttpServer2Majornet, securityAnu EngineerAnu Engineer
HDFS-10336TestBalancer failing intermittently because of not reseting UserGroupInformation completelyMajortestYiqun LinYiqun Lin
HDFS-10512VolumeScanner may terminate due to NPE in DataNode.reportBadBlocksMajordatanodeWei-Chiu ChuangYiqun Lin
YARN-5337Fix OOM issue in DistributedShell. AM failed with “java.lang.OutOfMemoryError: GC overhead limit exceeded”Major.Sumana SathishJian He
HADOOP-13297Add missing dependency in setting maven-remote-resource-plugin to fix buildsMajorbuildAkira AjisakaSean Busbey
YARN-5270Solve miscellaneous issues caused by YARN-4844Blocker.Wangda TanWangda Tan
HDFS-10579HDFS web interfaces lack configs for X-FRAME-OPTIONS protectionMajordatanode, namenodeAnu EngineerAnu Engineer
MAPREDUCE-6625TestCLI#testGetJob fails occasionallyMajortestJason LoweHaibo Chen
HADOOP-13315FileContext#umask is not initialized properlyMinor.John ZhugeJohn Zhuge
YARN-5353ResourceManager can leak delegation tokens when they are shared across appsCriticalresourcemanagerJason LoweJason Lowe
HADOOP-11361Fix a race condition in MetricsSourceAdapter.updateJmxCacheMajor.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-10544Balancer doesn't work with IPFailoverProxyProviderMajorbalancer & mover, haZhe ZhangZhe Zhang
HADOOP-13351TestDFSClientSocketSize buffer size tests are flakyMajor.Aaron FabbriAaron Fabbri
HADOOP-13202Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytesMajorutilzhengbing liKai Sasaki
HDFS-10603Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshotMajorhdfs, namenodeYongjun ZhangYiqun Lin
HADOOP-12991Conflicting default ports in DelegateToFileSystemMajorfsKevin HogelandKai Sasaki
YARN-5309Fix SSLFactory truststore reloader thread leak in TimelineClientImplBlockertimelineserver, yarnThomas FriedrichWeiwei Yang
HADOOP-13387users always get told off for using S3 —even when not using it.Minorfs/s3Steve LoughranSteve Loughran
YARN-5340Race condition in RollingLevelDBTimelineStore#getAndSetStartTime()CriticaltimelineserverSumana SathishLi Lu
HDFS-8914Document HA support in the HDFS HdfsDesign.mdMajordocumentationRavindra BabuLars Francke
HADOOP-12588Fix intermittent test failure of TestGangliaMetricsMajor.Tsuyoshi OzawaMasatake Iwasaki
HADOOP-13240TestAclCommands.testSetfaclValidations failMinortestlinbao111John Zhuge
HADOOP-13389TestS3ATemporaryCredentials.testSTS error when using IAM credentialsMajorfs/s3Steven K. WongSteven K. Wong
HADOOP-13406S3AFileSystem: Consider reusing filestatus in delete() and mkdirs()Minorfs/s3Rajesh BalamohanRajesh Balamohan
MAPREDUCE-6744Increase timeout on TestDFSIO testsMajor.Eric BadgerEric Badger
HDFS-10688BPServiceActor may run into a tight loop for sending block report when hitting IOExceptionMajordatanodeJing ZhaoChen Liang
HDFS-10671Fix typo in HdfsRollingUpgrade.mdTrivialdocumentationYiqun LinYiqun Lin
HADOOP-13422ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in processMajor.Sergey ShelukhinSergey Shelukhin
HDFS-10696TestHDFSCLI failsMajortestAkira AjisakaKai Sasaki
YARN-5432Lock already held by another process while LevelDB cache store creation for dagCriticaltimelineserverKaram SinghLi Lu
YARN-5438TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOMMajortimelineserverKaram SinghRohith Sharma K S
HADOOP-13381KMS clients should use KMS Delegation Tokens from current UGI.CriticalkmsXiao ChenXiao Chen
HDFS-10691FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsExceptionMajor.Yiqun LinYiqun Lin
YARN-5121fix some container-executor portability issuesBlockernodemanager, securityAllen WittenauerAllen Wittenauer
MAPREDUCE-6724Single shuffle to memory must not exceed Integer#MAX_VALUEMajormrv2Haibo ChenHaibo Chen
HDFS-5805TestCheckpoint.testCheckpoint fails intermittently on branch2Major.Mit DesaiEric Badger
HADOOP-13459hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time.Minorfs/azure, testChris NaurothChris Nauroth
HDFS-742A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block listMinorbalancer & moverHairong KuangMit Desai
YARN-4280CapacityScheduler reservations may not prevent indefinite postponement on a busy clusterMajorcapacity schedulerKuhu ShuklaKuhu Shukla
YARN-5462TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittentlyMajor.Eric BadgerEric Badger
HDFS-10710In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protectionMajornamenodeRui GaoRui Gao
YARN-5469Increase timeout of TestAmFilter.testFilterMinor.Eric BadgerEric Badger
HDFS-10569A bug causes OutOfIndex error in BlockListAsLongsMinor.Weiwei YangWeiwei Yang
HADOOP-13434Add quoting to Shell classMajor.Owen O'MalleyOwen O'Malley
MAPREDUCE-6682TestMRCJCFileOutputCommitter fails intermittentlyMajortestBrahma Reddy BattulaAkira Ajisaka
HDFS-10716In Balancer, the target task should be removed when its size < 0.Minorbalancer & moverYiqun LinYiqun Lin
HDFS-10722Fix race condition in TestEditLog#testBatchedSyncWithClosedLogsMajorhdfsDaryn SharpDaryn Sharp
HADOOP-13467Shell#getSignalKillCommand should use the bash builtin on LinuxMajor.Arpit AgarwalArpit Agarwal
HDFS-10717Fix findbugs warnings of hadoop-hdfs-client in branch-2Major.Akira AjisakaAkira Ajisaka
HDFS-10343BlockManager#createLocatedBlocks may return blocks on failed storagesMajorhdfsDaryn SharpKuhu Shukla
HDFS-10715NPE when applying AvailableSpaceBlockPlacementPolicyMajornamenodeGuangbin ZhuGuangbin Zhu
YARN-4624NPE in PartitionQueueCapacitiesInfo while accessing Schduler UIMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-10823TestReloadingX509TrustManager is flakyMajor.Ratandeep RattiMingliang Liu
HADOOP-13457Remove hardcoded absolute path for shell executableMajorutilArpit AgarwalChen Liang
HADOOP-13439Fix race between TestMetricsSystemImpl and TestGangliaMetricsMinortestMasatake IwasakiChen Liang
MAPREDUCE-6750TestHSAdminServer.testRefreshSuperUserGroups is failingMinortestKihwal LeeKihwal Lee
HADOOP-13473Tracing in IPC Server is brokenMajor.Wei-Chiu ChuangDaryn Sharp
HDFS-10738Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failureMajortestRakesh RRakesh R
HADOOP-13299JMXJsonServlet is vulnerable to TRACEMinor.Haibo ChenHaibo Chen
HDFS-8224Schedule a block for scanning if its metadata file is corruptMajordatanodeRushabh S ShahRushabh S Shah
YARN-5382RM does not audit log kill request for active applicationsMajorresourcemanagerJason LoweVrushali C
HDFS-10643Namenode should use loginUser(hdfs) to generateEncryptedKeyMajorencryption, namenodeXiaoyu YaoXiaoyu Yao
HDFS-8897Balancer should handle fs.defaultFS trailing slash in HAMajorbalancer & moverLINTEJohn Zhuge
HDFS-10731FSDirectory#verifyMaxDirItems does not log path nameMinornamenodeWei-Chiu ChuangWei-Chiu Chuang
YARN-5476Not existed application reported as ACCEPTED state by YarnClientImplCriticalyarnYesha VoraJunping Du
YARN-5491Random Failure TestCapacityScheduler#testCSQueueBlockedMajortestBibin A ChundattBibin A Chundatt
HADOOP-13333testConf.xml ls comparators in wrong orderTrivialfsJohn ZhugeVrushali C
HADOOP-13470GenericTestUtils$LogCapturer is flakyMajortest, utilMingliang LiuMingliang Liu
HADOOP-13494ReconfigurableBase can log sensitive informationMajorsecuritySean MackrorySean Mackrory
HDFS-9530ReservedSpace is not cleared for abandoned BlocksCriticaldatanodeFei HuiBrahma Reddy Battula
HDFS-10549Correctly revoke file leases when closing filesMajorhdfs-clientYiqun LinYiqun Lin
HADOOP-13513Java 1.7 support for org.apache.hadoop.fs.azure testcasesMinorfs/azureTibor KissTibor Kiss
HADOOP-13512ReloadingX509TrustManager should keep reloading in case of exceptionCriticalsecurityMingliang LiuMingliang Liu
YARN-4307Display blacklisted nodes for AM container in the RM web UIMajorresourcemanager, webappNaganarasimha G RNaganarasimha G R
MAPREDUCE-6763Shuffle server listen queue is too smallMajormrv2Jason LoweJason Lowe
YARN-4837User facing aspects of ‘AM blacklisting’ feature need fixingCritical.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-6310Add jdiff support to MapReduceBlocker.Li LuLi Lu
YARN-3388Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limitMajorcapacityschedulerNathan RobertsNathan Roberts
YARN-4685Disable AM blacklisting by default to mitigate situations that application get hangedCriticalresourcemanagerRohith Sharma K SRohith Sharma K S
HADOOP-13428Fix hadoop-common to generate jdiffBlocker.Wangda TanWangda Tan
HDFS-10764Fix INodeFile#getBlocks to not return nullMajornamenodeArpit AgarwalArpit Agarwal
HDFS-10692Point JDiff base version for HDFS from 2.6.0 to 2.7.2Blocker.Wangda TanWangda Tan
HADOOP-13487Hadoop KMS should load old delegation tokens from Zookeeper on startupMajorkmsAlex IvanovXiao Chen
HDFS-10783The option ‘-maxSize’ and ‘-step’ fail in OfflineImageViewerMajortoolsYiqun LinYiqun Lin
HADOOP-13524mvn eclipse:eclipse generates .gitignore'able filesMajor.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
HADOOP-13497fix wrong command in CredentialProviderAPI.mdTrivialdocumentationYuanbo LiuYuanbo Liu
MAPREDUCE-6761Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failureMajormrv2Peter VaryPeter Vary
HDFS-10748TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeoutMajortestXiaoyu YaoYiqun Lin
HDFS-10793Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184Blocker.Andrew WangManoj Govindassamy
HDFS-10652Add a unit test for HDFS-4660Majordatanode, hdfsYongjun ZhangVinayakumar B
HADOOP-13552RetryInvocationHandler logs all remote exceptionsBlockeripcJason LoweJason Lowe
HADOOP-12765HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connectionsMajor.Min ShenMin Shen
MAPREDUCE-6768TestRecovery.testSpeculative failed with NPEMajormrv2Haibo ChenHaibo Chen
HADOOP-13559Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classesMinorfsAaron FabbriAaron Fabbri
HDFS-4210Throw helpful exception when DNS entry for JournalNode cannot be resolvedTrivialha, journal-node, namenodeDamien HardyJohn Zhuge
MAPREDUCE-4784TestRecovery occasionally failsMajormrv2, testJason LoweHaibo Chen
HDFS-10760DataXceiver#run() should not log InvalidToken exception as an errorMajor.Pan YuxuanPan Yuxuan
HDFS-10729Improve log message for edit loading failures caused by FS limit checks.MajornamenodeWei-Chiu ChuangWei-Chiu Chuang
YARN-5221Expose UpdateResourceRequest API to allow AM to request for change in container propertiesMajor.Arun SureshArun Suresh
HADOOP-13375o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flakyMajorsecurity, testMingliang LiuWeiwei Yang
YARN-5555Scheduler UI: “% of Queue” is inaccurate if leaf queue is hierarchically nested.Minor.Eric PayneEric Payne
YARN-5549AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminatelyCriticalresourcemanagerDaniel TempletonDaniel Templeton
HDFS-10841Remove duplicate or unused variable in appendFile()Minor.Kihwal LeeKihwal Lee
HADOOP-13558UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticketMajorsecurityAlejandro AbdelnurXiao Chen
HDFS-9038DFS reserved space is erroneously counted towards non-DFS used.MajordatanodeChris NaurothBrahma Reddy Battula
HDFS-10832Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissionsCriticalhttpfsAndrew WangAndrew Wang
YARN-5632UPDATE_EXECUTION_TYPE causes UpdateContainerRequestPBImpl to throwMajorapiJason LoweJason Lowe
HDFS-9781FsDatasetImpl#getBlockReports can occasionally throw NullPointerExceptionMajordatanodeWei-Chiu ChuangManoj Govindassamy
HDFS-10830FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in useMajorhdfsManoj GovindassamyArpit Agarwal
YARN-5190Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImplBlocker.Junping DuJunping Du
HDFS-10856Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReportMinordocumentationAkira AjisakaYiqun Lin
YARN-5630NM fails to start after downgrade from 2.8 to 2.7BlockernodemanagerJason LoweJason Lowe
HADOOP-13616Broken code snippet area in Hadoop BenchmarkingMinordocumentationKai SasakiKai Sasaki
HDFS-10862Typos in 4 log messagesTrivial.Mehran HassaniMehran Hassani
YARN-4232TopCLI console support for HA modeMinor.Bibin A ChundattBibin A Chundatt
YARN-5655TestContainerManagerSecurity#testNMTokens is assertingMajor.Jason LoweRobert Kanter
HDFS-10879TestEncryptionZonesWithKMS#testReadWrite fails intermittentlyMajor.Xiao ChenXiao Chen
YARN-5539TimelineClient failed to retry on “java.net.SocketTimeoutException: Read timed out”CriticalyarnSumana SathishJunping Du
HADOOP-13643Math error in AbstractContractDistCpTestMinor.Aaron FabbriAaron Fabbri
HDFS-10886Replace “fs.default.name” with “fs.defaultFS” in viewfs documentMinordocumentation, federationBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-13535Add jetty6 acceptor startup issue workaround to branch-2Major.Wei-Chiu ChuangMin Shen
YARN-5664Fix Yarn documentation to link to correct versions.Minor.Xiao ChenXiao Chen
YARN-5663Small refactor in ZKRMStateStoreMinorresourcemanagerOleksii DymytrovOleksii Dymytrov
HADOOP-12597In kms-site.xml configuration “hadoop.security.keystore.JavaKeyStoreProvider.password” should be updated with new nameMinorsecurityhuangyitianSurendra Singh Lilhore
HADOOP-13638KMS should set UGI's Configuration object properlyMajorkmsWei-Chiu ChuangWei-Chiu Chuang
HDFS-9885Correct the distcp counters name while displaying countersMinordistcpArchana TSurendra Singh Lilhore
YARN-5660Wrong audit constants are used in Get/Put of priority in RMWebServiceTrivialresourcemanagerRohith Sharma K SRohith Sharma K S
HDFS-10889Remove outdated Fault Injection Framework documentaionMajordocumentationBrahma Reddy BattulaBrahma Reddy Battula
HDFS-10713Throttle FsNameSystem lock warningsMajorlogging, namenodeArpit AgarwalHanisha Koneru
HDFS-10426TestPendingInvalidateBlock failed in trunkMajortestYiqun LinYiqun Lin
HDFS-10828Fix usage of FsDatasetImpl object lock in ReplicaMapBlocker.Arpit AgarwalArpit Agarwal
YARN-5631Missing refreshClusterMaxPriority usage in rmadmin help messageMinor.Kai SasakiKai Sasaki
HDFS-9444Add utility to find set of available ephemeral ports to ServerSocketUtilMajor.Brahma Reddy BattulaMasatake Iwasaki
HDFS-10824MiniDFSCluster#storageCapacities has no effects on real capacityMajor.Xiaobing ZhouXiaobing Zhou
HDFS-10914Move remnants of oah.hdfs.client to hadoop-hdfs-clientCriticalhdfs-clientAndrew WangAndrew Wang
MAPREDUCE-6771RMContainerAllocator sends container diagnostics event after corresponding completion eventMajormrv2Haibo ChenHaibo Chen
HADOOP-13640Fix findbugs warning in VersionInfoMojo.javaMajor.Tsuyoshi OzawaYuanbo Liu
HDFS-10850getEZForPath should NOT throw FNFBlockerhdfsDaryn SharpAndrew Wang
HDFS-10945Fix the Findbugwaring FSNamesystem#renameTo(String, String, boolean) in branch-2Major.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-10810Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.MajornamenodeBrahma Reddy BattulaBrahma Reddy Battula
HDFS-10944Correct the javadoc of dfsadmin#disallowSnapshotMinordocumentationJagadesh Kiran NJagadesh Kiran N
HDFS-10947Correct the API name for truncate in webhdfs documentMajordocumentationSurendra Singh LilhoreSurendra Singh Lilhore
HADOOP-12667s3a: Support createNonRecursive APIMajorfs/s3Sean MackrorySean Mackrory
HDFS-10609Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applicationsMajorencryptionWei-Chiu ChuangWei-Chiu Chuang
HDFS-10962TestRequestHedgingProxyProvider is flakyMajortestAndrew WangAndrew Wang
MAPREDUCE-6740Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.intervalMinormr-amHaibo ChenHaibo Chen
YARN-5101YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed orderMajor.Xuan GongSunil G
YARN-5659getPathFromYarnURL should use standard methodsMajor.Sergey ShelukhinSergey Shelukhin
HADOOP-12611TestZKSignerSecretProvider#testMultipleInit occasionally failMajor.Wei-Chiu ChuangEric Badger
HDFS-10797Disk usage summary of snapshots causes renamed blocks to get counted twiceMajorsnapshotsSean MackrorySean Mackrory
HDFS-10991Export hdfsTruncateFile symbol in libhdfsBlockerlibhdfsSurendra Singh LilhoreSurendra Singh Lilhore
HADOOP-13700Remove unthrown IOException from TrashPolicy#initialize and #getInstance signaturesCriticalfsHaibo ChenAndrew Wang
HDFS-11002Fix broken attr/getfattr/setfattr links in ExtendedAttributes.mdMajordocumentationMingliang LiuMingliang Liu
HDFS-11000webhdfs PUT does not work if requests are routed to call queue.Major.Kihwal LeeKihwal Lee
HDFS-10987Make Decommission less expensive when lot of blocks present.Critical.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-13024Distcp with -delete feature on raw data not implementedMajortools/distcpMavin MartinMavin Martin
HDFS-10986DFSAdmin should log detailed error message if anyMajortoolsMingliang LiuMingliang Liu
HDFS-10990TestPendingInvalidateBlock should wait for IBRsMinor.Yiqun LinYiqun Lin
HDFS-10735Distcp using webhdfs on secure HA clusters fails with StandbyExceptionMajorwebhdfsBenoy AntonyBenoy Antony
HDFS-10883getTrashRoot's behavior is not consistent in DFS after enabling EZ.Major.Yuanbo LiuYuanbo Liu
HADOOP-13707If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessedMajor.Yuanbo LiuYuanbo Liu
HDFS-10301BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of orderCriticalnamenodeKonstantin ShvachkoVinitha Reddy Gankidi
HDFS-10712Fix TestDataNodeVolumeFailure on 2.* branches.Major.Konstantin ShvachkoVinitha Reddy Gankidi
HDFS-10920TestStorageMover#testNoSpaceDisk is failing intermittentlyMajortestRakesh RRakesh R
HDFS-10960TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume removeMinorhdfsManoj GovindassamyManoj Govindassamy
HDFS-10752Several log refactoring/improvement suggestion in HDFSMajor.Nemo ChenHanisha Koneru
HDFS-11025TestDiskspaceQuotaUpdate fails in trunk due to Bind exceptionMinor.Yiqun LinYiqun Lin
HDFS-11018Incorrect check and message in FsDatasetImpl#invalidateMajordatanodeWei-Chiu ChuangYiqun Lin
HADOOP-13236truncate will fail when we use viewfilesystemMajor.Brahma Reddy BattulaBrahma Reddy Battula
HADOOP-13749KMSClientProvider combined with KeyProviderCache can result in wrong UGI being usedCritical.Sergey ShelukhinXiaoyu Yao
HDFS-11042Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()MajortestKuhu ShuklaKuhu Shukla
HDFS-11015Enforce timeout in balancerMajorbalancer & moverKihwal LeeKihwal Lee
YARN-5677RM should transition to standby when connection is lost for an extended periodCriticalresourcemanagerDaniel TempletonDaniel Templeton
HDFS-11054Suppress verbose log message in BlockPlacementPolicyDefaultMajor.Arpit AgarwalChen Liang
HDFS-11050Change log level to ‘warn’ when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATORMajor.Kuhu ShuklaKuhu Shukla
HDFS-8492DN should notify NN when client requests a missing blockMajor.Daryn SharpWalter Su
MAPREDUCE-6541Exclude scheduled reducer memory when calculating available mapper slots from headroom to avoid deadlockMajor.Wangda TanVarun Saxena
YARN-3848TestNodeLabelContainerAllocation is not timing outMajortestJason LoweVarun Saxena
HADOOP-13201Print the directory paths when ViewFs denies the rename operation on internal dirsMajorviewfsTianyin XuRakesh R
YARN-4831Recovered containers will be killed after NM stateful restartMajornodemanagerSiqi LiSiqi Li
YARN-3432Cluster metrics have wrong Total Memory when there is reserved memory on CSMajorcapacityscheduler, resourcemanagerThomas GravesBrahma Reddy Battula
HDFS-9500datanodesSoftwareVersions map may counting wrong when rolling upgradeMajor.Phil YangErik Krogen
MAPREDUCE-2631Potential resource leaks in BinaryProtocol$TeeOutputStream.javaMajor.Ravi Teja Ch N VSunil G
HADOOP-13770Shell.checkIsBashSupported swallowed an interrupted exceptionBlockerutilWei-Chiu ChuangWei-Chiu Chuang
YARN-5027NM should clean up app log dirs after NM restartMajornodemanagersandfleesandflee
YARN-5767Fix the order that resources are cleaned up from the local Public/Private cachesMajor.Chris TrezzoChris Trezzo
HDFS-11061Update dfs -count -t command line help and documentationMinordocumentation, fsWei-Chiu ChuangYiqun Lin
YARN-5773RM recovery too slow due to LeafQueue#activateApplication()Criticalcapacity scheduler, rolling upgradeBibin A ChundattBibin A Chundatt
HDFS-10455Logging the username when deny the setOwner operationMinornamenodeTianyin XuRakesh R
HADOOP-13773wrong HADOOP_CLIENT_OPTS in hadoop-env on branch-2MajorconfFei HuiFei Hui
YARN-5001Aggregated Logs root directory is created with wrong group if nonexistentMajorlog-aggregation, nodemanager, securityHaibo ChenHaibo Chen
YARN-5815Random failure of TestApplicationPriority.testOrderOfActivatingThePriorityApplicationOnRMRestartMajor.Bibin A ChundattBibin A Chundatt
HDFS-11097Fix the jenkins warning related to the deprecated method StorageReceivedDeletedBlocksMajor.Yiqun LinYiqun Lin
YARN-5837NPE when getting node status of a decommissioned node after an RM restartMajor.Robert KanterRobert Kanter
HADOOP-13798TestHadoopArchives times outMajortestAkira AjisakaAkira Ajisaka
HADOOP-13797Remove hardcoded absolute path for lsMajorutilChristine KoppeltChristine Koppelt
HADOOP-13804MutableStat mean loses accuracy if add(long, long) is usedMinormetricsErik KrogenErik Krogen
HDFS-11128CreateEditsLog throws NullPointerExceptionMajorhdfsHanisha KoneruHanisha Koneru
HDFS-11129TestAppendSnapshotTruncate fails with bind exceptionMajortestBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-13813TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failingMajorsecurity, testMingliang LiuMingliang Liu
HDFS-11087NamenodeFsck should check if the output writer is still writable.MajornamenodeKonstantin ShvachkoErik Krogen
HDFS-11135The tests in TestBalancer run fails due to NPEMajortestYiqun LinYiqun Lin
HDFS-11056Concurrent append and read operations lead to checksum errorMajordatanode, httpfsWei-Chiu ChuangWei-Chiu Chuang
MAPREDUCE-6797Job history server scans can become blocked on a single, slow entryCriticaljobhistoryserverPrabhu JosephPrabhu Joseph
YARN-4355NPE while processing localizer heartbeatMajornodemanagerJason LoweVarun Saxena
YARN-4218Metric for resource*time that was preemptedMajorresourcemanagerChang LiChang Li
YARN-5875TestTokenClientRMService#testTokenRenewalWrongUser failsMajor.Varun SaxenaGergely Novák
HADOOP-13815TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in TrunkMajortestBrahma Reddy BattulaXiao Chen
YARN-5836Malicious AM can kill containers of other apps running in any node its containers are runningMinornodemanagerBotong HuangBotong Huang
HDFS-11134Fix bind exception threw in TestRenameWhileOpenMajor.Yiqun LinYiqun Lin
MAPREDUCE-6801Fix flaky TestKill.testKillJob()Majormrv2Haibo ChenHaibo Chen
HADOOP-13814Sample configuration of KMS HTTP Authentication signature is misleadingMinorconf, documentation, kmsMasahiro TanakaMasahiro Tanaka
HDFS-11144TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exceptionMajortestBrahma Reddy BattulaBrahma Reddy Battula
HDFS-11101TestDFSShell#testMoveWithTargetPortEmpty fails intermittentlyMajortestBrahma Reddy BattulaBrahma Reddy Battula
YARN-5859TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes failsMajortestJason LoweEric Badger
HADOOP-13663Index out of range in SysInfoWindowsMajorscriptsInigo GoiriInigo Goiri
HDFS-11174Wrong HttpFS test command in docMinordocumentation, httpfsJohn ZhugeJohn Zhuge
HADOOP-13820Replace ugi.getUsername() with ugi.getShortUserName() in viewFSMinorviewfsArchana TBrahma Reddy Battula
HADOOP-13838KMSTokenRenewer should close providersCriticalkmsXiao ChenXiao Chen
HADOOP-13830Intermittent failure of ITestS3NContractRootDir#testRecursiveRootListing: “Can not create a Path from an empty string”Minorfs/s3, testSteve LoughranSteve Loughran
YARN-5915ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event writeMajortimelineserverAtul SikariaAtul Sikaria
MAPREDUCE-6815Fix flaky TestKill.testKillTask()Majormrv2Haibo ChenHaibo Chen
HDFS-11181Fuse wrapper has a typoTrivialfuse-dfsWei-Chiu ChuangWei-Chiu Chuang
HADOOP-13847KMSWebApp should close KeyProviderCryptoExtensionMajorkmsAnthony Young-GarnerJohn Zhuge
YARN-5559Analyse 2.8.0/3.0.0 jdiff reports and fix any issuesBlockerresourcemanagerWangda TanAkira Ajisaka
HADOOP-13861Spelling errors in logging and exceptions for codeMajorcommon, fs, io, securityGrant SohnGrant Sohn
HDFS-11180Intermittent deadlock in NameNode when failover happens.BlockernamenodeAbhishek ModiAkira Ajisaka
HDFS-11198NN UI should link DN web address using hostnamesCritical.Kihwal LeeWeiwei Yang
MAPREDUCE-6816Progress bars in Web UI always at 100%BlockerwebappsShen YinjieShen Yinjie
YARN-5184Fix up incompatible changes introduced on ContainerStatus and NodeReportBlockerapiKarthik KambatlaSangjin Lee
YARN-5921Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceStateMajor.Varun SaxenaVarun Saxena
HDFS-11140Directory Scanner should log startup message time correctlyMinor.Xiao ChenYiqun Lin
HDFS-11223Fix typos in HttpFs documentationsTrivialdocumentationYiqun LinYiqun Lin
HDFS-11197Listing encryption zones fails when deleting a EZ that is on a snapshotted directoryMinorhdfsWellington ChevreuilWellington Chevreuil
HDFS-11224Lifeline message should be ignored for dead nodesCritical.Vinayakumar BVinayakumar B
HADOOP-13824FsShell can suppress the real error if no error message is presentMajorfsRob VesseJohn Zhuge
MAPREDUCE-6820Fix dead links in Job relevant classesMinordocumentationYiqun LinYiqun Lin
HDFS-8870Lease is leaked on write failureMajorhdfs-clientRushabh S ShahKuhu Shukla
HADOOP-13565KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client requestMajorsecurityXiaoyu YaoXiaoyu Yao
HDFS-11229HDFS-11056 failed to close meta fileBlockerdatanodeWei-Chiu ChuangWei-Chiu Chuang
HDFS-10570Remove classpath conflicts of netty-all jar in hadoop-hdfs-clientMinortestVinayakumar BVinayakumar B
HDFS-10684WebHDFS DataNode calls fail without parameter createparentBlockerwebhdfsSamuel LowJohn Zhuge
HDFS-11204Document the missing options of hdfs zkfc commandMinordocumentationYiqun LinYiqun Lin
HADOOP-13890Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsingMajortestBrahma Reddy BattulaXiaoyu Yao
HDFS-11094Send back HAState along with NamespaceInfo during a versionRequest as an optional parameterMajordatanodeEric BadgerEric Badger
HDFS-11160VolumeScanner reports write-in-progress replicas as corrupt incorrectlyMajordatanodeWei-Chiu ChuangWei-Chiu Chuang
HDFS-11263ClassCastException when we use Bzipcodec for Fsimage compressionCritical.Brahma Reddy BattulaBrahma Reddy Battula
HDFS-11195Return error when appending files by webhdfs rest api failsMajor.Yuanbo LiuYuanbo Liu
HDFS-11261Document missing NameNode metricsMinordocumentationYiqun LinYiqun Lin
HDFS-11258File mtime change could not save to editlogCritical.Jimmy XiangJimmy Xiang
HDFS-11271Typo in NameNode UITrivialnamenode, uiWei-Chiu ChuangWei-Chiu Chuang
HDFS-11250Fix a typo in ReplicaUnderRecovery#setRecoveryIDTrivial.Yiqun LinYiqun Lin
HDFS-11270Document the missing options of NameNode bootstrap commandMinordocumentationYiqun LinYiqun Lin
HDFS-11252TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindExceptionMajor.Jason LoweYiqun Lin
YARN-6024Capacity Scheduler ‘continuous reservation looking’ doesn‘t work when sum of queue’s used and reserved resources is equal to maxMajor.Wangda TanWangda Tan
HADOOP-13883Add description of -fs option in generic command usageMinordocumentationYiqun LinYiqun Lin
YARN-6029CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by one thread and LeafQueue#assignContainers is releasing excessive reserved container by another threadCriticalcapacityschedulerTao YangTao Yang
HADOOP-12733Remove references to obsolete io.seqfile configuration variablesMinor.Ray ChiangRay Chiang
HDFS-11280Allow WebHDFS to reuse HTTP connections to NNMajorhdfsZheng ShaoZheng Shao
MAPREDUCE-6711JobImpl fails to handle preemption events on state COMMITTINGMajor.Li LuPrabhu Joseph
HADOOP-13958Bump up release year to 2017Blocker.Junping DuJunping Du
YARN-6068Log aggregation get failed when NM restart even with recoveryBlocker.Junping DuJunping Du
YARN-4148When killing app, RM releases app's resource before they are released by NMMajorresourcemanagerJun GongJason Lowe
HDFS-11312Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProtoBlocker.Sean MackrorySean Mackrory
YARN-6072RM unable to start in secure modeBlockerresourcemanagerBibin A ChundattAjith S
HDFS-10733NameNode terminated after full GC thinking QJM is unresponsive.Majornamenode, qjmKonstantin ShvachkoVinitha Reddy Gankidi
HADOOP-14001Improve delegation token validity checkingMajor.Akira AjisakaAkira Ajisaka
HDFS-11376Revert HDFS-8377 Support HTTP/2 in datanodeMajordatanodeAndrew WangXiao Chen
YARN-6151FS preemption does not consider child queues over fairshare if the parent is underMajorfairschedulerYufei GuYufei Gu
YARN-5271ATS client doesn't work with Jersey 2 on the classpathMajorclient, timelineserverSteve LoughranWeiwei Yang
YARN-3933FairScheduler: Multiple calls to completedContainer are not safeMajorfairschedulerLavkesh LahngirShiwei Guo
YARN-6177Yarn client should exit with an informative error message if an incompatible Jersey library is used at clientMajor.Weiwei YangWeiwei Yang
HDFS-11379DFSInputStream may infinite loop requesting block locationsCriticalhdfs-clientDaryn SharpDaryn Sharp
HADOOP-14092Typo in hadoop-aws index.mdTrivialfs/s3John ZhugeJohn Zhuge
HADOOP-13826S3A Deadlock in multipart copy due to thread pool limits.Criticalfs/s3Sean MackrorySean Mackrory
HADOOP-14017User friendly name for ADLS user and groupMajorfs/adlJohn ZhugeVishwajeet Dusane
YARN-6175FairScheduler: Negative vcore for resource needed to preemptMajorfairschedulerYufei GuYufei Gu
HADOOP-14028S3A BlockOutputStreams doesn't delete temporary files in multipart uploads or handle part upload failuresCriticalfs/s3Seth FitzsimmonsSteve Loughran
YARN-1728Workaround guice3x-undecoded pathInfo in YARN WebAppMajor.Abraham ElmahrekYuanbo Liu
HADOOP-12979IOE in S3a: ${hadoop.tmp.dir}/s3a not configuredMajor.Steve LoughranSteve Loughran
YARN-6270WebUtils.getRMWebAppURLWithScheme() needs to honor RM HA settingMajor.Sumana SathishXuan Gong
HDFS-11498Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0Major.Andrew WangAndrew Wang
HADOOP-14087S3A typo in pom.xml test exclusionsMajorfs/s3Aaron FabbriAaron Fabbri
HADOOP-14062ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabledCritical.Steven RandSteven Rand
HDFS-11431hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProviderBlockerbuild, hdfs-clientSteven RandSteven Rand

TESTS:

JIRASummaryPriorityComponentReporterContributor
MAPREDUCE-6191TestJavaSerialization fails with getting incorrect MR job resultMinortestsam liusam liu
YARN-3339TestDockerContainerExecutor should pull a single image and not the entire centos repositoryMinortestRavindra Kumar NaikRavindra Kumar Naik
YARN-1880Cleanup TestApplicationClientProtocolOnHATrivialtestTsuyoshi OzawaTsuyoshi Ozawa
HDFS-6263Remove DRFA.MaxBackupIndex config from log4j.propertiesMinor.Akira AjisakaAbhiraj Butala
HDFS-6408Remove redundant definitions in log4j.propertiesMinortestAbhiraj ButalaAbhiraj Butala
YARN-2666TestFairScheduler.testContinuousScheduling fails IntermittentlyMajorschedulerTsuyoshi Ozawazhihai xu
HDFS-8247TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failingMajortestAnu EngineerXiaoyu Yao
HADOOP-11881test-patch.sh javac result is wildly wrongMajorbuild, testAllen WittenauerKengo Seki
HADOOP-11904test-patch.sh goes into an infinite loop on non-maven buildsCriticaltestAllen WittenauerAllen Wittenauer
YARN-3343TestCapacitySchedulerNodeLabelUpdate.testNodeUpdate sometime fails in trunkMinor.Xuan GongRohith Sharma K S
YARN-3580[JDK 8] TestClientRMService.testGetLabelsToNodes failsMajortestRobert KanterRobert Kanter
HDFS-7559Create unit test to automatically compare HDFS related classes and hdfs-default.xmlMinor.Ray ChiangRay Chiang
HADOOP-11906test-patch.sh should use ‘file’ command for patch determinismMajor.Allen WittenauerSean Busbey
YARN-3602TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanupMinortestzhihai xuzhihai xu
HDFS-8243Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.MinortestRuth WisniewskiRuth Wisniewski
HADOOP-11884test-patch.sh should pull the real findbugs versionMinortestAllen WittenauerKengo Seki
HADOOP-11944add option to test-patch to avoid relocating patch process directoryMinor.Sean BusbeySean Busbey
HADOOP-11949Add user-provided plugins to test-patchMajor.Sean BusbeySean Busbey
HADOOP-12000cannot use --java-home in test-patchMajorscriptsAllen WittenauerAllen Wittenauer
MAPREDUCE-6204TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTSMinortestsam liusam liu
HADOOP-12035shellcheck plugin displays a wrong version potentiallyTrivialbuildKengo SekiKengo Seki
HADOOP-12030test-patch should only report on newly introduced findbugs warnings.Major.Sean BusbeySean Busbey
HADOOP-11930test-patch in offline mode should tell maven to be in offline modeMajor.Sean BusbeySean Busbey
HADOOP-11965determine-flaky-tests needs a summary modeMinor.Allen WittenauerYufei Gu
HDFS-8645Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2MajornamenodeZhe ZhangZhe Zhang
YARN-2871TestRMRestart#testRMRestartGetApplicationList sometime fails in trunkMinor.Ted Yuzhihai xu
YARN-3956Fix TestNodeManagerHardwareUtils fails on MacMinornodemanagerVarun VasudevVarun Vasudev
HDFS-8834TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482MinordatanodeLei (Eddy) XuLei (Eddy) Xu
YARN-3992TestApplicationPriority.testApplicationPriorityAllocation fails intermittentlyMajor.Zhijie ShenSunil G
HDFS-2070Add more unit tests for FsShell getmergeMajortestXieXianshanDaniel Templeton
MAPREDUCE-5045UtilTest#isCygwin method appears to be unusedTrivialcontrib/streaming, testChris NaurothNeelesh Srinivas Salian
YARN-3573MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecatedMajortimelineserverMit DesaiBrahma Reddy Battula
HDFS-9295Add a thorough test of the full KMS code pathCriticalsecurity, testDaniel TempletonDaniel Templeton
HDFS-9339Extend full test of KMS ACLsMajortestDaniel TempletonDaniel Templeton
HDFS-9354Fix TestBalancer#testBalancerWithZeroThreadsForMove on WindowsMajortestXiaoyu YaoXiaoyu Yao
HDFS-9410Some tests should always reset sysout and syserrMinortestXiao ChenXiao Chen
HADOOP-12564Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io packageTrivialtestDustin CoteDustin Cote
HDFS-9153Pretty-format the output for DFSIOMajor.Kai ZhengKai Zheng
HDFS-9429Tests in TestDFSAdminWithHA intermittently fail with EOFExceptionMajortestXiao ChenXiao Chen
HADOOP-10729Add tests for PB RPC in case version mismatch of client and serverMajoripcJunping DuJunping Du
HDFS-7553fix the TestDFSUpgradeWithHA due to BindExceptionMajortestLiang XieXiao Chen
HDFS-9626TestBlockReplacement#testBlockReplacement fails occasionallyMinortestXiao ChenXiao Chen
HADOOP-12696Add Tests for S3FileSystem ContractMajortoolsMatthew PaduanoMatthew Paduano
MAPREDUCE-6614Remove unnecessary code in TestMapreduceConfigFieldsMinortestAkira AjisakaKai Sasaki
HADOOP-12736TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times outMajor.Xiao ChenXiao Chen
HADOOP-12715TestValueQueue#testgetAtMostPolicyALL fails intermittentlyMajor.Xiao ChenXiao Chen
HDFS-9773Remove dead code related to SimulatedFSDataset in testsMinortestAkira AjisakaBrahma Reddy Battula
HDFS-9888Allow reseting KerberosName in unit testsMinor.Xiao ChenXiao Chen
YARN-4717TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanupMinornodemanagerDaniel TempletonDaniel Templeton
HDFS-9949Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is clearedMinor.Harsh JHarsh J
HADOOP-12738Create unit test to automatically compare Common related classes and core-default.xmlMinor.Ray ChiangRay Chiang
HADOOP-12101Add automatic search of default Configuration variables to TestConfigurationFieldsBaseMajortestRay ChiangRay Chiang
YARN-4947Test timeout is happening for TestRMWebServicesNodesMajortestBibin A ChundattBibin A Chundatt
YARN-5069TestFifoScheduler.testResourceOverCommit race conditionMajortestEric BadgerEric Badger
YARN-5114Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8Minor.Bibin A ChundattBibin A Chundatt
HDFS-10375Remove redundant TestMiniDFSCluster.testDualClustersTrivialtestJohn ZhugeJiayi Zhou
YARN-5023TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry random failureMajor.Bibin A Chundattsandflee
YARN-5318TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider fails intermittently.Minor.sandfleeJun Gong
YARN-5037TestRMRestart#testQueueMetricsOnRMRestart random failureMajor.sandfleesandflee
YARN-5317testAMRestartNotLostContainerCompleteMsg may failMinor.sandfleesandflee
YARN-5159Wrong Javadoc tag in MiniYarnClusterMajordocumentationAndras BokorAndras Bokor
MAPREDUCE-6738TestJobListCache.testAddExisting failed intermittently in slow VM testbedMinor.Junping DuJunping Du
YARN-5092TestRMDelegationTokens fails intermittentlyMajortestRohith Sharma K SJason Lowe
HADOOP-10980TestActiveStandbyElector fails occasionally in trunkMinor.Ted YuEric Badger
HADOOP-13395Enhance TestKMSAuditMinorkmsXiao ChenXiao Chen
YARN-5492TestSubmitApplicationWithRMHA is failing sporadically during precommit buildsMajortestJason LoweVrushali C
YARN-5544TestNodeBlacklistingOnAMFailures fails on trunkMajortestVarun SaxenaSunil G
HDFS-9745TestSecureNNWithQJM#testSecureMode sometimes fails with timeoutsMinor.Xiao ChenXiao Chen
YARN-5389TestYarnClient#testReservationDelete failsMajor.Rohith Sharma K SSean Po
YARN-5560Clean up bad exception catching practices in TestYarnClientMajor.Sean PoSean Po
YARN-5608TestAMRMClient.setup() fails with ArrayOutOfBoundsExceptionMajortestDaniel TempletonDaniel Templeton
HDFS-10657testAclCLI.xml setfacl test should expect mask r-xMinor.John ZhugeJohn Zhuge
HDFS-9333Some tests using MiniDFSCluster errored complaining port in useMinortestKai ZhengMasatake Iwasaki
HADOOP-13686Adding additional unit test for Trash (I)Major.Xiaoyu YaoWeiwei Yang
YARN-3568TestAMRMTokens should use some random portMajortestGera ShegalovTakashi Ohnishi
MAPREDUCE-6804Add timeout when starting JobHistoryServer in MiniMRYarnClusterMinortestAndras BokorAndras Bokor
HDFS-11272Refine the assert messages in TestFSDirAttrOpMinortestAkira AjisakaJimmy Xiang
HDFS-11278Add missing @Test annotation for TestSafeMode.testSafeModeUtils()TrivialnamenodeLukas MajercakLukas Majercak

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
YARN-3356Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label.Majorcapacityscheduler, resourcemanagerWangda TanWangda Tan
YARN-3345Add non-exclusive node label API to RMAdmin protocol and NodeLabelsManagerMajorapi, client, resourcemanagerWangda TanWangda Tan
HDFS-7854Separate class DataStreamer out of DFSOutputStreamMajorhdfs-clientLi BoLi Bo
HDFS-7713Implement mkdirs in the HDFS Web UIMajoruiRavi PrakashRavi Prakash
YARN-2495Allow admin specify labels from each NM (Distributed configuration)MajorresourcemanagerWangda TanNaganarasimha G R
HDFS-7893Update the POM to create a separate hdfs-client jarMajorbuildHaohui MaiHaohui Mai
YARN-3365Add support for using the ‘tc’ tool via container-executorMajornodemanagerSidharta SeethanaSidharta Seethana
HDFS-8034Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for WindowsMinortestXiaoyu YaoXiaoyu Yao
YARN-3110Few issues in ApplicationHistory web uiMinorapplications, timelineserverBibin A ChundattNaganarasimha G R
HDFS-8049Annotation client implementation as privateMajorhdfs-clientTsz Wo Nicholas SzeTakuya Fukudome
HDFS-8079Separate the client retry conf from DFSConfigKeysMajorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8080Separate JSON related routines used by WebHdfsFileSystem to a package local classMinorhdfs-clientHaohui MaiHaohui Mai
HDFS-8085Move CorruptFileBlockIterator to the hdfs.client.impl packageMinorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8089Move o.a.h.hdfs.web.resources.* to the client jarsMinorbuildHaohui MaiHaohui Mai
HDFS-8102Separate webhdfs retry configuration keys from DFSConfigKeysMinorhdfs-clientHaohui MaiHaohui Mai
YARN-1376NM need to notify the log aggregation status to RM through Node heartbeatMajor.Xuan GongXuan Gong
HDFS-8100Refactor DFSClient.Conf to a standalone classMinorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8103Move BlockTokenSecretManager.AccessMode into BlockTokenIdentifierMinorsecurityHaohui MaiHaohui Mai
HDFS-8084Separate the client failover conf from DFSConfigKeysMajorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8083Separate the client write conf from DFSConfigKeysMajorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
YARN-3347Improve YARN log command to get AMContainer logs as well as running containers logsMajorlog-aggregationXuan GongXuan Gong
YARN-3443Create a ‘ResourceHandler’ subsystem to ease addition of support for new resource types on the NMMajornodemanagerSidharta SeethanaSidharta Seethana
HDFS-7701Support reporting per storage type quota and usage with hadoop/hdfs shellMajordatanode, namenodeXiaoyu YaoPeter Shi
YARN-3361CapacityScheduler side changes to support non-exclusive node labelsMajorcapacityschedulerWangda TanWangda Tan
YARN-3318Create Initial OrderingPolicy Framework and FifoOrderingPolicyMajorschedulerCraig WelchCraig Welch
YARN-3326Support RESTful API for getLabelsToNodesMinorresourcemanagerNaganarasimha G RNaganarasimha G R
YARN-3354Container should contains node-labels asked by original ResourceRequestsMajorapi, capacityscheduler, nodemanager, resourcemanagerWangda TanWangda Tan
HDFS-8082Separate the client read conf from DFSConfigKeysMajorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8165Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-clientMajorbuildHaohui MaiHaohui Mai
YARN-1402Related Web UI, CLI changes on exposing client API to check log aggregation statusMajor.Xuan GongXuan Gong
YARN-2696Queue sorting in CapacityScheduler should consider node labelMajorcapacityscheduler, resourcemanagerWangda TanWangda Tan
YARN-3487CapacityScheduler scheduler lock obtained unnecessarily when calling getQueueCriticalcapacityschedulerJason LoweJason Lowe
YARN-3136getTransferredContainers can be a bottleneck during AM registrationMajorschedulerJason LoweSunil G
HDFS-8169Move LocatedBlocks and related classes to hdfs-clientMajorbuild, hdfs-clientHaohui MaiHaohui Mai
YARN-3463Integrate OrderingPolicy Framework with CapacitySchedulerMajorcapacityschedulerCraig WelchCraig Welch
HDFS-8185Separate client related routines in HAUtil into a new classMajorbuild, hdfs-clientHaohui MaiHaohui Mai
YARN-3225New parameter or CLI for decommissioning node gracefully in RMAdmin CLIMajorgracefulJunping DuDevaraj K
HDFS-8218Move classes that used by ClientProtocol into hdfs-clientMajorbuildHaohui MaiHaohui Mai
YARN-3366Outbound network bandwidth : classify/shape traffic originating from YARN containersMajor.Sidharta SeethanaSidharta Seethana
YARN-2605[RM HA] Rest api endpoints doing redirect incorrectlyMajorresourcemanagerbc WongXuan Gong
YARN-3319Implement a FairOrderingPolicyMajorschedulerCraig WelchCraig Welch
YARN-3413Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn't be changeable at runtimeMajorapi, client, resourcemanagerWangda TanWangda Tan
YARN-2498Respect labels in preemption policy of capacity scheduler for inter-queue preemptionMajorresourcemanagerWangda TanWangda Tan
YARN-2740Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabledMajorresourcemanagerWangda TanNaganarasimha G R
YARN-3544AM logs link missing in the RM UI for a completed appBlocker.Hitesh ShahXuan Gong
YARN-2619NodeManager: Add cgroups support for disk I/O isolationMajor.Wei YanVarun Vasudev
HDFS-8086Move LeaseRenewer to the hdfs.client.impl packageMinorhdfs-clientTsz Wo Nicholas SzeTakanobu Asanuma
YARN-3006Improve the error message when attempting manual failover with auto-failover enabledMinor.Akira AjisakaAkira Ajisaka
HDFS-8249Separate HdfsConstants into the client and the server side classMajorhdfs-clientHaohui MaiHaohui Mai
HDFS-8309Skip unit test using DataNodeTestUtils#injectDataDirFailure() on WindowsMinortestXiaoyu YaoXiaoyu Yao
HDFS-8237Move all protocol classes used by ClientProtocol to hdfs-clientMajorbuildHaohui MaiHaohui Mai
HDFS-8314Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the usersMajor.Haohui MaiLi Lu
HDFS-8310Fix TestCLI.testAll ‘help: help for find’ on WindowsMinortestXiaoyu YaoKiran Kumar M R
YARN-3301Fix the format issue of the new RM web UI and AHS web UI after YARN-3272 / YARN-3262MajorresourcemanagerXuan GongXuan Gong
YARN-3448Add Rolling Time To Lives Level DB Plugin CapabilitiesMajortimelineserverJonathan EaglesJonathan Eagles
YARN-2918Don‘t fail RM if queue’s configured labels are not existed in cluster-node-labelsMajorresourcemanagerRohith Sharma K SWangda Tan
YARN-644Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainerMinornodemanagerOmkar Vinit JoshiVarun Saxena
YARN-3593Add label-type and Improve “DEFAULT_PARTITION” in Node Labels PageMajorwebappNaganarasimha G RNaganarasimha G R
YARN-2331Distinguish shutdown during supervision vs. shutdown for rolling upgradeMajornodemanagerJason LoweJason Lowe
YARN-3579CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappingsMinorresourcemanagerSunil GSunil G
YARN-3505Node's Log Aggregation Report with SUCCEED should not cached in RMAppsCriticallog-aggregationJunping DuXuan Gong
HDFS-8403Eliminate retries in TestFileCreation#testOverwriteOpenForWriteMajortestArpit AgarwalArpit Agarwal
HDFS-8157Writes to RAM DISK reserve locked memory for block filesMajordatanodeArpit AgarwalArpit Agarwal
YARN-3541Add version info on timeline service / generic history web UI and REST APIMajortimelineserverZhijie ShenZhijie Shen
YARN-3565NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of StringBlockerapi, client, resourcemanagerWangda TanNaganarasimha G R
YARN-3583Support of NodeLabel object instead of plain String in YarnClient side.MajorclientSunil GSunil G
YARN-3609Move load labels from storage from serviceInit to serviceStart to make it works with RM HA case.MajorresourcemanagerWangda TanWangda Tan
YARN-3684Change ContainerExecutor's primary lifecycle methods to use a more extensible mechanism for passing information.MajoryarnSidharta SeethanaSidharta Seethana
HDFS-8454Remove unnecessary throttling in TestDatanodeDeathMajortestArpit AgarwalArpit Agarwal
YARN-3632Ordering policy should be allowed to reorder an application when demand changesMajorcapacityschedulerCraig WelchCraig Welch
YARN-3686CapacityScheduler should trim default_node_label_expressionCriticalapi, client, resourcemanagerWangda TanSunil G
YARN-3647RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel objectMajorresourcemanagerSunil GSunil G
YARN-3581Deprecate -directlyAccessNodeLabelStore in RMAdminCLIMajorapi, client, resourcemanagerWangda TanNaganarasimha G R
HDFS-8482Rename BlockInfoContiguous to BlockInfoMajor.Zhe ZhangZhe Zhang
YARN-3700ATS Web Performance issue at load time when large number of jobsMajorresourcemanager, webapp, yarnXuan GongXuan Gong
YARN-3716Node-label-expression should be included by ResourceRequestPBImpl.toStringMinorapiXianyin XinXianyin Xin
YARN-3740Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPSMajorresourcemanager, webapp, yarnXuan GongXuan Gong
YARN-2900Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)MajortimelineserverJonathan EaglesMit Desai
HDFS-8489Subclass BlockInfo to represent contiguous blocksMajornamenodeZhe ZhangZhe Zhang
YARN-2392add more diags about app retry limits on AM failuresMinorresourcemanagerSteve LoughranSteve Loughran
YARN-3766ATS Web UI breaks because of YARN-3467Blockerresourcemanager, webapp, yarnXuan GongXuan Gong
YARN-1462AHS API and other AHS changes to handle tags for completed MR jobsMajor.Karthik KambatlaXuan Gong
YARN-3787loading applications by filtering appstartedTime period for ATS Web UIMajorresourcemanager, webapp, yarnXuan GongXuan Gong
HDFS-7923The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messagesMajor.Colin P. McCabeColin P. McCabe
HDFS-8540Mover should exit with NO_MOVE_BLOCK if no block can be movedMajorbalancer & moverTsz Wo Nicholas SzeSurendra Singh Lilhore
YARN-3711Documentation of ResourceManager HA should explain configurations about listen addressesMinordocumentationMasatake IwasakiMasatake Iwasaki
HDFS-8597Fix TestFSImage#testZeroBlockSize on WindowsMajordatanode, testXiaoyu YaoXiaoyu Yao
HDFS-7164Feature documentation for HDFS-6581MajordocumentationArpit AgarwalArpit Agarwal
HDFS-8238Move ClientProtocol to the hdfs-clientMajorbuildHaohui MaiTakanobu Asanuma
HDFS-6249Output AclEntry in PBImageXmlWriterMinortoolsAkira AjisakaSurendra Singh Lilhore
YARN-3521Support return structured NodeLabel objects in REST APIMajorapi, client, resourcemanagerWangda TanSunil G
HDFS-8192Eviction should key off used locked memory instead of ram disk free spaceMajordatanodeArpit AgarwalArpit Agarwal
HDFS-8651Make hadoop-hdfs-project Native code -Wall-cleanMajornativeAlan BurlisonAlan Burlison
HADOOP-12036Consolidate all of the cmake extensions in one directoryMajor.Allen WittenauerAlan Burlison
HDFS-7390Provide JMX metrics per storage typeMajor.Benoy AntonyBenoy Antony
HADOOP-12104Migrate Hadoop Pipes native build to new CMake frameworkMajorbuildAlan BurlisonAlan Burlison
HADOOP-12112Make hadoop-common-project Native code -Wall-cleanMajornativeAlan BurlisonAlan Burlison
HDFS-8493Consolidate truncate() related implementation in a single classMajor.Haohui MaiRakesh R
HDFS-8635Migrate HDFS native build to new CMake frameworkMajorbuildAlan BurlisonAlan Burlison
YARN-3827Migrate YARN native build to new CMake frameworkMajorbuildAlan BurlisonAlan Burlison
MAPREDUCE-6376Add avro binary support for jhist filesMajorjobhistoryserverRay ChiangRay Chiang
HDFS-8620Clean up the checkstyle warinings about ClientProtocolMajor.Takanobu AsanumaTakanobu Asanuma
HDFS-8726Move protobuf files that define the client-sever protocols to hdfs-clientMajorbuildHaohui MaiHaohui Mai
YARN-1012Report NM aggregated container resource utilization in heartbeatMajornodemanagerArun C MurthyInigo Goiri
YARN-3800Reduce storage footprint for ReservationAllocationMajorcapacityscheduler, fairscheduler, resourcemanagerAnubhav DhootAnubhav Dhoot
YARN-3445Cache runningApps in RMNode for getting running apps on given NodeIdMajornodemanager, resourcemanagerJunping DuJunping Du
YARN-3116[Collector wireup] We need an assured way to determine if a container is an AM container on NMMajornodemanager, timelineserverZhijie ShenGiovanni Matteo Fumarola
HDFS-8541Mover should exit with NO_MOVE_PROGRESS if there is no move progressMinorbalancer & moverTsz Wo Nicholas SzeSurendra Singh Lilhore
HDFS-8742Inotify: Support event for OP_TRUNCATEMajornamenodeSurendra Singh LilhoreSurendra Singh Lilhore
YARN-1449AM-NM protocol changes to support container resizingMajorapiWangda Tan (No longer used)MENG DING
HADOOP-11974Fix FIONREAD #include on SolarisMinornetAlan BurlisonAlan Burlison
YARN-3930FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrownMajorapi, client, resourcemanagerDian FuDian Fu
YARN-3844Make hadoop-yarn-project Native code -Wall-cleanMajorbuildAlan BurlisonAlan Burlison
HDFS-8794Improve CorruptReplicasMap#corruptReplicasMapMajor.Yi LiuYi Liu
HDFS-7483Display information per tier on the Namenode UIMajor.Benoy AntonyBenoy Antony
YARN-2003Support for Application priority : Changes in RM and Capacity SchedulerMajorresourcemanagerSunil GSunil G
HDFS-8721Add a metric for number of encryption zonesMajorencryptionRakesh RRakesh R
YARN-1645ContainerManager implementation to support container resizingMajornodemanagerWangda TanMENG DING
HDFS-8495Consolidate append() related implementation into a single classMajornamenodeRakesh RRakesh R
HDFS-8795Improve InvalidateBlocks#node2blocksMajor.Yi LiuYi Liu
HADOOP-12184Remove unused Linux-specific constants in NativeIOMajornativeMartin WalshMartin Walsh
HDFS-8730Clean up the import statements in ClientProtocolMinor.Takanobu AsanumaTakanobu Asanuma
YARN-3969Allow jobs to be submitted to reservation that is active but does not have any allocationsMajorcapacityscheduler, fairscheduler, resourcemanagerSubru KrishnanSubru Krishnan
HADOOP-12170hadoop-common's JNIFlags.cmake is redundant and can be removedMinornativeAlan BurlisonAlan Burlison
YARN-3656LowCost: A Cost-Based Placement Agent for YARN ReservationsMajorcapacityscheduler, resourcemanagerIshai MenacheJonathan Yaniv
YARN-3852Add docker container support to container-executorMajoryarnSidharta SeethanaAbin Shahab
YARN-3853Add docker container runtime support to LinuxContainterExecutorMajoryarnSidharta SeethanaSidharta Seethana
YARN-3867ContainerImpl changes to support container resizingMajornodemanagerMENG DINGMENG DING
HDFS-7192DN should ignore lazyPersist hint if the writer is not localMajordatanodeArpit AgarwalArpit Agarwal
YARN-433When RM is catching up with node updates then it should not expire acquired containersMajorresourcemanagerBikas SahaXuan Gong
MAPREDUCE-6394Speed up Task processing loop in HsTasksBlock#render()MajorjobhistoryserverRay ChiangRay Chiang
HADOOP-7824NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux valuesMajornativeDmytro ShteflyukMartin Walsh
YARN-3543ApplicationReport should be able to tell whether the Application is AM managed or not.MajorapiSpandan DuttaRohith Sharma K S
YARN-4004container-executor should print output of docker logs if the docker container exits with non-0 exit statusMajornodemanagerVarun VasudevVarun Vasudev
YARN-3736Add RMStateStore apis to store and load accepted reservations for failoverMajorcapacityscheduler, fairscheduler, resourcemanagerSubru KrishnanAnubhav Dhoot
YARN-1643Make ContainersMonitor can support change monitoring size of an allocated container in NM sideMajornodemanagerWangda TanMENG DING
YARN-3974Refactor the reservation system test cases to use parameterized base testMajorcapacityscheduler, fairschedulerSubru KrishnanSubru Krishnan
YARN-3948Display Application Priority in RM Web UIMajorwebappSunil GSunil G
YARN-3873pendingApplications in LeafQueue should also use OrderingPolicyMajorcapacityschedulerSunil GSunil G
YARN-3887Support for changing Application priority during runtimeMajorcapacityscheduler, resourcemanagerSunil GSunil G
HDFS-8805Archival Storage: getStoragePolicy should not need superuser privilegeMajorbalancer & mover, namenodeHui ZhengBrahma Reddy Battula
HDFS-8052Move WebHdfsFileSystem into hadoop-hdfs-clientMajorbuildHaohui MaiHaohui Mai
YARN-4023Publish Application Priority to TimelineServerMajortimelineserverSunil GSunil G
HDFS-8824Do not use small blocks for balancing the clusterMajorbalancer & moverTsz Wo Nicholas SzeTsz Wo Nicholas Sze
YARN-3534Collect memory/cpu usage on the nodeMajornodemanager, resourcemanagerInigo GoiriInigo Goiri
HDFS-8801Convert BlockInfoUnderConstruction as a featureMajornamenodeZhe ZhangJing Zhao
HDFS-8792BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memoryMajor.Yi LiuYi Liu
HDFS-8862BlockManager#excessReplicateMap should use a HashMapMajornamenodeYi LiuYi Liu
HDFS-8278HDFS Balancer should consider remaining storage % when checking for under-utilized machinesMajorbalancer & moverGopal VTsz Wo Nicholas Sze
HDFS-8826Balancer may not move blocks efficiently in some casesMajorbalancer & moverTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-8803Move DfsClientConf to hdfs-clientMajorbuildHaohui MaiMingliang Liu
YARN-2923Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration SetupMajornodemanagerNaganarasimha G RNaganarasimha G R
YARN-1644RM-NM protocol changes and NodeStatusUpdater implementation to support container resizingMajornodemanagerWangda TanMENG DING
YARN-3868ContainerManager recovery for container resizingMajornodemanagerMENG DINGMENG DING
HDFS-8823Move replication factor into individual blocksMajor.Haohui MaiHaohui Mai
YARN-221NM should provide a way for AM to tell it not to aggregate logs.Majorlog-aggregation, nodemanagerRobert Joseph EvansMing Ma
HDFS-8934Move ShortCircuitShm to hdfs-clientMajorbuildMingliang LiuMingliang Liu
HDFS-8948Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailureMajorbuildMingliang LiuMingliang Liu
YARN-4014Support user cli interface in for Application PriorityMajorclient, resourcemanagerRohith Sharma K SRohith Sharma K S
HDFS-8951Move the shortcircuit package to hdfs-clientMajorbuildMingliang LiuMingliang Liu
HDFS-8248Store INodeId instead of the INodeFile object in BlockInfoContiguousMajor.Haohui MaiHaohui Mai
HDFS-8962Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConfMajorbuildMingliang LiuMingliang Liu
YARN-3250Support admin cli interface in for Application PriorityMajorresourcemanagerSunil GRohith Sharma K S
HDFS-8925Move BlockReaderLocal to hdfs-clientMajorbuildMingliang LiuMingliang Liu
HDFS-8980Remove unnecessary block replacement in INodeFileMajornamenodeJing ZhaoJing Zhao
HDFS-8990Move RemoteBlockReader to hdfs-client moduleMajorbuildMingliang LiuMingliang Liu
YARN-4092RM HA UI redirection needs to be fixed when both RMs are in standby modeMajorresourcemanagerXuan GongXuan Gong
YARN-4082Container shouldn‘t be killed when node’s label updated.Majorcapacity schedulerWangda TanWangda Tan
YARN-2801Add documentation for node labels featureMajordocumentationGururaj ShettyWangda Tan
YARN-3893Both RM in active state when Admin#transitionToActive failure from refeshAll()CriticalresourcemanagerBibin A ChundattBibin A Chundatt
HDFS-8890Allow admin to specify which blockpools the balancer should run onMajorbalancer & moverChris TrezzoChris Trezzo
YARN-4101RM should print alert messages if Zookeeper and Resourcemanager gets connection issueCriticalyarnYesha VoraXuan Gong
YARN-3970REST api support for Application PriorityMajorwebappSunil GNaganarasimha G R
HDFS-9002Move o.a.h.hdfs.net/*Peer classes to hdfs-clientMajorbuildMingliang LiuMingliang Liu
HDFS-9012Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client moduleMajorbuildMingliang LiuMingliang Liu
HDFS-8984Move replication queues related methods in FSNamesystem to BlockManagerMajor.Haohui MaiHaohui Mai
YARN-2884Proxying all AM-RM communicationsMajornodemanager, resourcemanagerCarlo CurinoKishore Chaliparambil
YARN-4136LinuxContainerExecutor loses info when forwarding ResourceHandlerExceptionTrivialnodemanagerSteve LoughranBibin A Chundatt
HDFS-9041Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-clientMajorbuildHaohui MaiMingliang Liu
HDFS-9010Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config keyMajorbuildMingliang LiuMingliang Liu
YARN-1651CapacityScheduler side changes to support increase/decrease container resource.Majorresourcemanager, schedulerWangda TanWangda Tan
YARN-313Add Admin API for supporting node resource configuration in command lineCriticalclient, gracefulJunping DuInigo Goiri
HDFS-9008Balancer#Parameters class could use a builder patternMinorbalancer & moverChris TrezzoChris Trezzo
YARN-3635Get-queue-mapping should be a common interface of YarnSchedulerMajorschedulerWangda TanTan, Wangda
YARN-3717Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-APIMajor.Naganarasimha G RNaganarasimha G R
HDFS-7986Allow files / directories to be deleted from the NameNode UIMajoruiRavi PrakashRavi Prakash
HDFS-7995Implement chmod in the HDFS Web UIMajoruiRavi PrakashRavi Prakash
YARN-4034Render cluster Max Priority in scheduler metrics in RM web UIMinorresourcemanager, webappRohith Sharma K SRohith Sharma K S
HDFS-9022Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-clientMajorhdfs-clientMingliang LiuMingliang Liu
YARN-4171Resolve findbugs/javac warnings in YARN-1197 branchMajorapi, nodemanager, resourcemanagerWangda TanWangda Tan
YARN-3212RMNode State Transition Update with DECOMMISSIONING stateMajorgraceful, resourcemanagerJunping DuJunping Du
HDFS-9101Remove deprecated NameNode.getUri() static helper methodMajor.Mingliang LiuMingliang Liu
HDFS-9004Add upgrade domain to DatanodeInfoMajor.Ming MaMing Ma
HDFS-9111Move hdfs-client protobuf convert methods from PBHelper to PBHelperClientMajor.Mingliang LiuMingliang Liu
HDFS-9039Separate client and server side methods of o.a.h.hdfs.NameNodeProxiesMajor.Mingliang LiuMingliang Liu
HDFS-8733Keep server related definition in hdfs.proto on server sideMajor.Yi LiuMingliang Liu
HDFS-9131Move config keys used by hdfs-client to HdfsClientConfigKeysMajor.Mingliang LiuMingliang Liu
HDFS-7529Consolidate encryption zone related implementation into a single classMajor.Haohui MaiRakesh R
HDFS-9134Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstantsMajor.Mingliang LiuMingliang Liu
HADOOP-11918Listing an empty s3a root directory throws FileNotFound.Minorfs/s3Lei (Eddy) XuLei (Eddy) Xu
HDFS-8053Move DFSIn/OutputStream and related classes to hadoop-hdfs-clientMajorbuildHaohui MaiMingliang Liu
HDFS-8740Move DistributedFileSystem to hadoop-hdfs-clientMajorbuildYi LiuMingliang Liu
YARN-4141Runtime Application Priority change should not throw exception for applications at finishing statesMajorresourcemanagerSunil GSunil G
HDFS-9165Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-clientMajorbuildHaohui MaiMingliang Liu
HDFS-9166Move hftp / hsftp filesystem to hfds-clientMajorbuildHaohui MaiMingliang Liu
HDFS-8971Remove guards when calling LOG.debug() and LOG.trace() in client packageMajorbuildMingliang LiuMingliang Liu
HDFS-9015Refactor TestReplicationPolicy to test different block placement policiesMajor.Ming MaMing Ma
YARN-1897CLI and core support for signal container functionalityMajorapiMing MaMing Ma
HDFS-9158[OEV-Doc] : Document does not mention about “-f” and “-r” optionsMajor.nijelnijel
HDFS-9155OEV should treat .XML files as XML even when the file name extension is uppercaseMajor.nijelnijel
YARN-4215RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the requestMajorresourcemanagerNaganarasimha G RNaganarasimha G R
HDFS-9170Move libhdfs / fuse-dfs / libwebhdfs to hdfs-clientMajor.Haohui MaiHaohui Mai
HDFS-9159[OIV] : return value of the command is not correct if invalid value specified in “-p (processor)” optionMajor.nijelnijel
YARN-4140RM container allocation delayed incase of app submitted to Nodelabel partitionMajorschedulerBibin A ChundattBibin A Chundatt
YARN-3964Support NodeLabelsProvider at Resource Manager sideMajor.Dian FuDian Fu
YARN-4230Increasing container resource while there is no headroom left will cause ResourceManager to crashCriticalresourcemanagerMENG DINGMENG DING
HDFS-9006Provide BlockPlacementPolicy that supports upgrade domainMajor.Ming MaMing Ma
HDFS-9160[OIV-Doc] : Missing details of “delimited” for processor optionsMajor.nijelnijel
HDFS-9167Update pom.xml in other modules to depend on hdfs-client instead of hdfsMajorbuildHaohui MaiMingliang Liu
YARN-4255container-executor does not clean up docker operation command files.Minor.Sidharta SeethanaSidharta Seethana
HDFS-9223Code cleanup for DatanodeDescriptor and HeartbeatManagerMinornamenodeJing ZhaoJing Zhao
YARN-4258Add support for controlling capabilities for docker containersMajoryarnSidharta SeethanaSidharta Seethana
HDFS-9157[OEV and OIV] : Unnecessary parsing for mandatory arguements if “-h” option is specified as the only optionMajor.nijelnijel
HADOOP-12475Replace guava Cache with ConcurrentHashMap for caching Connection in ipc ClientMajorconf, io, ipcWalter SuWalter Su
YARN-4162CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST APIMajorapi, client, resourcemanagerNaganarasimha G RNaganarasimha G R
YARN-4170AM need to be notified with priority in AllocateResponseMajorresourcemanagerSunil GSunil G
YARN-2556Tool to measure the performance of the timeline serverMajortimelineserverJonathan EaglesChang Li
YARN-4262Allow whitelisted users to run privileged docker containers.MajoryarnSidharta SeethanaSidharta Seethana
YARN-4267Add additional logging to container launch implementations in container-executorMajoryarnSidharta SeethanaSidharta Seethana
YARN-3985Make ReservationSystem persist state using RMStateStore reservation APIsMajorresourcemanagerAnubhav DhootAnubhav Dhoot
YARN-2513Host framework UIs in YARN for use with the ATSMajortimelineserverJonathan EaglesJonathan Eagles
YARN-3739Add reservation system recovery to RM recovery processMajorcapacityscheduler, fairscheduler, resourcemanagerSubru KrishnanSubru Krishnan
YARN-4243Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInitMajorresourcemanagerXuan GongXuan Gong
YARN-3738Add support for recovery of reserved apps running under dynamic queuesMajorcapacityscheduler, resourcemanagerSubru KrishnanSubru Krishnan
YARN-3724Use POSIX nftw(3) instead of fts(3)Major.Malcolm KavalskyAlan Burlison
YARN-2729Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration SetupMajornodemanagerNaganarasimha G RNaganarasimha G R
HDFS-9304Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClassesMajorbuildMingliang LiuMingliang Liu
YARN-3216Max-AM-Resource-Percentage should respect node labelsCriticalresourcemanagerWangda TanSunil G
HADOOP-12457[JDK8] Fix a failure of compiling common by javadocMajor.Tsuyoshi OzawaAkira Ajisaka
HDFS-9168Move client side unit test to hadoop-hdfs-clientMajorbuildHaohui MaiHaohui Mai
HDFS-9343Empty caller context considered invalidMajor.Mingliang LiuMingliang Liu
HDFS-9362TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.MinortestChris NaurothChris Nauroth
HDFS-9007Fix HDFS Balancer to honor upgrade domain policyMajor.Ming MaMing Ma
HDFS-9379Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodesMajortestMingliang LiuMingliang Liu
YARN-1510Make NMClient support change container resourcesMajornodemanagerWangda Tan (No longer used)MENG DING
YARN-4345yarn rmadmin -updateNodeResource doesn't workCriticalgraceful, resourcemanagerSushmitha SreenivasanJunping Du
YARN-1509Make AMRMClient support send increase container request and get increased/decreased containersMajorresourcemanagerWangda Tan (No longer used)MENG DING
HDFS-9387Fix namenodeUri parameter parsing in NNThroughputBenchmarkMajortestMingliang LiuMingliang Liu
HDFS-9421NNThroughputBenchmark replication test NPE with -namenode optionMajorbenchmarksXiaoyu YaoMingliang Liu
YARN-4184Remove update reservation state api from state store as its not used by ReservationSystemMajorcapacityscheduler, fairscheduler, resourcemanagerAnubhav DhootSean Po
HADOOP-12582Using BytesWritable's getLength() and getBytes() instead of get() and getSize()Major.Tsuyoshi OzawaAkira Ajisaka
YARN-3454Add efficient merge operation to RLESparseResourceAllocationMajorresourcemanagerCarlo CurinoCarlo Curino
HDFS-7796Include X-editable for slick contenteditable fields in the web UIMajoruiRavi PrakashRavi Prakash
YARN-3980Plumb resource-utilization info in node heartbeat through to the schedulerMajorresourcemanager, schedulerKarthik KambatlaInigo Goiri
HADOOP-11954Solaris does not support RLIMIT_MEMLOCK as in LinuxMajor.Malcolm KavalskyAlan Burlison
YARN-4384updateNodeResource CLI should not accept negative values for resourceMajorgraceful, resourcemanagerSushmitha SreenivasanJunping Du
HDFS-9438TestPipelinesFailover assumes Linux ifconfigMinortestAlan BurlisonJohn Zhuge
YARN-4292ResourceUtilization should be a part of NodeInfo REST APIMajor.Wangda TanSunil G
HDFS-9436Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by defaultMinortestMingliang LiuMingliang Liu
HDFS-9484NNThroughputBenchmark$BlockReportStats should not send empty block reportsMajortestMingliang LiuMingliang Liu
YARN-4405Support node label store in non-appendable file systemMajorapi, client, resourcemanagerWangda TanWangda Tan
HDFS-9214Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restartMajordatanodeXiaobing ZhouXiaobing Zhou
YARN-4248REST API for submit/update/delete ReservationsMajorresourcemanagerCarlo CurinoCarlo Curino
YARN-4358Improve relationship between SharingPolicy and ReservationAgentMajorcapacityscheduler, fairscheduler, resourcemanagerCarlo CurinoCarlo Curino
YARN-3946Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic messageMajorcapacity scheduler, resourcemanagerSumit NigamNaganarasimha G R
YARN-4309Add container launch related debug information to container logs when a container failsMajornodemanagerVarun VasudevVarun Vasudev
YARN-4293ResourceUtilization should be a part of yarn node CLIMajor.Wangda TanSunil G
YARN-4416Deadlock due to synchronised get Methods in AbstractCSQueueMinorcapacity scheduler, resourcemanagerNaganarasimha G RNaganarasimha G R
YARN-3226UI changes for decommissioning nodeMajorgracefulJunping DuSunil G
YARN-4164Retrospect update ApplicationPriority API return typeMajorresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-4234New put APIs in TimelineClient for ats v1.5MajortimelineserverXuan GongXuan Gong
YARN-4098Document ApplicationPriority featureMajorresourcemanagerRohith Sharma K SRohith Sharma K S
HDFS-7779Support changing ownership, group and replication in HDFS Web UIMajoruiRavi PrakashRavi Prakash
YARN-2902Killing a container that is localizing can orphan resources in the DOWNLOADING stateMajornodemanagerJason LoweVarun Saxena
YARN-4393TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittentlyMajortestVarun SaxenaVarun Saxena
YARN-4479Retrospect app-priority in pendingOrderingPolicy during recovering applicationsMajorapi, resourcemanagerRohith Sharma K SRohith Sharma K S
HDFS-9621getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directoryCriticalerasure-codingSushmitha SreenivasanJing Zhao
YARN-4537Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policyMajorcapacity schedulerRohith Sharma K SRohith Sharma K S
HADOOP-11262Enable YARN to use S3AMajorfs/s3Thomas DemoorPieter Reuse
YARN-4265Provide new timeline plugin storage to support fine-grained entity cachingMajortimelineserverLi LuLi Lu
YARN-4304AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metricsMajorwebappSunil GSunil G
YARN-4557Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*MajorresourcemanagerNaganarasimha G RNaganarasimha G R
HDFS-9601NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding blockMajortestMasatake IwasakiMasatake Iwasaki
YARN-4614TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority fails occasionallyMajortestJason LoweSunil G
HDFS-9672o.a.h.hdfs.TestLeaseRecovery2 fails intermittentlyMajortestMingliang LiuMingliang Liu
YARN-4573TestRMAppTransitions.testAppRunningKill and testAppKilledKilled fail on trunkMajorresourcemanager, testTakashi OhnishiTakashi Ohnishi
YARN-4643Container recovery is broken with delegating container runtimeCriticalyarnSidharta SeethanaSidharta Seethana
YARN-4219New levelDB cache storage for timeline v1.5Major.Li LuLi Lu
YARN-4543TestNodeStatusUpdater.testStopReentrant fails + JUnit misusageMinornodemanagerAkihiro SudaAkihiro Suda
YARN-4340Add “list” API to reservation systemMajorcapacityscheduler, fairscheduler, resourcemanagerCarlo CurinoSean Po
YARN-4100Add Documentation for Distributed and Delegated-Centralized Node Labels featureMajorapi, client, resourcemanagerNaganarasimha G RNaganarasimha G R
HDFS-9503Replace -namenode option with -fs for NNThroughputBenchmarkMajortestKonstantin ShvachkoMingliang Liu
HADOOP-12292Make use of DeleteObjects optionalMajorfs/s3Thomas DemoorThomas Demoor
YARN-4667RM Admin CLI for refreshNodesResources throws NPE when nothing is configuredCriticalclientNaganarasimha G RNaganarasimha G R
HADOOP-12752Improve diagnostics/use of envvar/sysprop credential propagationMinorsecuritySteve LoughranSteve Loughran
YARN-4138Roll back container resource allocation after resource increase token expiresMajorapi, nodemanager, resourcemanagerMENG DINGMENG DING
YARN-2575Create separate ACLs for Reservation create/update/delete/list opsMajorcapacityscheduler, fairscheduler, resourcemanagerSubru KrishnanSean Po
HADOOP-11613Remove commons-httpclient dependency from hadoop-azureMajor.Akira AjisakaMasatake Iwasaki
HDFS-9084Pagination, sorting and filtering of files/directories in the HDFS Web UIMajoruiRavi PrakashRavi Prakash
YARN-3223Resource update during NM graceful decommissionMajorgraceful, nodemanager, resourcemanagerJunping DuBrook Zhou
YARN-4680TimerTasks leak in ATS V1.5 WriterMajortimelineserverXuan GongXuan Gong
HADOOP-12711Remove dependency on commons-httpclient for ServletUtilMajor.Wei-Chiu ChuangWei-Chiu Chuang
YARN-4566TestMiniYarnClusterNodeUtilization sometimes fails on trunkMajortestTakashi OhnishiTakashi Ohnishi
HADOOP-12813Migrate TestRPC and related codes to rebase on ProtobufRpcEngineMajor.Kai ZhengKai Zheng
YARN-4749Generalize config file handling in container-executorMajornodemanagerSidharta SeethanaSidharta Seethana
YARN-4696Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrencyMajortimelineserverSteve LoughranSteve Loughran
MAPREDUCE-6520Migrate MR Client test cases part 1TrivialtestDustin CoteDustin Cote
YARN-4545Allow YARN distributed shell to use ATS v1.5 APIsMajortimelineserverLi LuLi Lu
YARN-4817Change Log Level to DEBUG for putDomain call in ATS 1.5TrivialtimelineserverXuan GongXuan Gong
YARN-4108CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming requestMajorcapacity schedulerWangda TanWangda Tan
HADOOP-12819Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngineMajor.Kai ZhengKai Zheng
YARN-4815ATS 1.5 timelineclient impl try to create attempt directory for every event callMajortimelineserverXuan GongXuan Gong
YARN-4814ATS 1.5 timelineclient impl call flush after every event writeMajortimelineserverXuan GongXuan Gong
YARN-998Keep NM resource updated through dynamic resource config for RM/NM restartMajorgraceful, nodemanager, schedulerJunping DuJunping Du
MAPREDUCE-6543Migrate MR Client test cases part 2TrivialtestDustin CoteDustin Cote
YARN-4822Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidatesMajor.Wangda TanWangda Tan
YARN-4634Scheduler UI/Metrics need to consider cases like non-queue label mappingsMajor.Sunil GSunil G
HADOOP-12169ListStatus on empty dir in S3A lists itself instead of returning an empty listMajorfs/s3Pieter ReusePieter Reuse
HDFS-10186DirectoryScanner: Improve logs by adding full path of both actual and expected block directoriesMinordatanodeRakesh RRakesh R
YARN-4826Document configuration of ReservationSystem for CapacitySchedulerMinorcapacity schedulerSubru KrishnanSubru Krishnan
HADOOP-12444Support lazy seek in S3AInputStreamMajorfs/s3Rajesh BalamohanRajesh Balamohan
YARN-4928Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colonMinortestGergely NovákGergely Novák
YARN-4168Test TestLogAggregationService.testLocalFileDeletionOnDiskFull failingCriticaltestSteve LoughranTakashi Ohnishi
HADOOP-12973make DU pluggableMajor.Elliott ClarkElliott Clark
YARN-4886Add HDFS caller context for EntityGroupFSTimelineStoreMajortimelineserverLi LuLi Lu
HDFS-10281o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittentlyMajortestMingliang LiuMingliang Liu
YARN-4909Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilterBlocker.Brahma Reddy BattulaBibin A Chundatt
YARN-4468Document the general ReservationSystem functionality, and the REST APIMajorcapacityscheduler, fairscheduler, resourcemanagerCarlo CurinoCarlo Curino
HADOOP-13011Clearly Document the Password Details for Keystore-based Credential ProvidersMajordocumentationLarry McCayLarry McCay
YARN-3215Respect labels in CapacityScheduler when computing headroomMajorcapacityschedulerWangda TanNaganarasimha G R
HDFS-10224Implement asynchronous rename for DistributedFileSystemMajorfs, hdfs-clientXiaobing ZhouXiaobing Zhou
YARN-4956findbug issue on LevelDBCacheTimelineStoreMajortimelineserverXuan GongZhiyuan Yang
YARN-4851Metric improvements for ATS v1.5 storage componentsMajortimelineserverLi LuLi Lu
HADOOP-12749Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errorsMajor.Sidharta SeethanaSidharta Seethana
HDFS-10346Implement asynchronous setPermission/setOwner for DistributedFileSystemMajorhdfs, hdfs-clientXiaobing ZhouXiaobing Zhou
HADOOP-13122Customize User-Agent header sent in HTTP requests by S3A.Minorfs/s3Chris NaurothChris Nauroth
HADOOP-12844Recover when S3A fails on IOException in read()Majorfs/s3Pieter ReusePieter Reuse
HADOOP-13028add low level counter metrics for S3A; use in read performance testsMajorfs/s3, metricsSteve LoughranSteve Loughran
HADOOP-13113Enable parallel test execution for hadoop-aws.MinortestChris NaurothChris Nauroth
HADOOP-13158S3AFileSystem#toString might throw NullPointerException due to null cannedACL.Minorfs/s3Chris NaurothChris Nauroth
YARN-4832NM side resource value should get updated if change applied in RM sideCriticalnodemanager, resourcemanagerJunping DuJunping Du
HADOOP-13140FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemesMajorfsBrahma Reddy BattulaMingliang Liu
HADOOP-13130s3a failures can surface as RTEs, not IOEsMajorfs/s3Steve LoughranSteve Loughran
YARN-3362Add node label usage in RM CapacityScheduler web UIMajorcapacityscheduler, resourcemanager, webappWangda TanNaganarasimha G R
HDFS-10390Implement asynchronous setAcl/getAclStatus for DistributedFileSystemMajorfsXiaobing ZhouXiaobing Zhou
YARN-857Localization failures should be available in container diagnosticsCritical.Hitesh ShahVinod Kumar Vavilapalli
HDFS-8057Move BlockReader implementation to the client implementation packageMajorhdfs-clientTsz Wo Nicholas SzeTakanobu Asanuma
YARN-4957Add getNewReservation in ApplicationClientProtocolMajorapplications, client, resourcemanagerSubru KrishnanSean Po
HDFS-10431Refactor and speedup TestAsyncDFSRenameMinortestXiaobing ZhouXiaobing Zhou
YARN-4987Read cache concurrency issue between read and evict in EntityGroupFS timeline storeCritical.Li LuLi Lu
HDFS-10430Reuse FileSystem#access in TestAsyncDFSMajorhdfsXiaobing ZhouXiaobing Zhou
HADOOP-13162Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirsMinorfs/s3Rajesh BalamohanRajesh Balamohan
HADOOP-13131Add tests to verify that S3A supports SSE-S3 encryptionMinorfs/s3Steve LoughranSteve Loughran
HADOOP-13171Add StorageStatistics to S3A; instrument some more operationsMinorfs/s3Steve LoughranSteve Loughran
YARN-1815Work preserving recovery of Unmanged AMsCriticalresourcemanagerKarthik KambatlaSubru Krishnan
YARN-5165Fix NoOvercommitPolicy to take advantage of RLE representation of planMajorcapacityscheduler, fairscheduler, resourcemanagerCarlo CurinoCarlo Curino
YARN-5185StageAllocaterGreedyRLE: Fix NPE in corner caseMajorcapacityscheduler, fairscheduler, resourcemanagerCarlo CurinoCarlo Curino
YARN-4525Fix bug in RLESparseResourceAllocation.getRangeOverlapping(...)Major.Ishai MenacheIshai Menache
HADOOP-13237s3a initialization against public bucket fails if caller lacks any credentialsMinorfs/s3Steve LoughranChris Nauroth
YARN-5199Close LogReader in in AHSWebServices#getStreamingOutput and FileInputStream in NMWebServices#getLogsMajor.Xuan GongXuan Gong
YARN-3426Add jdiff support to YARNBlocker.Li LuLi Lu
YARN-1942Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc.CriticalapiThomas GravesWangda Tan
HADOOP-13241document s3a betterMinordocumentation, fs/s3Steve LoughranSteve Loughran
HADOOP-13284FileSystemStorageStatistics must not attempt to read non-existent rack-aware read stats in branch-2.8MajorfsMingliang LiuMingliang Liu
HADOOP-12975Add jitter to CachingGetSpaceUsed's threadMajor.Elliott ClarkElliott Clark
HADOOP-13280FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOpsMajorfsMingliang LiuMingliang Liu
HADOOP-13288Guard null stats key in FileSystemStorageStatisticsMajorfsMingliang LiuMingliang Liu
HADOOP-13291Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implementedMajorfsMingliang LiuMingliang Liu
HDFS-10538Remove AsyncDistributedFileSystem APIMajorhdfs-clientXiaobing ZhouXiaobing Zhou
HADOOP-13203S3A: Support fadvise “random” mode for high performance readPositioned() readsMajorfs/s3Rajesh BalamohanRajesh Balamohan
HADOOP-12229Fix inconsistent subsection titles in filesystem.mdMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-12242Add in-page TOC to filesystem specification pagesMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-13305Define common statistics names across schemesMajorfsMingliang LiuMingliang Liu
HADOOP-13283Support reset operation for new global storage statistics and per FS storage statsMajorfsMingliang LiuMingliang Liu
YARN-5080Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AMCriticalyarnSumana SathishXuan Gong
HADOOP-13366Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadocMinordocumentationRakesh RRakesh R
YARN-4484Available Resource calculation for a queue is not correct when used with labelsMajorcapacity schedulerSunil GSunil G
HADOOP-13368DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operationMajorfsMingliang LiuMingliang Liu
HADOOP-13212Provide an option to set the socket buffers in S3AFileSystemMinorfs/s3Rajesh BalamohanRajesh Balamohan
HDFS-10653Optimize conversion from path string to componentsMajorhdfsDaryn SharpDaryn Sharp
HADOOP-13207Specify FileSystem listStatus, listFiles and RemoteIteratorMajordocumentation, fsSteve LoughranSteve Loughran
HADOOP-13188S3A file-create should throw error rather than overwrite directoriesMinorfs/s3Raymie StataSteve Loughran
HDFS-10642TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittentlyMajordatanode, testMingliang LiuMingliang Liu
HDFS-10668TestDataNodeMXBean#testDataNodeMXBeanBlockCount fails intermittentlyMajortestMingliang LiuMingliang Liu
YARN-5434Add -client|server argument for graceful decomBlockergracefulRobert KanterRobert Kanter
HADOOP-13429Dispose of unnecessary SASL serversMajoripcDaryn SharpDaryn Sharp
HADOOP-13426More efficiently build IPC responsesMajor.Daryn SharpDaryn Sharp
HDFS-10656Optimize conversion of byte arrays back to path stringMajorhdfsDaryn SharpDaryn Sharp
HDFS-10674Optimize creating a full path from an inodeMajorhdfsDaryn SharpDaryn Sharp
YARN-5342Improve non-exclusive node partition resource allocation in Capacity SchedulerMajor.Wangda TanSunil G
HADOOP-13438Optimize IPC server protobuf decodingMajor.Daryn SharpDaryn Sharp
HADOOP-13418Fix javadoc warnings by JDK8 in hadoop-nfs packageMajor.Kai SasakiKai Sasaki
HDFS-10724Document the caller context config keysMinoripc, namenodeMingliang LiuMingliang Liu
HDFS-10678Documenting NNThroughputBenchmark toolMajorbenchmarks, testMingliang LiuMingliang Liu
HDFS-10641TestBlockManager#testBlockReportQueueing fails intermittentlyMajornamenode, testMingliang LiuDaryn Sharp
HADOOP-13324s3a tests don't authenticate with S3 frankfurt (or other V4 auth only endpoints)Majorfs/s3Steve LoughranSteve Loughran
HADOOP-13208S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directoriesMinorfs/s3Steve LoughranSteve Loughran
HADOOP-13405doc for “fs.s3a.acl.default” indicates incorrect valuesMinorfs/s3Shen YinjieShen Yinjie
HDFS-10711Optimize FSPermissionChecker group membership checkMajorhdfsDaryn SharpDaryn Sharp
HADOOP-13252Tune S3A provider plugin mechanismMinorfs/s3Steve LoughranSteve Loughran
HADOOP-13446Support running isolated unit tests separate from AWS integration tests.Majorfs/s3Chris NaurothChris Nauroth
HDFS-10762Pass IIP for file status related methodsMajorhdfsDaryn SharpDaryn Sharp
HDFS-10772Reduce byte/string conversions for get listingMajorhdfsDaryn SharpDaryn Sharp
YARN-3940Application moveToQueue should check NodeLabel permissionMajorresourcemanagerBibin A ChundattBibin A Chundatt
HDFS-10768Optimize mkdir opsMajorhdfsDaryn SharpDaryn Sharp
HDFS-10655Fix path related byte array conversion bugsMajorhdfsDaryn SharpDaryn Sharp
HDFS-10662Optimize UTF8 string/byte conversionsMajorhdfsDaryn SharpDaryn Sharp
HADOOP-13547Optimize IPC client protobuf decodingMajor.Daryn SharpDaryn Sharp
HADOOP-13549Eliminate intermediate buffer for server-side PB encodingMajoripcDaryn SharpDaryn Sharp
HADOOP-13447Refactor S3AFileSystem to support introduction of separate metadata repository and tests.Majorfs/s3Chris NaurothChris Nauroth
HADOOP-13541explicitly declare the Joda time version S3A depends onMinorbuild, fs/s3Steve LoughranSteve Loughran
YARN-5566Client-side NM graceful decom is not triggered when jobs finishMajornodemanagerRobert KanterRobert Kanter
HADOOP-10940RPC client does no bounds checking of responsesCriticalipcDaryn SharpDaryn Sharp
HADOOP-13540improve section on troubleshooting s3a auth problemsMinordocumentation, fs/s3Steve LoughranSteve Loughran
HDFS-8818Allow Balancer to run fasterMajorbalancer & moverTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-10673Optimize FSPermissionChecker's internal path usageMajorhdfsDaryn SharpDaryn Sharp
HADOOP-13546Override equals and hashCode to avoid connection leakageMajoripcXiaobing ZhouXiaobing Zhou
HDFS-10744Internally optimize path component resolutionMajorhdfsDaryn SharpDaryn Sharp
HDFS-10805Reduce runtime for append testMinortestGergely NovákGergely Novák
HADOOP-13544JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIsBlocker.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
HDFS-10779Rename does not need to re-solve destinationMajorhdfsDaryn SharpDaryn Sharp
HDFS-10892Add unit tests for HDFS command ‘dfs -tail’ and ‘dfs -stat’Majorfs, shell, testMingliang LiuMingliang Liu
HADOOP-13599s3a close() to be non-synchronized, so avoid risk of deadlock on shutdownMajorfs/s3Steve LoughranSteve Loughran
HADOOP-12974Create a CachingGetSpaceUsed implementation that uses dfMajor.Elliott ClarkElliott Clark
HDFS-10851FSDirStatAndListingOp: stop passing path as stringMajorhdfsDaryn SharpDaryn Sharp
HDFS-10619Cache path in InodesInPathMajorhdfsDaryn SharpDaryn Sharp
HDFS-10934TestDFSShell.testStat fails intermittentlyMajortestEric BadgerEric Badger
HADOOP-13674S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint.Minorfs/s3Chris NaurothChris Nauroth
HDFS-10956Remove rename/delete performance penalty when not using snapshotsMajorhdfsDaryn SharpDaryn Sharp
HDFS-10896Move lock logging logic from FSNamesystem into FSNamesystemLockMajornamenodeErik KrogenErik Krogen
HDFS-10745Directly resolve paths into INodesInPathMajorhdfsDaryn SharpDaryn Sharp
HDFS-10955Pass IIP for FSDirAttr methodsMajorhdfsDaryn SharpDaryn Sharp
HADOOP-12977s3a to handle delete(“/”, true) robustlyMinorfs/s3Steve LoughranSteve Loughran
HDFS-10939Reduce performance penalty of encryption zonesMajorhdfsDaryn SharpDaryn Sharp
HADOOP-13692hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts.Minorfs/s3Chris NaurothChris Nauroth
HDFS-10979Pass IIP for FSDirDeleteOp methodsMajorhdfsDaryn SharpDaryn Sharp
HDFS-10980Optimize check for existence of parent directoryMajorhdfsDaryn SharpDaryn Sharp
HDFS-10988Refactor TestBalancerBandwidthMajorbalancer & mover, testBrahma Reddy BattulaBrahma Reddy Battula
HDFS-10985o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertionsMinorha, testMingliang LiuMingliang Liu
HDFS-10972Add unit test for HDFS command ‘dfsadmin -getDatanodeInfo’Majorfs, shell, testXiaobing ZhouXiaobing Zhou
HDFS-10965Add unit test for HDFS command ‘dfsadmin -printTopology’Majorfs, shell, testXiaobing ZhouXiaobing Zhou
HDFS-11008Change unit test for testing parsing “-source” parameter in Balancer CLIMajortestMingliang LiuMingliang Liu
HADOOP-13419Fix javadoc warnings by JDK8 in hadoop-common packageMajor.Kai SasakiKai Sasaki
HDFS-10922Adding additional unit tests for Trash (II)MajortestXiaoyu YaoWeiwei Yang
HDFS-10906Add unit tests for Trash with HDFS encryption zonesMajorencryptionXiaoyu YaoHanisha Koneru
HADOOP-13735ITestS3AFileContextStatistics.testStatistics() failingMinorfs/s3Steve LoughranPieter Reuse
HDFS-10998Add unit tests for HDFS command ‘dfsadmin -fetchImage’ in HAMajortestXiaobing ZhouXiaobing Zhou
HADOOP-13727S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider.Minorfs/s3Rajesh BalamohanChris Nauroth
HADOOP-12774s3a should use UGI.getCurrentUser.getShortname() for usernameMajorfs/s3Steve LoughranSteve Loughran
HADOOP-13309Document S3A known limitations in file ownership and permission model.Minorfs/s3Chris NaurothChris Nauroth
HDFS-11011Add unit tests for HDFS command ‘dfsadmin -set/clrSpaceQuota’Majorhdfs-clientXiaobing ZhouXiaobing Zhou
HADOOP-13614Purge some superfluous/obsolete S3 FS tests that are slowing test runs downMinorfs/s3, testSteve LoughranSteve Loughran
HADOOP-10597RPC Server signals backoff to clients when all request queues are fullMajor.Ming MaMing Ma
HADOOP-13680fs.s3a.readahead.range to use getLongBytesMajorfs/s3Steve LoughranAbhishek Modi
HDFS-11030TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)Majordatanode, testMingliang LiuMingliang Liu
HDFS-10997Reduce number of path resolving methodsMajornamenodeDaryn SharpDaryn Sharp
HDFS-11065Add space quota tests for heterogenous storagesMajorhdfsXiaobing ZhouXiaobing Zhou
HDFS-11031Add additional unit test for DataNode startup behavior when volumes failMajordatanode, testMingliang LiuMingliang Liu
HADOOP-10300Allowed deferred sending of call responsesMajoripcDaryn SharpDaryn Sharp
HDFS-11076Add unit test for extended AclsMajortestChen LiangChen Liang
HDFS-11085Add unit test for NameNode failing to start when name dir is unwritableMajornamenode, testMingliang LiuXiaobing Zhou
YARN-5802updateApplicationPriority api in scheduler should ensure to re-insert app to correct ordering policyCriticalcapacity schedulerBibin A ChundattBibin A Chundatt
HDFS-11083Add unit test for DFSAdmin -report commandMajorshell, testMingliang LiuXiaobing Zhou
YARN-4498Application level node labels stats to be available in RESTMajorapi, client, resourcemanagerBibin A ChundattBibin A Chundatt
HDFS-11122TestDFSAdmin#testReportCommand fails due to timed outMinortestYiqun LinYiqun Lin
HDFS-10872Add MutableRate metrics for FSNamesystemLock operationsMajornamenodeErik KrogenErik Krogen
HDFS-11105TestRBWBlockInvalidation#testRWRInvalidation fails intermittentlyMajornamenode, testYiqun LinYiqun Lin
HADOOP-13822Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics()MajorfsBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-11601Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty filesMinorfs, testSteve LoughranSteve Loughran
HADOOP-13801regression: ITestS3AMiniYarnCluster failingMajorfs/s3Steve LoughranSteve Loughran
HADOOP-12804Read Proxy Password from Credential Providers in S3 FileSystemMinorfs/s3Larry McCayLarry McCay
HADOOP-13823s3a rename: fail if dest file existsBlockerfs/s3Steve LoughranSteve Loughran
HADOOP-13857S3AUtils.translateException to map (wrapped) InterruptedExceptions to InterruptedIOEsMajorfs/s3Steve LoughranSteve Loughran
HADOOP-13855Fix a couple of the s3a statistic names to be consistent with the restMajorfs/s3Steve LoughranSteve Loughran
HADOOP-13257Improve Azure Data Lake contract tests.Majorfs/adlChris NaurothVishwajeet Dusane
YARN-4390Do surgical preemption based on reserved container in CapacitySchedulerMajorcapacity schedulerEric PayneWangda Tan
HDFS-8630WebHDFS : Support get/set/unset StoragePolicyMajorwebhdfsnijelSurendra Singh Lilhore
HADOOP-13871ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awfulMajorfs/s3Steve LoughranSteve Loughran
YARN-2009CapacityScheduler: Add intra-queue preemption for app priority supportMajorcapacityschedulerDevaraj KSunil G
YARN-4844Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.ResourceBlockerapiWangda TanWangda Tan
YARN-4990Re-direction of a particular log file within in a container in NM UI does not redirect properly to Log Server ( history ) on container completionMajor.Hitesh ShahXuan Gong
YARN-3866AM-RM protocol changes to support container resizingBlockerapiMENG DINGMENG DING
HADOOP-13336S3A to support per-bucket configurationMajorfs/s3Steve LoughranSteve Loughran
HDFS-8377Support HTTP/2 in datanodeMajor.Duo ZhangDuo Zhang
HADOOP-14019fix some typos in the s3a docsMinordocumentation, fs/s3Steve LoughranSteve Loughran
HADOOP-14081S3A: Consider avoiding array copy in S3ABlockOutputStream (ByteArrayBlock)Minorfs/s3Rajesh BalamohanRajesh Balamohan
YARN-6143Fix incompatible issue caused by YARN-3583Blockerrolling upgradeWangda TanSunil G
HADOOP-14113review ADL DocsMinordocumentation, fs/adlSteve LoughranSteve Loughran
HADOOP-14138Remove S3A ref from META-INF service discovery, rely on existing core-default entryCriticalfs/s3Steve LoughranSteve Loughran
HADOOP-14123Remove misplaced ADL service provider config file for FileSystemMinorfs/adlJohn ZhugeJohn Zhuge
HADOOP-14153ADL module has messed doc structureMajorfs/adlMingliang LiuMingliang Liu
HADOOP-14173Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCETrivialfs/adlJohn ZhugeJohn Zhuge

OTHER:

JIRASummaryPriorityComponentReporterContributor
YARN-3357Move TestFifoScheduler to FIFO packageMajorscheduler, testRohith Sharma K SRohith Sharma K S
HADOOP-11814Reformat hadoop-annotations, o.a.h.classification.toolsMinor.Li LuLi Lu
MAPREDUCE-6388Remove deprecation warnings from JobHistoryServer classesMinorjobhistoryserverRay ChiangRay Chiang
YARN-3026Move application-specific container allocation logic from LeafQueue to FiCaSchedulerAppMajorcapacityschedulerWangda TanWangda Tan
HDFS-8938Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManagerMajor.Mingliang LiuMingliang Liu
HDFS-9027Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() methodMajor.Mingliang LiuMingliang Liu
MAPREDUCE-6477Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystemMajor.Mingliang LiuMingliang Liu
MAPREDUCE-6483Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentialsMajortestMingliang LiuMingliang Liu
HDFS-9130Use GenericTestUtils#setLogLevel to the logging levelMajor.Mingliang LiuMingliang Liu
HADOOP-12446Undeprecate createNonRecursive()Major.Ted YuTed Yu
HDFS-8979Clean up checkstyle warnings in hadoop-hdfs-client moduleMajor.Mingliang LiuMingliang Liu
HADOOP-11791Update src/site/markdown/releases to include old versions of HadoopMajorbuild, documentationAllen WittenauerAllen Wittenauer
HADOOP-12514Make static fields in GenericTestUtils for assertExceptionContains() package-private and finalMinortestMingliang LiuMingliang Liu
HDFS-9377Fix findbugs warnings in FSDirSnapshotOpMajornamenodeMingliang LiuMingliang Liu
HADOOP-12567NPE in SaslRpcServerMajor.Sergey ShelukhinSergey Shelukhin
YARN-4653Document YARN security model from the perspective of Application DevelopersMajorsiteSteve LoughranSteve Loughran
HDFS-10200Docs for WebHDFS still describe GETDELEGATIONTOKENS operationTrivialdocumentationWellington ChevreuilWellington Chevreuil
HDFS-9353Code and comment mismatch in JavaKeyStoreProviderTrivial.nijelAndras Bokor
HDFS-10984Expose nntop output as metricsMajornamenodeSiddharth WagleSiddharth Wagle
YARN-5704Provide config knobs to control enabling/disabling new/work in progress features in container-executorMajoryarnSidharta SeethanaSidharta Seethana
HADOOP-14091AbstractFileSystem implementaion for ‘wasbs’ schemeMajorfs/azureVarada HemeswariVarada Hemeswari
YARN-6274Documentation refers to incorrect nodemanager health checker interval propertyTrivialdocumentationCharles ZhangWeiwei Yang