Apache Hadoop Changelog

Release 2.7.0 - 2015-04-20

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-11498Bump the version of HTrace to 3.1.0-incubatingMajortracingMasatake IwasakiMasatake Iwasaki
HADOOP-11492Bump up curator version to 2.7.1Major.Karthik KambatlaArun Suresh
HADOOP-11385Prevent cross site scripting attack on JMXJSONServletCritical.Haohui MaiHaohui Mai
HADOOP-11311Restrict uppercase key names from being created with JCEKSMajorsecurityAndrew WangAndrew Wang
HADOOP-10530Make hadoop trunk build on Java7+ onlyBlockerbuildSteve LoughranSteve Loughran
HDFS-7210Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClientMajorhdfs-client, namenodeVinayakumar BVinayakumar B
HDFS-6651Deletion failure can leak inodes permanentlyCritical.Kihwal LeeJing Zhao
HDFS-6252Phase out the old web UI in HDFSMinornamenodeFengdong YuHaohui Mai
YARN-3217Remove httpclient dependency from hadoop-yarn-server-web-proxyMajor.Akira AJISAKABrahma Reddy Battula
YARN-3154Should not upload partial logs for MR jobs or other "short-running' applicationsBlockernodemanager, resourcemanagerXuan GongXuan Gong

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-11510Expose truncate API via FileContextMajorfsYi LiuYi Liu
HADOOP-11490Expose truncate API via FileSystem and shell commandMajorfsKonstantin ShvachkoMilan Desai
HADOOP-11341KMS support for whitelist key ACLsMajorkms, securityArun SureshArun Suresh
HADOOP-10728Metrics system for Windows Azure Storage FilesystemMajortoolsMike LiddellMike Liddell
HADOOP-9629Support Windows Azure Storage - Blob as a file system in HadoopMajortoolsMostafa ElhemaliChris Nauroth
HADOOP-8989hadoop fs -find featureMajor.Marco NicosiaJonathan Allen
HADOOP-7984Add hadoop --loglevel option to change log levelMinorscriptsEli CollinsAkira AJISAKA
HDFS-7584Enable Quota Support for Storage TypesMajordatanode, namenodeXiaoyu YaoXiaoyu Yao
HDFS-7449Add metrics to NFS gatewayMajornfsBrandon LiBrandon Li
HDFS-7424Add web UI for NFS gatewayMajornfsBrandon LiBrandon Li
HDFS-7222Expose DataNode network errors as a metricMinordatanodeCharles LambCharles Lamb
HDFS-6982nntop: top­-like tool for name node usersMajor.Maysam YabandehMaysam Yabandeh
HDFS-6826Plugin interface to enable delegation of HDFS authorization assertionsMajorsecurityAlejandro AbdelnurArun Suresh
HDFS-6663Admin command to track file and locations from block idMajor.Kihwal LeeChen He
HDFS-6488Support HDFS superuser in NFSv3 gatewayMajornfsStephen ChuBrandon Li
HDFS-3689Add support for variable length blockMajordatanode, hdfs-client, namenodeSuresh SrinivasJing Zhao
HDFS-3107HDFS truncateMajordatanode, namenodeLei ChangPlamen Jeliazkov
HDFS-1362Provide volume management functionality for DataNodeMajordatanodeWang XuWang Xu
MAPREDUCE-6228Add truncate operation to SLiveMajorbenchmarks, testKonstantin ShvachkoPlamen Jeliazkov
MAPREDUCE-6227DFSIO for truncateMajorbenchmarks, testKonstantin ShvachkoKonstantin Shvachko
YARN-2837Timeline server needs to recover the timeline DT when restartingBlockertimelineserverZhijie ShenZhijie Shen
YARN-2574Add support for FairScheduler to the ReservationSystemMajorfairschedulerSubru KrishnanAnubhav Dhoot
YARN-2427Add support for moving apps between queues in RM web servicesMajorresourcemanagerVarun VasudevVarun Vasudev
YARN-2360Fair Scheduler: Display dynamic fair share for queues on the scheduler pageMajorfairschedulerAshwin ShankarAshwin Shankar
YARN-2190Add CPU and memory limit options to the default container executor for Windows containersMajornodemanagerChuan LiuChuan Liu

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-11801Update BUILDING.txt for UbuntuMinordocumentationGabor LiptakGabor Liptak
HADOOP-11714Add more trace log4j messages to SpanReceiverHostMinortracingColin Patrick McCabeColin Patrick McCabe
HADOOP-11658Externalize io.compression.codecs propertyMinor.Kai ZhengKai Zheng
HADOOP-11648Set DomainSocketWatcher thread name explicitlyMajornetLiang XieLiang Xie
HADOOP-11642Upgrade azure sdk version from 0.6.0 to 2.0.0Majortoolsshashankshashank
HADOOP-11633Convert remaining branch-2 .apt.vm files to markdownMajordocumentationColin Patrick McCabeMasatake Iwasaki
HADOOP-11632Cleanup Find.java to remove SupressWarnings annotationsMinor.Akira AJISAKAAkira AJISAKA
HADOOP-11620Add support for load balancing across a group of KMS for HAMajorkmsArun SureshArun Suresh
HADOOP-11607Reduce log spew in S3AFileSystemTrivialfs/s3Lei (Eddy) XuLei (Eddy) Xu
HADOOP-11599Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured.Minoripczhihai xuzhihai xu
HADOOP-11589NetUtils.createSocketAddr should trim the input URIMinornetAkira AJISAKARakesh R
HADOOP-11586Update use of Iterator to Iterable in AbstractMetricsContext.javaMinormetricsRay ChiangRay Chiang
HADOOP-11579Documentation for truncateMajordocumentationSteve LoughranKonstantin Shvachko
HADOOP-11569Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFileMajor.Vinayakumar BVinayakumar B
HADOOP-11544Remove unused configuration keys for tracingTrivial.Masatake IwasakiMasatake Iwasaki
HADOOP-11543Improve help message for hadoop/yarn commandTrivialscriptsJagadesh Kiran NBrahma Reddy Battula
HADOOP-11520Clean incomplete multi-part uploads in S3A testsMinorfs/s3Thomas DemoorThomas Demoor
HADOOP-11506Configuration variable expansion regex expensive for long valuesMajorconfDmitriy V. RyaboyGera Shegalov
HADOOP-11495Convert site documentation from apt to markdownMajordocumentationAllen WittenauerMasatake Iwasaki
HADOOP-11483HardLink.java should use the jdk7 createLink methodMajor.Colin Patrick McCabeAkira AJISAKA
HADOOP-11481ClassCastException while using a key created by keytool to create encryption zone.Minor.Yi YaoCharles Lamb
HADOOP-11464Reinstate support for launching Hadoop processes on Windows using Cygwin.MajorbinChris NaurothChris Nauroth
HADOOP-11455KMS and Credential CLI should request confirmation for deletion by defaultMinorsecurityCharles LambCharles Lamb
HADOOP-11448Fix findbugs warnings in FileBasedIPListMinor.Akira AJISAKATsuyoshi Ozawa
HADOOP-11442hadoop-azure: Create test jarMajortoolsshashankshashank
HADOOP-11441Hadoop-azure: Change few methods scope to publicMinortoolsshashankshashank
HADOOP-11440Use “test.build.data” instead of “build.test.dir” for testing in ClientBaseWithFixesMinor.Akira AJISAKAKengo Seki
HADOOP-11430Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevelMajor.Colin Patrick McCabeColin Patrick McCabe
HADOOP-11427ChunkedArrayList: fix removal via iterator and implement getMajor.Colin Patrick McCabeColin Patrick McCabe
HADOOP-11422Check CryptoCodec is AES-CTR for Crypto input/output streamMinor.Yi LiuYi Liu
HADOOP-11421Add IOUtils#listDirectoryMajor.Colin Patrick McCabeColin Patrick McCabe
HADOOP-11419improve hadoop-maven-pluginsMinorbuildHervé BoutemyHervé Boutemy
HADOOP-11416Move ChunkedArrayList into hadoop-commonMajor.Colin Patrick McCabeColin Patrick McCabe
HADOOP-11410make the rpath of libhadoop.so configurableMajor.Colin Patrick McCabeColin Patrick McCabe
HADOOP-11399Java Configuration file and .xml files should be automatically cross-comparedMinor.Ray ChiangRay Chiang
HADOOP-11396Provide navigation in the site documentation linking to the Hadoop Compatible File Systems.MajordocumentationChris NaurothChris Nauroth
HADOOP-11395Add site documentation for Azure Storage FileSystem integration.MajordocumentationChris NaurothChris Nauroth
HADOOP-11390Metrics 2 ganglia provider to include hostname in unresolved address problemsMinormetricsSteve LoughranVarun Saxena
HADOOP-11323WritableComparator#compare keeps reference to byte arrayMajorperformanceWilfred SpiegelenburgWilfred Spiegelenburg
HADOOP-11313Adding a document about NativeLibraryCheckerMajordocumentationTsuyoshi OzawaTsuyoshi Ozawa
HADOOP-11301[optionally] update jmx cache to drop old metricsMajor.Maysam YabandehMaysam Yabandeh
HADOOP-11291Log the cause of SASL connection failuresMinorsecurityStephen ChuStephen Chu
HADOOP-11261Set custom endpoint for S3AMajorfs/s3Thomas DemoorThomas Demoor
HADOOP-11257Update “hadoop jar” documentation to warn against using it for launching yarn jarsBlocker.Allen WittenauerMasatake Iwasaki
HADOOP-11231Remove dead code in ServletUtilMinor.Haohui MaiLi Lu
HADOOP-11188hadoop-azure: automatically expand page blobs when they become fullMajorfsEric HansonEric Hanson
HADOOP-11173Improve error messages for some KeyShell commandsMinor.Andrew WangAndrew Wang
HADOOP-11172Improve error message in Shell#runCommand on OutOfMemoryErrorMajor.Yongjun ZhangYongjun Zhang
HADOOP-11171Enable using a proxy server to connect to S3a.Majorfs/s3Thomas DemoorThomas Demoor
HADOOP-11045Introducing a tool to detect flaky tests of hadoop jenkins test jobMajorbuild, toolsYongjun ZhangYongjun Zhang
HADOOP-11032Replace use of Guava‘s Stopwatch with Hadoop’s StopWatchMajor.Gary SteelmanTsuyoshi Ozawa
HADOOP-10987Provide an iterator-based listing API for FileSystemMajor.Kihwal LeeKihwal Lee
HADOOP-10976moving the source code of hadoop-tools docs to the directory under hadoop-toolsMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-10847Remove the usage of sun.security.x509.* in testing codeMinorsecurityKai Zhengpascal oliva
HADOOP-10809hadoop-azure: page blob supportMajortoolsMike LiddellEric Hanson
HADOOP-10670Allow AuthenticationFilters to load secret from signature secret filesMinorsecurityKai ZhengKai Zheng
HADOOP-10626Limit Returning Attributes for LDAP searchMajorsecurityJason HubbardJason Hubbard
HADOOP-10563Remove the dependency of jsp in trunkMajor.Haohui MaiHaohui Mai
HADOOP-10525Remove DRFA.MaxBackupIndex config from log4j.propertiesMinor.Akira AJISAKAAkira AJISAKA
HADOOP-10140Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmdMinorscriptsIan JacksonKiran Kumar M R
HADOOP-9992Modify the NN loadGenerator to optionally run as a MapReduce jobMajortestAkshay RadiaAkshay Radia
HADOOP-9869Configuration.getSocketAddr()/getEnum() should use getTrimmed()MinorconfSteve LoughranTsuyoshi Ozawa
HADOOP-8757Metrics should disallow names with invalid charactersMinormetricsTodd LipconRay Chiang
HADOOP-8059Add javadoc to InterfaceAudience and InterfaceStabilityMajordocumentationSuresh SrinivasBrandon Li
HADOOP-4297Enable Java assertions when running testsMajorbuildYoram KulbakTsz Wo Nicholas Sze
HDFS-8071Redundant checkFileProgress() in PART II of getAdditionalBlock()Major.Konstantin ShvachkoKonstantin Shvachko
HDFS-7976Update NFS user guide for mount option “sync” to minimize or avoid reordered writesMajordocumentation, nfsBrandon LiBrandon Li
HDFS-7962Remove duplicated logs in BlockManagerMinor.Yi LiuYi Liu
HDFS-7917Use file to replace data dirs in test to simulate a disk failure.MinortestLei (Eddy) XuLei (Eddy) Xu
HDFS-7898Change TestAppendSnapshotTruncate to fail-fastMinortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-7849Update documentation for enabling a new feature in rolling upgradeMinordocumentationTsz Wo Nicholas SzeJ.Andreina
HDFS-7832Show ‘Last Modified’ in Namenode's ‘Browse Filesystem’MajornamenodeVinayakumar BVinayakumar B
HDFS-7797Add audit log for setQuota operationMajornamenodeRakesh RRakesh R
HDFS-7795Show warning if not all favored nodes were chosen by namenodeMinor.Kihwal LeeKihwal Lee
HDFS-7790Do not create optional fields in DFSInputStream unless they are neededMinorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-7789DFSck should resolve the path to support cross-FS symlinksMajortoolsGera ShegalovGera Shegalov
HDFS-7780Update use of Iterator to Iterable in DataXceiverServer and SnapshotDiffInfoMinor.Ray ChiangRay Chiang
HDFS-7773Additional metrics in HDFS to be accessed via jmx.Majordatanode, namenodeAnu EngineerAnu Engineer
HDFS-7772Document hdfs balancer -exclude/-include option in HDFSCommands.htmlTrivialdocumentationXiaoyu YaoXiaoyu Yao
HDFS-7771fuse_dfs should permit FILE: on the front of KRB5CCNAMEMajor.Colin Patrick McCabeColin Patrick McCabe
HDFS-7761cleanup unnecssary code logic in LocatedBlockMinor.Yi LiuYi Liu
HDFS-7757Misleading error messages in FSImage.javaMajornamenodeArpit AgarwalBrahma Reddy Battula
HDFS-7752Improve description for “dfs.namenode.num.extra.edits.retained” and “dfs.namenode.num.checkpoints.retained” properties on hdfs-default.xmlMinordocumentationWellington ChevreuilWellington Chevreuil
HDFS-7743Code cleanup of BlockInfo and rename BlockInfo to BlockInfoContiguousMinornamenodeJing ZhaoJing Zhao
HDFS-7732Fix the order of the parameters in DFSConfigKeysTrivial.Akira AJISAKABrahma Reddy Battula
HDFS-7710Remove dead code in BackupImage.javaMinor.Xiaoyu YaoXiaoyu Yao
HDFS-7706Switch BlockManager logging to use slf4jMinornamenodeAndrew WangAndrew Wang
HDFS-7703Support favouredNodes for the append for new blocksMajor.Vinayakumar BVinayakumar B
HDFS-7694FSDataInputStream should support “unbuffer”Major.Colin Patrick McCabeColin Patrick McCabe
HDFS-7685Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xmlMinordocumentationFrank LanitzKai Sasaki
HDFS-7684The host:port settings of the daemons should be trimmed before useMajor.Tianyin XuAnu Engineer
HDFS-7683Combine usages and percent stats in NameNode UIMinornamenodeVinayakumar BVinayakumar B
HDFS-7675Remove unused member DFSClient#spanReceiverHostTrivialhdfs-clientKonstantin ShvachkoColin Patrick McCabe
HDFS-7668Convert site documentation from apt to markdownMajordocumentationAllen WittenauerMasatake Iwasaki
HDFS-7640print NFS Client in the NFS logTrivialnfsBrandon LiBrandon Li
HDFS-7604Track and display failed DataNode storage locations in NameNode.Majordatanode, namenodeChris NaurothChris Nauroth
HDFS-7600Refine hdfs admin classes to reuse common codeMajortoolsYi LiuJing Zhao
HDFS-7598Remove dependency on old version of Guava in TestDFSClientCache#testEvictionMinortestSangjin LeeSangjin Lee
HDFS-7591hdfs classpath command should support same options as hadoop classpath.MinorscriptsChris NaurothVarun Saxena
HDFS-7579Improve log reporting during block report rpc failureMinordatanodeCharles LambCharles Lamb
HDFS-7564NFS gateway dynamically reload UID/GID mapping file /etc/nfs.mapMinornfsHari SekhonYongjun Zhang
HDFS-7557Fix spacing for a few keys in DFSConfigKeys.javaMinor.Colin Patrick McCabeColin Patrick McCabe
HDFS-7555Remove the support of unmanaged connectors in HttpServer2Major.Haohui MaiHaohui Mai
HDFS-7537fsck is confusing when dfs.namenode.replication.min > 1 && missing replicas && NN restartMajornamenodeAllen WittenauerGAO Rui
HDFS-7535Utilize Snapshot diff report for distcpMajordistcp, snapshotsJing ZhaoJing Zhao
HDFS-7531Improve the concurrent access on FsVolumeListMajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-7513HDFS inotify: add defaultBlockSize to CreateEventMajornamenodeColin Patrick McCabeColin Patrick McCabe
HDFS-7491Add incremental blockreport latency to DN metricsMinordatanodeMing MaMing Ma
HDFS-7484Make FSDirectory#addINode take existing INodes as its parameterMajor.Haohui MaiJing Zhao
HDFS-7478Move org.apache.hadoop.hdfs.server.namenode.NNConf to FSNamesystemMajor.Li LuLi Lu
HDFS-7463Simplify FSNamesystem#getBlockLocationsUpdateTimesMajor.Haohui MaiHaohui Mai
HDFS-7458Add description to the nfs ports in core-site.xml used by nfs test to avoid confusionMinornfs, testYongjun ZhangYongjun Zhang
HDFS-7454Reduce memory footprint for AclEntries in NameNodeMajornamenodeVinayakumar BVinayakumar B
HDFS-7446HDFS inotify should have the ability to determine what txid it has read up toMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-7439Add BlockOpResponseProto‘s message to DFSClient’s exception messageMinorbalancer & mover, datanode, hdfs-clientMing MaTakanobu Asanuma
HDFS-7435PB encoding of block reports is very inefficientCriticaldatanode, namenodeDaryn SharpDaryn Sharp
HDFS-7434DatanodeID hashCode should not be mutableMajornamenodeDaryn SharpDaryn Sharp
HDFS-7430Rewrite the BlockScanner to use O(1) memory and use multiple threadsMajor.Colin Patrick McCabeColin Patrick McCabe
HDFS-7426Change nntop JMX format to be a JSON blobMajornamenodeAndrew WangAndrew Wang
HDFS-7419Improve error messages for DataNode hot swap drive featureMajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-7411Refactor and improve decommissioning logic into DecommissionManagerMajor.Andrew WangAndrew Wang
HDFS-7410Support CreateFlags with append() to support hsync() for appending streamsMajorhdfs-clientVinayakumar BVinayakumar B
HDFS-7409Allow dead nodes to finish decommissioning if all files are fully replicatedMinor.Andrew WangAndrew Wang
HDFS-7404Remove o.a.h.hdfs.server.datanode.web.resourcesMajor.Haohui MaiLi Lu
HDFS-7398Reset cached thread-local FSEditLogOp's on every FSEditLog#logEditMajornamenodeGera ShegalovGera Shegalov
HDFS-7386Replace check “port number < 1024” with shared isPrivilegedPort methodTrivialdatanode, securityYongjun ZhangYongjun Zhang
HDFS-7384‘getfacl’ command and ‘getAclStatus’ output should be in syncMajornamenodeVinayakumar BVinayakumar B
HDFS-7381Decouple the management of block id and gen stamps from FSNamesystemMajor.Haohui MaiHaohui Mai
HDFS-7375Move FSClusterStats to o.a.h.h.hdfs.server.blockmanagementMajor.Haohui MaiHaohui Mai
HDFS-7365Remove hdfs.server.blockmanagement.MutableBlockCollectionMinor.Li LuLi Lu
HDFS-7357FSNamesystem.checkFileProgress should log file pathMinornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-7356Use DirectoryListing.hasMore() directly in nfsMinornfsHaohui MaiLi Lu
HDFS-7336Unused member DFSInputStream.buffersizeMajorhdfs-clientKonstantin ShvachkoMilan Desai
HDFS-7335Redundant checkOperation() in FSN.analyzeFileState()MajornamenodeKonstantin ShvachkoMilan Desai
HDFS-7333Improve log message in Storage.tryLock()Majordatanode, namenodeKonstantin ShvachkoKonstantin Shvachko
HDFS-7331Add Datanode network counts to datanode jmx pageMinordatanodeCharles LambCharles Lamb
HDFS-7329MiniDFSCluster should log the exception when createNameNodesAndSetConf() fails.MajortestKonstantin ShvachkoByron Wong
HDFS-7326Add documentation for hdfs debug commandsMinordocumentationColin Patrick McCabeVijay Bhat
HDFS-7323Move the get/setStoragePolicy commands out from dfsadminMajorhdfs-clientTsz Wo Nicholas SzeJing Zhao
HDFS-7308DFSClient write packet size may > 64kBMinorhdfs-clientTsz Wo Nicholas SzeTakuya Fukudome
HDFS-7283Bump DataNode OOM log from WARN to ERRORTrivialdatanodeStephen ChuStephen Chu
HDFS-7280Use netty 4 in WebImageViewerMajor.Haohui MaiHaohui Mai
HDFS-7279Use netty to implement DatanodeWebHdfsMethodsMajordatanode, webhdfsHaohui MaiHaohui Mai
HDFS-7278Add a command that allows sysadmins to manually trigger full block reports from a DNMajordatanodeColin Patrick McCabeColin Patrick McCabe
HDFS-7270Add congestion signaling capability to DataNode write protocolMajordatanodeHaohui MaiHaohui Mai
HDFS-7266HDFS Peercache enabled check should not lock on objectMinorhdfs-clientGopal VAndrew Wang
HDFS-7257Add the time of last HA state transition to NN's /jmx pageMinornamenodeCharles LambCharles Lamb
HDFS-7252small refinement to the use of isInAnEZ in FSNamesystemTrivial.Yi LiuYi Liu
HDFS-7242Code improvement for FSN#checkUnreadableBySuperuserMinornamenodeYi LiuYi Liu
HDFS-7223Tracing span description of IPC client is too longMinor.Masatake IwasakiMasatake Iwasaki
HDFS-7190Bad use of Preconditions in startFileInternal()MajornamenodeKonstantin ShvachkoDawson Choong
HDFS-7186Document the “hadoop trace” command.MinordocumentationMasatake IwasakiMasatake Iwasaki
HDFS-7182JMX metrics aren't accessible when NN is busyMajor.Ming MaMing Ma
HDFS-7165Separate block metrics for files with replication count 1MajornamenodeAndrew WangZhe Zhang
HDFS-7026Introduce a string constant for “Failed to obtain user group info...”Trivial.Yongjun ZhangYongjun Zhang
HDFS-6806HDFS Rolling upgrade document should mention the versions availableMinordocumentationAkira AJISAKAJ.Andreina
HDFS-6741Improve permission denied message when FSPermissionChecker#checkOwner failsTrivial.Stephen ChuHarsh J
HDFS-6735A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStreamMajorhdfs-clientLiang XieLars Hofhansl
HDFS-6565Use jackson instead jetty json in hdfs-clientMajor.Haohui MaiAkira AJISAKA
HDFS-6133Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover.Majorbalancer & mover, datanodezhaoyunjiongzhaoyunjiong
HDFS-5853Add “hadoop.user.group.metrics.percentiles.intervals” to hdfs-default.xmlMinordocumentation, namenodeAkira AJISAKAAkira AJISAKA
HDFS-3342SocketTimeoutException in BlockSender.sendChunks could have a better error messageMinordatanodeTodd LipconYongjun Zhang
HDFS-2219Fsck should work with fully qualified file paths.MinortoolsJitendra Nath PandeyTsz Wo Nicholas Sze
HDFS-316Balancer should run for a configurable # of iterationsMinorbalancer & moverBrian BockelmanXiaoyu Yao
MAPREDUCE-6292Use org.junit package instead of junit.framework in TestCombineFileInputFormatMinortestAkira AJISAKAAkira AJISAKA
MAPREDUCE-6267Refactor JobSubmitter#copyAndConfigureFiles into it's own classMinor.Chris TrezzoChris Trezzo
MAPREDUCE-6265Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containersMajormrv2zhihai xuzhihai xu
MAPREDUCE-6256Removed unused private methods in o.a.h.mapreduce.Job.javaMinor.Devaraj KNaganarasimha G R
MAPREDUCE-6255Fix JobCounter's format to use grouping separatorMinorclientRyu KobayashiRyu Kobayashi
MAPREDUCE-6253Update use of Iterator to IterableMinor.Ray ChiangRay Chiang
MAPREDUCE-6248Allow users to get the MR job information for distcpMajordistcpJing ZhaoJing Zhao
MAPREDUCE-6194Bubble up final exception in failures during creation of output collectorsMinortaskHarsh JVarun Saxena
MAPREDUCE-6173Document the configuration of deploying MR over distributed cache with enabling wired encryption at the same timeMajordistributed-cache, documentationJunping DuJunping Du
MAPREDUCE-6169MergeQueue should release reference to the current item from key and value at the end of the iteration to save memory.Majormrv2zhihai xuzhihai xu
MAPREDUCE-6151Update document of GridMixMinordocumentationMasatake IwasakiMasatake Iwasaki
MAPREDUCE-6150Update document of RumenMinordocumentationMasatake IwasakiMasatake Iwasaki
MAPREDUCE-6149Document override log4j.properties in MR jobMajordocumentationJunping DuJunping Du
MAPREDUCE-6143add configuration for mapreduce speculative execution in MR2Majormrv2zhihai xuzhihai xu
MAPREDUCE-6141History server leveldb recovery storeMajorjobhistoryserverJason LoweJason Lowe
MAPREDUCE-6059Speed up history server startup timeMajor.Siqi LiSiqi Li
MAPREDUCE-6046Change the class name for logs in RMCommunicator.javaMinormr-amDevaraj KSahil Takiar
MAPREDUCE-5932Provide an option to use a dedicated reduce-side shuffle logMajormrv2Gera ShegalovGera Shegalov
MAPREDUCE-5800Use Job#getInstance instead of deprecated constructorsMinor.Akira AJISAKAAkira AJISAKA
MAPREDUCE-5612Add javadoc for TaskCompletionEvent.StatusMinordocumentationSandy RyzaChris Palmer
MAPREDUCE-5583Ability to limit running map and reduce tasksMajormr-am, mrv2Jason LoweJason Lowe
MAPREDUCE-5335Rename Job Tracker terminology in ShuffleSchedulerImplMajorapplicationmasterDevaraj KDevaraj K
MAPREDUCE-4815Speed up FileOutputCommitter#commitJob for many output filesMajormrv2Jason LoweSiqi Li
MAPREDUCE-4431mapred command should print the reason on killing already completed jobsMinormrv2Nishan ShettyDevaraj K
YARN-3349Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetryMinortestzhihai xuzhihai xu
YARN-3285Convert branch-2 .apt.vm files of YARN to markdownMajordocumentationMasatake IwasakiMasatake Iwasaki
YARN-3273Improve web UI to facilitate scheduling analysis and debuggingMajor.Jian HeRohith Sharma K S
YARN-3272Surface container locality info in RM web UIMajor.Jian HeJian He
YARN-3262Surface application outstanding resource requests table in RM web UIMajoryarnJian HeJian He
YARN-3249Add a “kill application” button to Resource Manager's Web UIMinorresourcemanagerRyu KobayashiRyu Kobayashi
YARN-3236cleanup RMAuthenticationFilter#AUTH_HANDLER_PROPERTY.Trivialresourcemanagerzhihai xuzhihai xu
YARN-3230Clarify application states on the web UIMajor.Jian HeJian He
YARN-3203Correct a log message in AuxServicesMinor.Brahma Reddy BattulaBrahma Reddy Battula
YARN-3195Add -help to yarn logs and nodes CLI commandMinorclientJagadesh Kiran NJagadesh Kiran N
YARN-3187Documentation of Capacity Scheduler Queue mapping based on user or groupMajorcapacityscheduler, documentationNaganarasimha G RGururaj Shetty
YARN-3182Cleanup switch statement in ApplicationMasterLauncher#handle()Minor.Ray ChiangRay Chiang
YARN-3179Update use of Iterator to IterableMinor.Ray ChiangRay Chiang
YARN-3158Correct log messages in ResourceTrackerServiceMajor.Devaraj KVarun Saxena
YARN-3157Refactor the exception handling in ConverterUtils#to*IdMinorresourcemanagerBibin A ChundattBibin A Chundatt
YARN-3147Clean up RM web proxy codeMajorwebappSteve LoughranSteve Loughran
YARN-3144Configuration for making delegation token failures to timeline server not-fatalMajor.Jonathan EaglesJonathan Eagles
YARN-3123Make YARN CLI show a single completed container even if the app is runningMajorclientZhijie ShenNaganarasimha G R
YARN-3108ApplicationHistoryServer doesn't process -D argumentsMajor.Chang LiChang Li
YARN-3100Make YARN authorization pluggableMajor.Jian HeJian He
YARN-3086Make NodeManager memory configurable in MiniYARNClusterMinortestRobert MetzgerRobert Metzger
YARN-3085Application summary should include the application typeMajorresourcemanagerJason LoweRohith Sharma K S
YARN-3077RM should create yarn.resourcemanager.zk-state-store.parent-path recursivelyMajorresourcemanagerChun ChenChun Chen
YARN-3056add verification for containerLaunchDuration in TestNodeManagerMetrics.Trivialtestzhihai xuzhihai xu
YARN-3022Expose Container resource information from NodeManager for monitoringMajor.Anubhav DhootAnubhav Dhoot
YARN-3005[JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.javaTrivial.Akira AJISAKAKengo Seki
YARN-2996Refine fs operations in FileSystemRMStateStore and few fixesMajorresourcemanagerYi LiuYi Liu
YARN-2957Create unit test to automatically compare YarnConfiguration and yarn-default.xmlMinor.Ray ChiangRay Chiang
YARN-2950Change message to mandate, not suggest JS requirement on UIMinorwebappHarsh JDustin Cote
YARN-2940Fix new findbugs warnings in rest of the hadoop-yarn componentsMajor.Varun SaxenaLi Lu
YARN-2939Fix new findbugs warnings in hadoop-yarn-commonMajor.Varun SaxenaLi Lu
YARN-2938Fix new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryserviceMajor.Varun SaxenaVarun Saxena
YARN-2937Fix new findbugs warnings in hadoop-yarn-nodemanagerMajor.Varun SaxenaVarun Saxena
YARN-2891Failed Container Executor does not provide a clear error messageMinornodemanagerDustin CoteDustin Cote
YARN-2878Fix DockerContainerExecutor.apt.vm formattingMajordocumentationAbin ShahabAbin Shahab
YARN-2854The document about timeline service and generic service needs to be updatedCriticaltimelineserverZhijie ShenNaganarasimha G R
YARN-2820Retry in FileSystemRMStateStore when FS's operations fail due to IOException.Majorresourcemanagerzhihai xuzhihai xu
YARN-2802ClusterMetrics to include AM launch and register delaysMajorresourcemanagerzhihai xuzhihai xu
YARN-2799cleanup TestLogAggregationService based on the change in YARN-90Minortestzhihai xuzhihai xu
YARN-2797TestWorkPreservingRMRestart should use ParametrizedSchedulerTestBaseMinor.Karthik KambatlaKarthik Kambatla
YARN-2780Log aggregated resource allocation in rm-appsummary.logMinorresourcemanagerKoji NoguchiEric Payne
YARN-2777Mark the end of individual log in aggregated logMajor.Ted YuVarun Saxena
YARN-2679Add metric for container launch durationMajornodemanagerzhihai xuzhihai xu
YARN-2669FairScheduler: queue names shouldn't allow periodsMajor.Wei YanWei Yan
YARN-2643Don't create a new DominantResourceCalculator on every FairScheduler.allocate callTrivial.Sandy RyzaKarthik Kambatla
YARN-2641Decommission nodes on -refreshNodes instead of next NM-RM heartbeatMajorresourcemanagerzhihai xuzhihai xu
YARN-2604Scheduler should consider max-allocation-* in conjunction with the largest nodeMajorschedulerKarthik KambatlaRobert Kanter
YARN-2301Improve yarn container commandMajor.Jian HeNaganarasimha G R
YARN-2254TestRMWebServicesAppsModification should run against both CS and FSMinor.zhihai xuzhihai xu
YARN-2157Document YARN metricsMajordocumentationAkira AJISAKAAkira AJISAKA
YARN-1582Capacity Scheduler: add a maximum-allocation-mb setting per queueMajorcapacityschedulerThomas GravesThomas Graves
YARN-1393SLS: Add how-to-use instructionsMajor.Wei YanWei Yan
YARN-1299Improve a log message in AppSchedulingInfo by adding application idMajorresourcemanagerDevaraj K
YARN-1156Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal valuesMajor.Akira AJISAKATsuyoshi Ozawa

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-11837AuthenticationFilter should destroy SignerSecretProvider in Tomcat deploymentsBlockersecurityVenkat RanganathanBowen Zhang
HADOOP-11815HttpServer2 should destroy SignerSecretProvider when it stopsBlocker.Rohith Sharma K SRohith Sharma K S
HADOOP-11787OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit MacCriticalnativeColin Patrick McCabeKiran Kumar M R
HADOOP-11776jdiff is broken in Hadoop 2Blocker.Li LuLi Lu
HADOOP-11761Fix findbugs warnings in org.apache.hadoop.security.authenticationMinor.Li LuLi Lu
HADOOP-11757NFS gateway should shutdown when it can't start UDP or TCP serverMajornfsBrandon LiBrandon Li
HADOOP-11754RM fails to start in non-secure mode due to authentication filter failureBlocker.Sangjin LeeHaohui Mai
HADOOP-11748The secrets of auth cookies should not be specified in configuration in clear textCritical.Haohui MaiLi Lu
HADOOP-11738Fix a link of Protocol Buffers 2.5 for download in BUILDING.txtMajor.Tsuyoshi OzawaTsuyoshi Ozawa
HADOOP-11729Fix link to cgroups doc in site.xmlMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-11722Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deletedMajor.Arun SureshArun Suresh
HADOOP-11720[JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-toolsMajordocumentationAkira AJISAKAAkira AJISAKA
HADOOP-11693Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving.MajortoolsDuo XuDuo Xu
HADOOP-11691X86 build of libwinutils is brokenCriticalbuild, nativeRemus RusanuKiran Kumar M R
HADOOP-11686MiniKDC cannot change ORG_NAME or ORG_DOMAINMajorsecurity, testDuo ZhangDuo Zhang
HADOOP-11674oneByteBuf in CryptoInputStream and CryptoOutputStream should be non staticCriticalioSean BusbeySean Busbey
HADOOP-11666Revert the format change of du output introduced by HADOOP-6857Major.Akira AJISAKAByron Wong
HADOOP-11639Clean up Windows native code compilation warnings related to Windows Secure Container Executor.MajornativeChris NaurothRemus Rusanu
HADOOP-11638OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to LinuxMajornativeDmitry SivachenkoKiran Kumar M R
HADOOP-11634Description of webhdfs' principal/keytab should switch places each otherMajordocumentationBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-11629WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to trueMajortoolsshanyu zhaoshanyu zhao
HADOOP-11619FTPFileSystem should override getDefaultPortMajorfsGera ShegalovBrahma Reddy Battula
HADOOP-11618DelegateToFileSystem erroneously uses default FS's port in constructorMajorfsGera ShegalovBrahma Reddy Battula
HADOOP-11615Update ServiceLevelAuth.md for YARNMinordocumentationAkira AJISAKABrahma Reddy Battula
HADOOP-11609Correct credential commands info in CommandsManual.html#credentialMajordocumentation, securityBrahma Reddy BattulaVarun Saxena
HADOOP-11605FilterFileSystem#create with ChecksumOpt should propagate it to wrapped FSMinorfsGera ShegalovGera Shegalov
HADOOP-11604Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread.CriticalnetLiang XieChris Nauroth
HADOOP-11602Fix toUpperCase/toLowerCase to use Locale.ENGLISHBlocker.Tsuyoshi OzawaTsuyoshi Ozawa
HADOOP-11595Add default implementation for AbstractFileSystem#truncateMajorfsYi LiuYi Liu
HADOOP-11587TestMapFile#testMainMethodMapFile creates test files in hadoop-common project rootTrivialtestXiaoyu YaoXiaoyu Yao
HADOOP-11571Über-jira: S3a stabilisation phase IBlockerfs/s3Steve LoughranSteve Loughran
HADOOP-11558Fix dead links to doc of hadoop-toolsMinordocumentationMasatake IwasakiJean-Pierre Matsumoto
HADOOP-11549flaky test detection tool failed to handle special control characters in test resultMajortoolsYongjun ZhangYongjun Zhang
HADOOP-11548checknative should display a nicer error message when openssl support is not compiled inMajorbuild, nativeColin Patrick McCabeAnu Engineer
HADOOP-11547hadoop-common native compilation fails on Windows due to missing support for __attribute__ declaration.MajornativeChris NaurothChris Nauroth
HADOOP-11546Checkstyle failing: Unable to instantiate DoubleCheckedLockingCheckMajorbuildSteve LoughranTsuyoshi Ozawa
HADOOP-11545ArrayIndexOutOfBoundsException is thrown with “hadoop credential list -provider”MinorsecurityBrahma Reddy BattulaBrahma Reddy Battula
HADOOP-11529Fix findbugs warnings in hadoop-archivesMinortoolsMasatake IwasakiMasatake Iwasaki
HADOOP-11526Memory leak in Bzip2Compressor and Bzip2DecompressorMajorio, nativeIan RogersAnu Engineer
HADOOP-11523StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASBMajortoolsDuo XuDuo Xu
HADOOP-11512Use getTrimmedStrings when reading serialization keysMinorioHarsh JRyan P
HADOOP-11509change parsing sequence in GenericOptionsParser to parse -D parameters firstMajor.Xuan GongXuan Gong
HADOOP-11507Hadoop RPC Authentication problem with different user localeMinor.Talat UYARERTalat UYARER
HADOOP-11500InputStream is left unclosed in ApplicationClassLoaderMajor.Ted YuTed Yu
HADOOP-11499Check of executorThreadsStarted in ValueQueue#submitRefillTask() evades lock acquisitionMinor.Ted YuTed Yu
HADOOP-11497Fix typo in ClusterSetup.html#Hadoop_StartupMajordocumentationChristian WinklerChristian Winkler
HADOOP-11494Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another threadMinor.Ted YuTed Yu
HADOOP-11493Fix some typos in kms-acls.xml descriptionTrivialkmsCharles LambCharles Lamb
HADOOP-11488Difference in default connection timeout for S3A FSMinorfs/s3Harsh JDaisuke Kobayashi
HADOOP-11482Use correct UGI when KMSClientProvider is called by a proxy userMajor.Arun SureshArun Suresh
HADOOP-11480Typo in hadoop-aws/index.md uses wrong scheme for test.fs.s3.nameMinordocumentationTed YuTed Yu
HADOOP-11470Remove some uses of obsolete guava APIs from the hadoop codebaseMajor.Sangjin LeeSangjin Lee
HADOOP-11469KMS should skip default.key.acl and whitelist.key.acl when loading key aclMinorkmsDian FuDian Fu
HADOOP-11467KerberosAuthenticator can connect to a non-secure clusterCriticalsecurityRobert KanterYongjun Zhang
HADOOP-11462TestSocketIOWithTimeout needs change for PowerPC platformMajortestAyappanAyappan
HADOOP-11459Fix recent findbugs in ActiveStandbyElector, NetUtils and ShellBasedIdMappingMinor.Vinayakumar BVinayakumar B
HADOOP-11450Cleanup DistCpV1 not to use deprecated methods and fix javadocsMinortools/distcpTsuyoshi OzawaVarun Saxena
HADOOP-11449[JDK8] Cannot build on Windows: error: unexpected end tag: </ul>MajorbuildAlec TaylorChris Nauroth
HADOOP-11446S3AOutputStream should use shared thread pool to avoid OutOfMemoryErrorMajorfs/s3Ted YuTed Yu
HADOOP-11445Bzip2Codec: Data block is skipped when position of newly created stream is equal to start of splitCritical.Ankit KambojAnkit Kamboj
HADOOP-11431clean up redundant maven-site-plugin configurationMajor.Hervé BoutemyHervé Boutemy
HADOOP-11428Remove obsolete reference to Cygwin in BUILDING.txtMajordocumentationArpit AgarwalArpit Agarwal
HADOOP-11420Use latest maven-site-plugin and replace link to svn with link to gitTrivialsiteHervé BoutemyHervé Boutemy
HADOOP-11414FileBasedIPList#readLines() can leak file descriptorsMinor.Ted YuTsuyoshi Ozawa
HADOOP-11412POMs mention “The Apache Software License” rather than “Apache License”Trivial.Hervé BoutemyHervé Boutemy
HADOOP-11411Hive build failure on hadoop-2.7 due to HADOOP-11356Major.Jason Dere
HADOOP-11409FileContext.getFileContext can stack overflow if default fs misconfiguredMajor.Jason LoweGera Shegalov
HADOOP-11403Avoid using sys_errlist on Solaris, which lacks support for itMajor.Malcolm KavalskyMalcolm Kavalsky
HADOOP-11402Negative user-to-group cache entries are never cleared for never-again-accessed usersMajor.Colin Patrick McCabeVarun Saxena
HADOOP-11400GraphiteSink does not reconnect to Graphite after ‘broken pipe’MajormetricsKamil GorloKamil Gorlo
HADOOP-11394hadoop-aws documentation missing.MajordocumentationChris NaurothChris Nauroth
HADOOP-11388Remove deprecated o.a.h.metrics.file.FileContextMinor.Haohui MaiLi Lu
HADOOP-11386Replace \n by %n in format hadoop-common format stringsMajor.Li LuLi Lu
HADOOP-11368Fix SSLFactory truststore reloader thread leak in KMSClientProviderMajorkmsArun SureshArun Suresh
HADOOP-11363Hadoop maven surefire-plugin uses must set heap sizeMajorbuildSteve LoughranSteve Loughran
HADOOP-11355When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown.Minor.Arun SureshArun Suresh
HADOOP-11354ThrottledInputStream doesn't perform effective throttlingMajor.Ted YuTed Yu
HADOOP-11350The size of header buffer of HttpServer is too small when HTTPS is enabledMajorsecurityBenoy AntonyBenoy Antony
HADOOP-11349RawLocalFileSystem leaks file descriptor while creating a file if creat succeeds but chmod fails.MinorfsChris NaurothVarun Saxena
HADOOP-11348Remove unused variable from CMake error message for finding opensslMinor.Dian FuDian Fu
HADOOP-11344KMS kms-config.sh sets a default value for the keystore password even in non-ssl setupMajor.Arun SureshArun Suresh
HADOOP-11343Overflow is not properly handled in caclulating final iv for AES CTRBlockersecurityJerry ChenJerry Chen
HADOOP-11342KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACLMajorkms, securityDian FuDian Fu
HADOOP-11337KeyAuthorizationKeyProvider access checks need to be done atomicallyMajor.Dian FuDian Fu
HADOOP-11333Fix deadlock in DomainSocketWatcher when the notification pipe is fullMajor.zhaoyunjiongzhaoyunjiong
HADOOP-11332KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subjectMajorsecurityDian FuDian Fu
HADOOP-11329Add JAVA_LIBRARY_PATH to KMS startup optionsMajorkms, securityDian FuArun Suresh
HADOOP-11327BloomFilter#not() omits the last bit, resulting in an incorrect filterMinorutilTim LuoEric Payne
HADOOP-11322key based ACL check in KMS always check KeyOpType.MANAGEMENT even actual KeyOpType is not MANAGEMENTMajorsecurityDian FuDian Fu
HADOOP-11321copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions.MajorfsChris NaurothChris Nauroth
HADOOP-11318Update the document for hadoop fs -statMajordocumentationAkira AJISAKAAkira AJISAKA
HADOOP-11316“mvn package -Pdist,docs -DskipTests -Dtar” fails because of non-ascii charactersBlocker.Tsuyoshi OzawaTsuyoshi Ozawa
HADOOP-11312Fix unit tests to not use uppercase key namesMajorsecurityAndrew WangAndrew Wang
HADOOP-11309System class pattern package.Foo should match package.Foo$Bar, tooBlocker.Gera ShegalovGera Shegalov
HADOOP-11300KMS startup scripts must not display the keystore / truststore passwordsMajorkmsArun SureshArun Suresh
HADOOP-11295RPC Server Reader thread can't shutdown if RPCCallQueue is fullMajor.Ming MaMing Ma
HADOOP-11294Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructorMinornfsBrandon LiBrandon Li
HADOOP-11289Fix typo in RpcUtil log messageTrivialnetCharles LambCharles Lamb
HADOOP-11287Simplify UGI#reloginFromKeytab for Java 7+Major.Haohui MaiLi Lu
HADOOP-11283Potentially unclosed SequenceFile.Writer in DistCpV1#setup()Minor.Ted YuVarun Saxena
HADOOP-11273TestMiniKdc failure: login options not compatible with IBM JDKMajortestGao Zhong LiangGao Zhong Liang
HADOOP-11272Allow ZKSignerSecretProvider and ZKDelegationTokenSecretManager to use the same curator clientMajor.Arun SureshArun Suresh
HADOOP-11271Use Time.monotonicNow() in Shell.java instead of Time.now()Minor.Vinayakumar BVinayakumar B
HADOOP-11269Add java 8 profile for hadoop-annotationsMajor.Haohui MaiLi Lu
HADOOP-11268Update BUILDING.txt to remove the workaround for tools.jarMinor.Haohui MaiLi Lu
HADOOP-11267TestSecurityUtil fails when run with JDK8 because of empty principal namesMinorsecurity, testStephen ChuStephen Chu
HADOOP-11266Remove no longer supported activation properties for packaging from pomTrivialbuildMasatake IwasakiMasatake Iwasaki
HADOOP-11256Some site docs have inconsistent appearanceMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-11248Add hadoop configuration to disable Azure Filesystem metrics collectionMajorfsshanyu zhaoshanyu zhao
HADOOP-11246Move jenkins to Java 7Major.Haohui MaiSteve Loughran
HADOOP-11238Update the NameNode's Group Cache in the background when possibleMinor.Chris LiChris Li
HADOOP-11236NFS: Fix javadoc warning in RpcProgram.javaTrivialdocumentationAbhiraj ButalaAbhiraj Butala
HADOOP-11230Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARNMajortestRobert KanterRobert Kanter
HADOOP-11213Typos in html pages: SecureMode and EncryptedShuffleMinor.Wei YanWei Yan
HADOOP-11211mapreduce.job.classloader.system.classes semantics should be order-independentMajor.Yitong ZhouYitong Zhou
HADOOP-11209Configuration#updatingResource/finalParameters are not thread-safeMajorconfJosh RosenVarun Saxena
HADOOP-11201Hadoop Archives should support globs resolving to filesBlockertoolsGera ShegalovGera Shegalov
HADOOP-11187NameNode - KMS communication fails after a long period of inactivityMajor.Arun SureshArun Suresh
HADOOP-11186documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classesMinor.Colin Patrick McCabeColin Patrick McCabe
HADOOP-11166Remove ulimit from test-patch.shMajor.Andrew WangAndrew Wang
HADOOP-11157ZKDelegationTokenSecretManager never shuts down listenerThreadPoolMajorsecurityGregory ChananArun Suresh
HADOOP-11156DelegateToFileSystem should implement getFsStatus(final Path f).Majorfszhihai xuzhihai xu
HADOOP-11039ByteBufferReadable API doc is inconsistent with the implementations.MinordocumentationYi LiuYi Liu
HADOOP-11014Potential resource leak in JavaKeyStoreProvider due to unclosed streamMinorsecurityTed YuTsuyoshi Ozawa
HADOOP-11008Remove duplicated description about proxy-user in site documentsMinordocumentationMasatake IwasakiMasatake Iwasaki
HADOOP-11000HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDINGMajor.Ming MaMing Ma
HADOOP-10953NetworkTopology#add calls NetworkTopology#toString without holding the netlockMinornetLiang XieLiang Xie
HADOOP-10852NetgroupCache is not thread-safeMajorsecurityBenoy AntonyBenoy Antony
HADOOP-10840Fix OutOfMemoryError caused by metrics system in Azure File SystemMajormetricsshanyu zhaoshanyu zhao
HADOOP-10786Fix UGI#reloginFromKeytab on Java 8MajorsecurityTobi VollebregtStephen Chu
HADOOP-10748HttpServer2 should not load JspServletMajor.Haohui MaiHaohui Mai
HADOOP-10717HttpServer2 should load jsp DTD from local jars instead of going remoteBlocker.Dapeng SunDapeng Sun
HADOOP-10714AmazonS3Client.deleteObjects() need to be limited to 1000 entries per callCriticalfs/s3David S. WangJuan Yu
HADOOP-10703HttpServer2 creates multiple authentication filtersMajorsecurityBenoy AntonyBenoy Antony
HADOOP-10690Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close()MinortoolsTed YuChen He
HADOOP-10689InputStream is not closed in AzureNativeFileSystemStore#retrieve()MinortoolsTed YuChen He
HADOOP-10542Potential null pointer dereference in Jets3tFileSystemStore#retrieveBlock()Minorfs/s3Ted YuTed Yu
HADOOP-10181GangliaContext does not work with multicast ganglia setupMinormetricsAndrew OttoAndrew Johnson
HADOOP-10134[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc commentsMinor.Andrew PurtellAndrew Purtell
HADOOP-10062race condition in MetricsSystemImpl#publishMetricsNow that causes incorrect resultsMajormetricsShinichi YamashitaSangjin Lee
HADOOP-9922hadoop windows native build will fail in 32 bit machineMajorbuild, nativeVinayakumar BKiran Kumar M R
HADOOP-9907Webapp http://hostname:port/metrics link is not workingCritical.Jian HeAkira AJISAKA
HADOOP-9137Support connection limiting in IPC serverMajor.Sanjay RadiaKihwal Lee
HADOOP-9087Queue size metric for metric sinks isn't actually maintainedMinormetricsMostafa ElhemaliAkira AJISAKA
HADOOP-8642Document that io.native.lib.available only controls native bz2 and zlib compression codecsMajordocumentation, nativeEli CollinsAkira AJISAKA
HADOOP-6221RPC Client operations cannot be interruptedMinoripcSteve LoughranSteve Loughran
HDFS-8072Reserved RBW space is not released if client terminates while writing blockMajordatanodeArpit AgarwalArpit Agarwal
HDFS-8063Fix intermittent test failures in TestTracingMinortestMasatake IwasakiMasatake Iwasaki
HDFS-8051FsVolumeList#addVolume should release volume reference if not put it into BlockScanner.MajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-8036Use snapshot path as source when using snapshot diff report in DistCpMajordistcpSushmitha SreenivasanJing Zhao
HDFS-8025Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicatedMajor.Ming MaMing Ma
HDFS-8001RpcProgramNfs3 : wrong parsing of dfs.blocksizeTrivialnfsRemi CatherinotRemi Catherinot
HDFS-7999FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long timeMajor.zhouyingchaozhouyingchao
HDFS-7996After swapping a volume, BlockReceiver reports ReplicaNotFoundExceptionCriticaldatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-7977NFS couldn't take percentile intervalsMajornfsBrandon LiBrandon Li
HDFS-7963Fix expected tracing spans in TestTracing along with HDFS-7054CriticaltestMasatake IwasakiMasatake Iwasaki
HDFS-7961Trigger full block report after hot swapping diskMajor.Lei (Eddy) XuLei (Eddy) Xu
HDFS-7960The full block report should prune zombie storages even if they're not emptyCritical.Lei (Eddy) XuColin Patrick McCabe
HDFS-7957Truncate should verify quota before making changesCriticalnamenodeJing ZhaoJing Zhao
HDFS-7956Improve logging for DatanodeRegistration.MajornamenodeKonstantin ShvachkoPlamen Jeliazkov
HDFS-7953NN Web UI fails to navigate to paths that contain #MinornamenodeKanaka Kumar AvvaruKanaka Kumar Avvaru
HDFS-7945The WebHdfs system on DN does not honor the length parameterBlocker.Haohui MaiHaohui Mai
HDFS-7943Append cannot handle the last block with length greater than the preferred block sizeBlocker.Jing ZhaoJing Zhao
HDFS-7942NFS: support regexp grouping in nfs.exports.allowed.hostsMajornfsBrandon LiBrandon Li
HDFS-7932Speed up the shutdown of datanode during rolling upgradeMajor.Kihwal LeeKihwal Lee
HDFS-7930commitBlockSynchronization() does not remove locationsBlockernamenodeKonstantin ShvachkoYi Liu
HDFS-7929inotify unable fetch pre-upgrade edit log segments once upgrade startsMajor.Zhe ZhangZhe Zhang
HDFS-7926NameNode implementation of ClientProtocol.truncate(..) is not idempotentMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-7915The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network errorMajor.Colin Patrick McCabeColin Patrick McCabe
HDFS-7886TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimesMinortestYi LiuPlamen Jeliazkov
HDFS-7885Datanode should not trust the generation stamp provided by clientCriticaldatanodevitthal (Suhas) GogateTsz Wo Nicholas Sze
HDFS-7884NullPointerException in BlockSenderBlockerdatanodeTsz Wo Nicholas SzeBrahma Reddy Battula
HDFS-7881TestHftpFileSystem#testSeek fails in branch-2Blocker.Akira AJISAKABrahma Reddy Battula
HDFS-7880Remove the tests for legacy Web UI in branch-2BlockertestAkira AJISAKABrahma Reddy Battula
HDFS-7879hdfs.dll does not export functions of the public libhdfs APIMajorbuild, libhdfsChris NaurothChris Nauroth
HDFS-7871NameNodeEditLogRoller can keep printing “Swallowing exception” messageCritical.Jing ZhaoJing Zhao
HDFS-7869Inconsistency in the return information while performing rolling upgradeMajor.J.AndreinaJ.Andreina
HDFS-7831Fix the starting index and end condition of the loop in FileDiffList.findEarlierSnapshotBlocks()Major.Konstantin ShvachkoKonstantin Shvachko
HDFS-7830DataNode does not release the volume lock when adding a volume fails.MajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-7818OffsetParam should return the default value instead of throwing NPE when the value is unspecifiedBlockerwebhdfsEric PayneEric Payne
HDFS-7816Unable to open webhdfs paths with “+”BlockerwebhdfsJason LoweHaohui Mai
HDFS-7813TestDFSHAAdminMiniCluster#testFencer testcase is failing frequentlyMajorha, testRakesh RRakesh R
HDFS-7807libhdfs htable.c: fix htable resizing, add unit testMajornativeColin Patrick McCabeColin Patrick McCabe
HDFS-7805NameNode recovery prompt should be printed on consoleMajornamenodeSurendra Singh LilhoreSurendra Singh Lilhore
HDFS-7798Checkpointing failure caused by shared KerberosAuthenticatorCriticalsecurityChengbing LiuChengbing Liu
HDFS-7788Post-2.6 namenode may not start up with an image containing inodes created with an old release.Blocker.Kihwal LeeRushabh S Shah
HDFS-7785Improve diagnostics information for HttpPutFailedExceptionMajornamenodeChengbing LiuChengbing Liu
HDFS-7778Rename FsVolumeListTest to TestFsVolumeList and commit it to branch-2Majordatanode, testLei (Eddy) XuLei (Eddy) Xu
HDFS-7774Unresolved symbols error while compiling HDFS on Windows 7/32 bitCriticalbuild, nativeVenkatasubramaniam RamakrishnanKiran Kumar M R
HDFS-7769TestHDFSCLI create files in hdfs project root dirTrivialtestTsz Wo Nicholas Sze
HDFS-7763fix zkfc hung issue due to not catching exception in a corner caseMajorhaLiang XieLiang Xie
HDFS-7756Restore method signature for LocatedBlock#getLocations()Major.Ted YuTed Yu
HDFS-7753Fix Multithreaded correctness Warnings in BackupImage.javaMajor.Rakesh RKonstantin Shvachko
HDFS-7748Separate ECN flags from the Status in the DataTransferPipelineAckBlocker.Haohui MaiAnu Engineer
HDFS-7744Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is calledMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-7742favoring decommissioning node for replication can cause a block to stay underreplicated for long periodsMajornamenodeNathan RobertsNathan Roberts
HDFS-7741Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStreamMinor.Yi LiuYi Liu
HDFS-7734Class cast exception in NameNode#mainBlockernamenodeArpit AgarwalYi Liu
HDFS-7722DataNode#checkDiskError should also remove Storage when error is found.MajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-7721The HDFS BlockScanner may run fast during the first hourMajordatanodeTsz Wo Nicholas SzeColin Patrick McCabe
HDFS-7719BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumesMajor.Lei (Eddy) XuLei (Eddy) Xu
HDFS-7718Store KeyProvider in ClientContext to avoid leaking key provider threads when using FileContextMajor.Arun SureshArun Suresh
HDFS-7714Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.MajordatanodeChris NaurothVinayakumar B
HDFS-7709Fix findbug warnings in httpfsMajor.Rakesh RRakesh R
HDFS-7707Edit log corruption due to delayed block removal againMajornamenodeYongjun ZhangYongjun Zhang
HDFS-7704DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out.Majordatanode, namenodeRushabh S ShahRushabh S Shah
HDFS-7698Fix locking on HDFS read statistics and add a method for clearing them.Major.Colin Patrick McCabeColin Patrick McCabe
HDFS-7697Mark the PB OIV tool as experimentalMajor.Haohui MaiLei (Eddy) Xu
HDFS-7696FsDatasetImpl.getTmpInputStreams(..) may leak file descriptorsMinordatanodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-7686Re-add rapid rescan of possibly corrupt block feature to the block scannerBlocker.Rushabh S ShahColin Patrick McCabe
HDFS-7682{{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted contentMajor.Charles LambCharles Lamb
HDFS-7660BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.Minor.Lei (Eddy) XuLei (Eddy) Xu
HDFS-7647DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDsMajor.Milan DesaiMilan Desai
HDFS-7644minor typo in HttpFS docTrivialdocumentationCharles LambCharles Lamb
HDFS-7641Update archival storage user doc for list/set/get block storage policiesMinordocumentationYi LiuYi Liu
HDFS-7637Fix the check condition for reserved pathMinor.Yi LiuYi Liu
HDFS-7635Remove TestCorruptFilesJsp from branch-2.MinortestChris NaurothChris Nauroth
HDFS-7632MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode.MajortestChris NaurothChris Nauroth
HDFS-7615Remove longReadLockMajor.Kihwal LeeKihwal Lee
HDFS-7611deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.CriticalnamenodeKonstantin ShvachkoJing Zhao
HDFS-7610Fix removal of dynamically added DN volumesMajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-7606Missing null check in INodeFile#getBlocks()Minor.Ted YuByron Wong
HDFS-7603The background replication queue initialization may not let others runCriticalrolling upgradesKihwal LeeKihwal Lee
HDFS-7596NameNode should prune dead storages from storageMapMajornamenodeArpit AgarwalArpit Agarwal
HDFS-7587Edit log corruption can happen if append fails with a quota violationBlockernamenodeKihwal LeeJing Zhao
HDFS-7583Fix findbug in TransferFsImage.javaMinornamenodeVinayakumar BVinayakumar B
HDFS-7575Upgrade should generate a unique storage ID for each volumeCritical.Lars FranckeArpit Agarwal
HDFS-7572TestLazyPersistFiles#testDnRestartWithSavedReplicas is flaky on WindowsMajortestArpit AgarwalArpit Agarwal
HDFS-7566Remove obsolete entries from hdfs-default.xmlMajor.Ray ChiangRay Chiang
HDFS-7563NFS gateway parseStaticMap NumberFormatExceptionMajornfsHari SekhonYongjun Zhang
HDFS-7561TestFetchImage should write fetched-image-dir under target.Major.Konstantin ShvachkoLiang Xie
HDFS-7560ACLs removed by removeDefaultAcl() will be back after NameNode restart/failoverCriticalnamenodeVinayakumar BVinayakumar B
HDFS-7552change FsVolumeList toString() to fix TestDataNodeVolumeFailureTolerationMajordatanode, testLiang XieLiang Xie
HDFS-7548Corrupt block reporting delayed until datablock scanner thread detects itMajor.Rushabh S ShahRushabh S Shah
HDFS-7536Remove unused CryptoCodec in org.apache.hadoop.fs.HdfsMinorsecurityYi LiuYi Liu
HDFS-7533Datanode sometimes does not shutdown on receiving upgrade shutdown commandMajor.Kihwal LeeEric Payne
HDFS-7530Allow renaming of encryption zone rootsMinornamenodeCharles LambCharles Lamb
HDFS-7517Remove redundant non-null checks in FSNamesystem#getBlockLocationsMajor.Haohui MaiHaohui Mai
HDFS-7516Fix findbugs warnings in hadoop-nfs projectMajornfsBrandon LiBrandon Li
HDFS-7515Fix new findbugs warnings in hadoop-hdfsMajor.Haohui MaiHaohui Mai
HDFS-7514TestTextCommand fails on WindowsMajortestArpit AgarwalArpit Agarwal
HDFS-7502Fix findbugs warning in hdfs-nfs projectMajornfsBrandon LiBrandon Li
HDFS-7497Inconsistent report of decommissioning DataNodes between dfsadmin and NameNode webuiMajordatanode, namenodeYongjun ZhangYongjun Zhang
HDFS-7496Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instancesMajor.Colin Patrick McCabeLei (Eddy) Xu
HDFS-7495Remove updatePosition argument from DFSInputStream#getBlockAt()Minor.Ted YuColin Patrick McCabe
HDFS-7494Checking of closed in DFSInputStream#pread() should be protected by synchronizationMinor.Ted YuTed Yu
HDFS-7490HDFS tests OOM on Java7+Majorbuild, testSteve LoughranSteve Loughran
HDFS-7481Add ACL indicator to the “Permission Denied” exception.MinornamenodeVinayakumar BVinayakumar B
HDFS-7473Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalidMajordocumentationJason KellerAkira AJISAKA
HDFS-7472Fix typo in message of ReplicaNotFoundExceptionTrivial.Masatake IwasakiMasatake Iwasaki
HDFS-7470SecondaryNameNode need twice memory when calling reloadFromImageFileMajornamenodezhaoyunjiongzhaoyunjiong
HDFS-7457DatanodeID generates excessive garbageMajornamenodeDaryn SharpDaryn Sharp
HDFS-7456De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNodeMajornamenodeVinayakumar BVinayakumar B
HDFS-7444convertToBlockUnderConstruction should preserve BlockCollectionMajor.Haohui MaiHaohui Mai
HDFS-7431log message for InvalidMagicNumberException may be incorrectMajorsecurityYi LiuYi Liu
HDFS-7423various typos and message formatting fixes in nfs daemon and docTrivialnfsCharles LambCharles Lamb
HDFS-7406SimpleHttpProxyHandler puts incorrect “Connection: Close” headerMajor.Haohui MaiHaohui Mai
HDFS-7403Inaccurate javadoc of BlockUCState#COMPLETE stateTrivialnamenodeYongjun ZhangYongjun Zhang
HDFS-7399Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock()Minor.Ted YuVinayakumar B
HDFS-7395BlockIdManager#clear() bails out when resetting the GenerationStampV1LimitMajornamenodeYongjun ZhangHaohui Mai
HDFS-7394Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCacheMinor.Kihwal LeeKeith Pak
HDFS-7389Named user ACL cannot stop the user from accessing the FS entity.MajornamenodeChunjun XiaoVinayakumar B
HDFS-7374Allow decommissioning of dead DataNodesMajor.Zhe ZhangZhe Zhang
HDFS-7373Clean up temporary files after fsimage transfer failuresMajor.Kihwal LeeKihwal Lee
HDFS-7366BlockInfo should take replication as an short in the constructorMinor.Haohui MaiLi Lu
HDFS-7361TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation.Minordatanode, namenode, testChris NaurothKonstantin Shvachko
HDFS-7358Clients may get stuck waiting when using ByteArrayManagerMajorhdfs-clientTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-7315DFSTestUtil.readFileBuffer opens extra FSDataInputStreamTrivial.Plamen JeliazkovPlamen Jeliazkov
HDFS-7303NN UI fails to distinguish datanodes on the same hostMinor.Benoy AntonyBenoy Antony
HDFS-7301TestMissingBlocksAlert should use MXBeans instead of old web UIMinor.Zhe ZhangZhe Zhang
HDFS-7282Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GCMajortestJinghui WangJinghui Wang
HDFS-7277Remove explicit dependency on netty 3.2 in BKJournalMinorbuildHaohui MaiHaohui Mai
HDFS-7263Snapshot read can reveal future bytes for appended files.Majorhdfs-clientKonstantin ShvachkoTao Luo
HDFS-7258CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO levelMinornamenodeXiaoyu YaoXiaoyu Yao
HDFS-7235DataNode#transferBlock should report blocks that don't exist using reportBadBlockMajordatanode, namenodeYongjun ZhangYongjun Zhang
HDFS-7232Populate hostname in httpfs audit logTrivial.Zoran DimitrijevicZoran Dimitrijevic
HDFS-7227Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHostMinor.Colin Patrick McCabeColin Patrick McCabe
HDFS-7225Remove stale block invalidation work when DN re-registers with different UUIDMajornamenodeZhe ZhangZhe Zhang
HDFS-7224Allow reuse of NN connections via webhdfsMajorwebhdfsEric PayneEric Payne
HDFS-7213processIncrementalBlockReport performance degradationCriticalnamenodeDaryn SharpEric Payne
HDFS-7202Should be able to omit package name of SpanReceiver on “hadoop trace -add”Minor.Masatake IwasakiMasatake Iwasaki
HDFS-7201Fix typos in hdfs-default.xmlMajor.Konstantin ShvachkoDawson Choong
HDFS-7198Fix findbugs “unchecked conversion” warning in DFSClient#getPathTraceScopeTrivial.Colin Patrick McCabeColin Patrick McCabe
HDFS-7194Fix findbugs “inefficient new String constructor” warning in DFSClient#PATHTrivial.Yongjun ZhangYongjun Zhang
HDFS-7146NFS ID/Group lookup requires SSSD enumeration on the serverMajornfsYongjun ZhangYongjun Zhang
HDFS-7097Allow block reports to be processed during checkpointing on standby name nodeCritical.Kihwal LeeKihwal Lee
HDFS-7009Active NN and standby NN have different live nodesMajordatanodeMing MaMing Ma
HDFS-7008xlator should be closed upon exit from DFSAdmin#genericRefresh()Minor.Ted YuTsuyoshi Ozawa
HDFS-6938Cleanup javac warnings in FSNamesystemTrivialnamenodeCharles LambCharles Lamb
HDFS-6917Add an hdfs debug command to validate blocks, call recoverlease, etc.Majorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-6841Use Time.monotonicNow() wherever applicable instead of Time.now()Major.Vinayakumar BVinayakumar B
HDFS-6833DirectoryScanner should not register a deleting block with memory of DataNodeCriticaldatanodeShinichi YamashitaShinichi Yamashita
HDFS-6753Initialize checkDisk when DirectoryScanner not able to get files list for scanningMajor.J.AndreinaJ.Andreina
HDFS-6672Regression with hdfs oiv toolMinor.Lei (Eddy) XuLei (Eddy) Xu
HDFS-6662WebHDFS cannot open a file if its path contains “%”CriticalnamenodeBrahma Reddy BattulaGerson Carlos
HDFS-6657Remove link to ‘Legacy UI’ in Namenode UIMinor.Vinayakumar BVinayakumar B
HDFS-6538Comment format error in ShortCircuitRegistry javadocTrivialdatanodedebuggingDavid Luo
HDFS-6425Large postponedMisreplicatedBlocks has impact on blockReport latencyMajor.Ming MaMing Ma
HDFS-5578[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc commentsMinor.Andrew PurtellAndrew Purtell
HDFS-5445PacketReceiver populates the packetLen field in PacketHeader incorrectlyMinordatanodeJonathan MaceJonathan Mace
HDFS-3519Checkpoint upload may interfere with a concurrent saveNamespaceCriticalnamenodeTodd LipconMing Ma
HDFS-2605CHANGES.txt has two “Release 0.21.1” sectionsMajordocumentationKonstantin ShvachkoAllen Wittenauer
HDFS-1522Merge Block.BLOCK_FILE_PREFIX and DataStorage.BLOCK_FILE_PREFIX into one constantMajordatanodeKonstantin ShvachkoDongming Liang
HDFS-49MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not foundMinortestSteve LoughranSteve Loughran
MAPREDUCE-6303Read timeout when retrying a fetch error can be fatal to a reducerBlocker.Jason LoweJason Lowe
MAPREDUCE-6285ClientServiceDelegate should not retry upon AuthenticationExceptionMajor.Jonathan EaglesJonathan Eagles
MAPREDUCE-6277Job can post multiple history files if attempt loses connection to the RMMajormr-amChang LiChang Li
MAPREDUCE-6275Race condition in FileOutputCommitter v2 for user-specified task output subdirsCritical.Siqi LiGera Shegalov
MAPREDUCE-6268Fix typo in Task Attempt API's URLMinor.Ryu KobayashiRyu Kobayashi
MAPREDUCE-6263Configurable timeout between YARNRunner terminate the application and forcefully kill.MajorclientJason LoweEric Payne
MAPREDUCE-6261NullPointerException if MapOutputBuffer.flush invoked twiceMajormrv2Jason LoweTsuyoshi Ozawa
MAPREDUCE-6243Fix findbugs warnings in hadoop-rumenMinortools/rumenAkira AJISAKAMasatake Iwasaki
MAPREDUCE-6233org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort failed in trunkMajortestYongjun Zhangzhihai xu
MAPREDUCE-6231Grep example job is not working on a fully-distributed clusterMajorexamplesAkira AJISAKAAkira AJISAKA
MAPREDUCE-6230MR AM does not survive RM restart if RM activated a new AMRM secret keyBlockermr-amJason LoweJason Lowe
MAPREDUCE-6225Fix new findbug warnings in hadoop-mapreduce-client-coreMajor.Jason LoweVarun Saxena
MAPREDUCE-6221Stringifier is left unclosed in Chain#getChainElementConf()Minor.Ted YuTed Yu
MAPREDUCE-6210Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.javaMinorapplicationmasterLeitao GuoLeitao Guo
MAPREDUCE-6206TestAggregatedTransferRate fails on non-US systemsCritical.Jens RabeJens Rabe
MAPREDUCE-6186Redundant call to requireJob() while displaying the conf pageMinorjobhistoryserverRohit AgarwalRohit Agarwal
MAPREDUCE-6177Minor typo in the EncryptedShuffle document about ssl-client.xmlTrivialdocumentationyangping wuyangping wu
MAPREDUCE-6172TestDbClasses timeouts are too aggressiveMinortestJason LoweVarun Saxena
MAPREDUCE-6166Reducers do not validate checksum of map outputs when fetching directly to diskMajormrv2Eric PayneEric Payne
MAPREDUCE-6162mapred hsadmin fails on a secure clusterBlockerjobhistoryserverJason LoweJason Lowe
MAPREDUCE-6160Potential NullPointerException in MRClientProtocol interface implementation.Major.Rohith Sharma K SRohith Sharma K S
MAPREDUCE-6136MRAppMaster doesn't shutdown file systemsMajorapplicationmasterNoah WatkinsBrahma Reddy Battula
MAPREDUCE-6049AM JVM does not exit if MRClientService gracefull shutdown failsMajorapplicationmaster, resourcemanagerNishan ShettyRohith Sharma K S
MAPREDUCE-6045need close the DataInputStream after open it in TestMapReduce.javaMinortestzhihai xuzhihai xu
MAPREDUCE-5988Fix dead links to the javadocs in mapreduce projectMinordocumentationAkira AJISAKAAkira AJISAKA
MAPREDUCE-5918LineRecordReader can return the same decompressor to CodecPool multiple timesMajor.Sergey MurylevSergey Murylev
MAPREDUCE-5657[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc commentsMinordocumentationAndrew PurtellAkira AJISAKA
MAPREDUCE-5568JHS returns invalid string for reducer completion percentage if AM restarts with 0 reducer.Major.Jian HeMinJi Kim
MAPREDUCE-4879TeraOutputFormat may overwrite an existing output directoryMajorexamplesGera ShegalovGera Shegalov
MAPREDUCE-4742Fix typo in nnbench#displayUsageTrivialtestLiang XieLiang Xie
MAPREDUCE-4286TestClientProtocolProviderImpls passes on failure conditionsMajor.Devaraj KDevaraj K
MAPREDUCE-3283mapred classpath CLI does not display the complete classpathMinorscriptsRamya SunilVarun Saxena
MAPREDUCE-2815JavaDoc does not generate correctly for MultithreadedMapRunnerMinordocumentationShane ButlerChris Palmer
YARN-3393Getting application(s) goes wrong when app finishes before starting the attemptCriticaltimelineserverZhijie ShenZhijie Shen
YARN-3384TestLogAggregationService.verifyContainerLogs fails after YARN-2777Minor.Naganarasimha G RNaganarasimha G R
YARN-3369Missing NullPointer check in AppSchedulingInfo causes RM to dieBlockerresourcemanagerGiovanni Matteo FumarolaBrahma Reddy Battula
YARN-3338Exclude jline dependency from YARNBlockerbuildZhijie ShenZhijie Shen
YARN-3336FileSystem memory leak in DelegationTokenRenewerCriticalresourcemanagerzhihai xuzhihai xu
YARN-3304ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other gettersBlockernodemanagerJunping DuJunping Du
YARN-3296yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked PrivateMajor.Hitesh ShahHitesh Shah
YARN-3295Fix documentation nits found in markdown conversionTrivialdocumentationMasatake IwasakiMasatake Iwasaki
YARN-3287TimelineClient kerberos authentication failure uses wrong login context.Major.Jonathan EaglesDaryn Sharp
YARN-3281Add RMStateStore to StateMachine visualization listMinorscriptsChengbing LiuChengbing Liu
YARN-3275CapacityScheduler: Preemption happening on non-preemptable queuesMajor.Eric PayneEric Payne
YARN-3270node label expression not getting set in ApplicationSubmissionContextMinor.Rohit AgarwalRohit Agarwal
YARN-3267Timelineserver applies the ACL rules after applying the limit on the number of recordsMajor.Prakash RamachandranChang Li
YARN-3256TestClientToAMTokens#testClientTokenRace is not running against all Schedulers even when using ParameterizedSchedulerTestBaseMajor.Anubhav DhootAnubhav Dhoot
YARN-3255RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic optionsMajornodemanager, resourcemanagerKonstantin ShvachkoKonstantin Shvachko
YARN-3242Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old clientCriticalresourcemanagerzhihai xuzhihai xu
YARN-3239WebAppProxy does not support a final tracking url which has query fragments and paramsMajor.Hitesh ShahJian He
YARN-3238Connection timeouts to nodemanagers are retried at multiple levelsBlocker.Jason LoweJason Lowe
YARN-3237AppLogAggregatorImpl fails to log error causeMajor.Rushabh S ShahRushabh S Shah
YARN-3231FairScheduler: Changing queueMaxRunningApps interferes with pending jobsCritical.Siqi LiSiqi Li
YARN-3227Timeline renew delegation token fails when RM user's TGT is expiredCritical.Jonathan EaglesZhijie Shen
YARN-3222RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential orderCriticalresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-3207secondary filter matches entites which do not have the key being filtered for.MajortimelineserverPrakash RamachandranZhijie Shen
YARN-3194RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected nodeBlockerresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-3191Log object should be initialized with its own classTrivialnodemanagerRohith Sharma K SRohith Sharma K S
YARN-3164rmadmin command usage prints incorrect command nameMinorresourcemanagerBibin A ChundattBibin A Chundatt
YARN-3160Non-atomic operation on nodeUpdateQueue in RMNodeImplMajorresourcemanagerChengbing LiuChengbing Liu
YARN-3155Refactor the exception handling code for TimelineClientImpl's retryOn methodMinor.Li LuLi Lu
YARN-3151On Failover tracking url wrong in application cli for KILLED applicationMinorclient, resourcemanagerBibin A ChundattRohith Sharma K S
YARN-3149Typo in message for invalid application idTrivialresourcemanagerBibin A ChundattBibin A Chundatt
YARN-3145ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfoMajor.Jian HeTsuyoshi Ozawa
YARN-3143RM Apps REST API can return NPE or entries missing id and other fieldsMajorwebappKendall ThrappJason Lowe
YARN-3131YarnClientImpl should check FAILED and KILLED state in submitApplicationMajor.Chang LiChang Li
YARN-3113Release audit warning for “Sorting icons.psd”Major.Chang LiSteve Loughran
YARN-3104RM generates new AMRM tokens every heartbeat between rolling and activationMajorresourcemanagerJason LoweJason Lowe
YARN-3103AMRMClientImpl does not update AMRM token properlyBlockerclientJason LoweJason Lowe
YARN-3101In Fair Scheduler, fix canceling of reservations for exceeding max shareMajorfairschedulerAnubhav DhootAnubhav Dhoot
YARN-3094reset timer for liveness monitors after RM recoveryMajorresourcemanagerJun GongJun Gong
YARN-3090DeletionService can silently ignore deletion task failuresMajornodemanagerJason LoweVarun Saxena
YARN-3089LinuxContainerExecutor does not handle file arguments to deleteAsUserBlocker.Jason LoweEric Payne
YARN-3088LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an errorMajornodemanagerJason LoweEric Payne
YARN-3082Non thread safe access to systemCredentials in NodeHeartbeatResponse processingMajor.Anubhav DhootAnubhav Dhoot
YARN-3079Scheduler should also update maximumAllocation when updateNodeResource.Major.zhihai xuzhihai xu
YARN-3078LogCLIHelpers lacks of a blank space before string ‘does not exist’Minorlog-aggregationsam liu
YARN-3074Nodemanager dies when localizer runner tries to write to a full diskMajornodemanagerJason LoweVarun Saxena
YARN-3071Remove invalid char from sample conf in doc of FairSchedulerTrivialdocumentationMasatake IwasakiMasatake Iwasaki
YARN-3064TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeoutCriticalschedulerWangda TanJian He
YARN-3058Fix error message of tokens' activation delay configurationMinor.Yi LiuYi Liu
YARN-3055The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewerBlockersecurityYi LiuDaryn Sharp
YARN-3029FSDownload.unpack() uses local locale for FS case conversion, may not work everywhereMajornodemanagerSteve LoughranVarun Saxena
YARN-3027Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocationMajor.Anubhav DhootAnubhav Dhoot
YARN-3024LocalizerRunner should give DIE action when all resources are localizedMajornodemanagerChengbing LiuChengbing Liu
YARN-3015yarn classpath command should support same options as hadoop classpath.MinorscriptsChris NaurothVarun Saxena
YARN-3010Fix recent findbug issue in AbstractYarnSchedulerMinor.Yi LiuYi Liu
YARN-2997NM keeps sending already-sent completed containers to RM until containers are removed from contextMajornodemanagerChengbing LiuChengbing Liu
YARN-2993Several fixes (missing acl check, error log msg ...) and some refinement in AdminServiceMajorresourcemanagerYi LiuYi Liu
YARN-2992ZKRMStateStore crashes due to session expiryBlockerresourcemanagerKarthik KambatlaKarthik Kambatla
YARN-2991TestRMRestart.testDecomissionedNMsMetricsOnRMRestart intermittently fails on trunkBlocker.Zhijie ShenRohith Sharma K S
YARN-2990FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requestsMajorfairschedulerKarthik KambatlaKarthik Kambatla
YARN-2988Graph#save() may leak file descriptorsMinor.Ted YuTed Yu
YARN-2987ClientRMService#getQueueInfo doesn't check app ACLsMajor.Jian HeVarun Saxena
YARN-2983NPE possible in ClientRMService#getQueueInfoMajorresourcemanagerVarun SaxenaVarun Saxena
YARN-2978ResourceManager crashes with NPE while getting queue infoCritical.Jason TufoVarun Saxena
YARN-2977TestNMClient get failed intermittentlyMajor.Junping DuJunping Du
YARN-2975FSLeafQueue app lists are accessed without required locksBlocker.Karthik KambatlaKarthik Kambatla
YARN-2972DelegationTokenRenewer thread pool never expandsMajorresourcemanagerJason LoweJason Lowe
YARN-2964RM prematurely cancels tokens for jobs that submit jobs (oozie)BlockerresourcemanagerDaryn SharpJian He
YARN-2958RMStateStore seems to unnecessarily and wrongly store sequence number separatelyBlockerresourcemanagerZhijie ShenVarun Saxena
YARN-2956Some yarn-site index linked pages are difficult to discover because are not in the side barMinordocumentationRemus RusanuMasatake Iwasaki
YARN-2952Incorrect version check in RMStateStoreMajor.Jian HeRohith Sharma K S
YARN-2945FSLeafQueue#assignContainer - document the reason for using both write and read locksMajor.Tsuyoshi OzawaTsuyoshi Ozawa
YARN-2936YARNDelegationTokenIdentifier doesn't set proto.builder nowMajor.Zhijie ShenVarun Saxena
YARN-2932Add entry for “preemptable” status (enabled/disabled) to scheduler web UI and queue initialize/refresh loggingMajor.Eric PayneEric Payne
YARN-2931PublicLocalizer may fail until directory is initialized by LocalizeRunnerCriticalnodemanagerAnubhav DhootAnubhav Dhoot
YARN-2922ConcurrentModificationException in CapacityScheduler's LeafQueueMajorcapacityscheduler, resourcemanager, schedulerJason TufoRohith Sharma K S
YARN-2917Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hookCriticalresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-2912Jersey Tests failing with port in useMajortestSteve LoughranVarun Saxena
YARN-2910FSLeafQueue can throw ConcurrentModificationExceptionMajorfairschedulerWilfred SpiegelenburgWilfred Spiegelenburg
YARN-2907SchedulerNode#toString should print all resource detail instead of only memory.TrivialresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-2906CapacitySchedulerPage shows HTML tags for a queue's Active UsersMajorcapacityschedulerJason LoweJason Lowe
YARN-2905AggregatedLogsBlock page can infinitely loop if the aggregated log file is corruptedBlocker.Jason LoweVarun Saxena
YARN-2899Run TestDockerContainerExecutorWithMocks on Linux onlyMinornodemanager, testMing MaMing Ma
YARN-2897CrossOriginFilter needs more log statementsMajor.Mit DesaiMit Desai
YARN-2894When ACL's are enabled, if RM switches then application can not be viewed from web.MajorresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-2874Dead lock in “DelegationTokenRenewer” which blocks RM to execute any further appsBlockerresourcemanagerNaganarasimha G RNaganarasimha G R
YARN-2870Update examples in document of Timeline ServerTrivialdocumentation, timelineserverMasatake IwasakiMasatake Iwasaki
YARN-2869CapacityScheduler should trim sub queue names when parse configurationMajorcapacityscheduler, resourcemanagerWangda TanWangda Tan
YARN-2865Application recovery continuously fails with “Application with id already present. Cannot duplicate”CriticalresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-2861Timeline DT secret manager should not reuse the RM's configs.Major.Zhijie ShenZhijie Shen
YARN-2857ConcurrentModificationException in ContainerLogAppenderCritical.Mohammad Kamrul IslamMohammad Kamrul Islam
YARN-2856Application recovery throw InvalidStateTransitonException: Invalid event: ATTEMPT_KILLED at ACCEPTEDCriticalresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-2847Linux native container executor segfaults if default banned user detectedMajornodemanagerJason LoweOlaf Flebbe
YARN-2816NM fail to start with NPE during container recoveryMajornodemanagerzhihai xuzhihai xu
YARN-2815Remove jline from hadoop-yarn-server-commonMajor.Ferdinand XuFerdinand Xu
YARN-2811In Fair Scheduler, reservation fulfillments shouldn't ignore max shareMajor.Siqi LiSiqi Li
YARN-2809Implement workaround for linux kernel panic when removing cgroupMajornodemanagerNathan RobertsNathan Roberts
YARN-2808yarn client tool can not list app_attempt's container info correctlyMajorclientGordon WangNaganarasimha G R
YARN-2749Some testcases from TestLogAggregationService fails in trunkMajor.Xuan GongXuan Gong
YARN-2742FairSchedulerConfiguration should allow extra spaces between value and unitMinorfairschedulerSangjin LeeWei Yan
YARN-2735diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollectionTrivialnodemanagerzhihai xuzhihai xu
YARN-2731Fixed RegisterApplicationMasterResponsePBImpl to properly invoke maybeInitBuilderMajor.Carlo CurinoCarlo Curino
YARN-2713“RM Home” link in NM should point to one of the RMs in an HA setupMajorresourcemanagerKarthik KambatlaKarthik Kambatla
YARN-2697RMAuthenticationHandler is no longer usefulMajorresourcemanagerZhijie Shenhaosdent
YARN-2675containersKilled metrics is not updated when the container is killed during localizationMajornodemanagerzhihai xuzhihai xu
YARN-2637maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications.CriticalresourcemanagerWangda TanCraig Welch
YARN-2461Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfigurationMinor.Ray ChiangRay Chiang
YARN-2432RMStateStore should process the pending events before closeMajorresourcemanagerVarun SaxenaVarun Saxena
YARN-2414RM web UI: app page will crash if app is failed before any attempt has been createdMajorwebappZhijie ShenWangda Tan
YARN-2356yarn status command for non-existent application/application attempt/container is too verboseMinorclientSunil GSunil G
YARN-2340NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application's and remain in standbyCriticalresourcemanager, schedulerNishan ShettyRohith Sharma K S
YARN-2315FairScheduler: Set current capacity in addition to capacityMajor.zhihai xuzhihai xu
YARN-2246Job History Link in RM UI is redirecting to the URL which contains Job Id twiceMajorwebappDevaraj KDevaraj K
YARN-2243Order of arguments for Preconditions.checkNotNull() is wrong in SchedulerApplicationAttempt ctorMinor.Ted YuDevaraj K
YARN-2230Fix description of yarn.scheduler.maximum-allocation-vcores in yarn-default.xml (or code)Minorclient, documentation, schedulerAdam KawaVijay Bhat
YARN-2136RMStateStore can explicitly handle store/update events when fencedMajor.Jian HeVarun Saxena
YARN-1703Too many connections are opened for proxy server when applicationMaster UI is accessed.Critical.Rohith Sharma K SRohith Sharma K S
YARN-1615Fix typos in description about delay schedulingTrivialdocumentation, schedulerAkira AJISAKAAkira AJISAKA
YARN-1580Documentation error regarding “container-allocation.expiry-interval-ms”TrivialdocumentationGerman Florez-LarrahondoBrahma Reddy Battula
YARN-1453[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc commentsMinor.Andrew PurtellAkira AJISAKA
YARN-1237Description for yarn.nodemanager.aux-services in yarn-default.xml is misleadingMinordocumentationHitesh ShahBrahma Reddy Battula
YARN-933Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVINGMajorresourcemanagerJ.AndreinaRohith Sharma K S
YARN-570Time strings are formated in different timezoneMajorwebappPeng ZhangAkira AJISAKA

TESTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-11535TableMapping related tests failed due to ‘successful’ resolving of invalid test hostnameMinor.Kai ZhengKai Zheng
HADOOP-11432Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2MajorfsLiang XieLiang Xie
HADOOP-11358Tests for encryption/decryption with IV calculation overflowMajorsecurity, testYi LiuYi Liu
HADOOP-11165TestUTF8 fails when run against java 8MinortestTed YuStephen Chu
HADOOP-11125Remove redundant tests in TestOsSecureRandomMajor.Ted YuMasanori Oyama
HADOOP-10668TestZKFailoverControllerStress#testExpireBackAndForth occasionally failsMajortestTed YuMing Ma
HDFS-7914TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in useMajor.Xiaoyu YaoXiaoyu Yao
HDFS-7585Get TestEnhancedByteBufferAccess working on CPU architectures with page sizes other than 4096Majortestsam liusam liu
HDFS-7475Make TestLazyPersistFiles#testLazyPersistBlocksAreSaved deterministicMajortestXiaoyu YaoXiaoyu Yao
HDFS-7448TestBookKeeperHACheckpoints fails in trunk buildMinor.Ted YuAkira AJISAKA
YARN-3070TestRMAdminCLI#testHelp fails for transitionToActive commandMinor.Ted YuJunping Du
YARN-2930TestRMRestart#testRMRestartRecoveringNodeLabelManager sometimes fails against Java 7 & 8Minor.Ted YuWangda Tan
YARN-1979TestDirectoryCollection fails when the umask is unusualMajor.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-1537TestLocalResourcesTrackerImpl.testLocalResourceCache often failedMajornodemanagerHong ShenXuan Gong

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-11796Skip TestShellBasedIdMapping.testStaticMapUpdate on WindowsMinortestXiaoyu YaoXiaoyu Yao
HADOOP-11710Make CryptoOutputStream behave like DFSOutputStream wrt synchronizationCriticalfsSean BusbeySean Busbey
HADOOP-11670Regression: s3a auth setup brokenBlockerfs/s3Adam BuddeAdam Budde
HADOOP-11600Fix up source codes to be compiled with Guava 17.0Major.Tsuyoshi OzawaTsuyoshi Ozawa
HADOOP-11584s3a file block size set to 0 in getFileStatusBlockerfs/s3Dan HechtBrahma Reddy Battula
HADOOP-11570S3AInputStream.close() downloads the remaining bytes of the object from S3Majorfs/s3Dan HechtDan Hecht
HADOOP-11522Update S3A DocumentationMajorfs/s3Thomas DemoorThomas Demoor
HADOOP-11521Make connection timeout configurable in s3aMinorfs/s3Thomas DemoorThomas Demoor
HADOOP-11465Fix findbugs warnings in hadoop-gridmixMajor.Varun SaxenaVarun Saxena
HADOOP-11429Findbugs warnings in hadoop extrasMajor.Varun SaxenaVarun Saxena
HADOOP-11389Clean up byte to string encoding issues in hadoop-commonMajor.Haohui MaiHaohui Mai
HADOOP-11381Fix findbugs warnings in hadoop-distcp, hadoop-aws, hadoop-azure, and hadoop-openstackMajor.Li LuLi Lu
HADOOP-11379Fix new findbugs warnings in hadoop-auth*Major.Li LuLi Lu
HADOOP-11378Fix new findbugs warnings in hadoop-kmsMajor.Li LuLi Lu
HADOOP-11377jdiff failing on java 7 and java 8, “Null.java” not foundMajorbuildSteve LoughranTsuyoshi Ozawa
HADOOP-11372Fix new findbugs warnings in mapreduce-examplesMajor.Li LuLi Lu
HADOOP-11370Fix new findbug warnings hadoop-yarnMajor.Zhijie Shen
HADOOP-11369Fix new findbugs warnings in hadoop-mapreduce-client, non-core directoriesMajor.Li LuLi Lu
HADOOP-11367Fix warnings from findbugs 3.0 in hadoop-streamingMajor.Li LuLi Lu
HADOOP-11317Increment SLF4J version to 1.7.10MajorbuildSteve LoughranTim Robertson
HADOOP-11183Memory-based S3AOutputstreamMajorfs/s3Thomas DemoorThomas Demoor
HADOOP-10651Add ability to restrict service access using IP addresses and hostnamesMajorsecurityBenoy AntonyBenoy Antony
HADOOP-10574Bump the maven plugin versions too -moving the numbers into propertiesMajorbuildSteve LoughranAkira AJISAKA
HADOOP-10482Fix various findbugs warnings in hadoop-commonMajor.Haohui MaiHaohui Mai
HADOOP-10478Fix new findbugs warnings in hadoop-maven-pluginsMajor.Haohui MaiLi Lu
HADOOP-10476Bumping the findbugs version to 3.0.0MajorbuildHaohui MaiHaohui Mai
HDFS-8039Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on WindowsMinortestXiaoyu YaoXiaoyu Yao
HDFS-8038PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format.MinortoolsXiaoyu YaoXiaoyu Yao
HDFS-7954TestBalancer#testBalancerWithPinnedBlocks failed on WindowsMinortestXiaoyu YaoXiaoyu Yao
HDFS-7951Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on LinuxMajortestXiaoyu YaoXiaoyu Yao
HDFS-7950Fix TestFsDatasetImpl#testAddVolumes failure on WindowsMajortestXiaoyu YaoXiaoyu Yao
HDFS-7948TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on WindowsMajortestXiaoyu YaoXiaoyu Yao
HDFS-7946TestDataNodeVolumeFailureReporting NPE on WindowsMajortestXiaoyu YaoXiaoyu Yao
HDFS-7940Add tracing to DFSClient#setQuotaByStorageTypeMajorhdfs-clientRakesh RRakesh R
HDFS-7903Cannot recover block after truncate and delete snapshotBlockerdatanode, namenodeTsz Wo Nicholas SzePlamen Jeliazkov
HDFS-7855Separate class Packet from DFSOutputStreamMajorhdfs-clientLi BoLi Bo
HDFS-7843A truncated file is corrupted after rollback from a rolling upgradeBlockernamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-7838Expose truncate API for libhdfsMajordatanode, namenodeYi LiuYi Liu
HDFS-7824GetContentSummary API and its namenode implementation for Storage Type Quota/UsageMajordatanode, namenodeXiaoyu YaoXiaoyu Yao
HDFS-7819Log WARN message for the blocks which are not in Block ID based layoutMajordatanodeRakesh RRakesh R
HDFS-7814Fix usage string of storageType parameter for “dfsadmin -setSpaceQuota/clrSpaceQuota”Minordatanode, namenodeXiaoyu YaoXiaoyu Yao
HDFS-7811Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsageMinornamenodeXiaoyu YaoXiaoyu Yao
HDFS-7806Refactor: move StorageType from hadoop-hdfs to hadoop-commonMinordatanode, namenodeXiaoyu YaoXiaoyu Yao
HDFS-7776Adding additional unit tests for Quota By Storage TypeMajortestXiaoyu YaoXiaoyu Yao
HDFS-7775Use consistent naming for NN-internal quota related types and functionsMinordatanode, namenodeXiaoyu YaoXiaoyu Yao
HDFS-7760Document truncate for WebHDFS.MinordocumentationYi LiuKonstantin Shvachko
HDFS-7746Add a test randomly mixing append, truncate and snapshotMinortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-7740Test truncate with DataNodes restartingMajortestKonstantin ShvachkoYi Liu
HDFS-7738Add more tests for truncateMinortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-7723Quota By Storage Type namenode implemenationMajornamenodeXiaoyu YaoXiaoyu Yao
HDFS-7720Quota by Storage Type API, tools and ClientNameNode Protocol changesMajordatanode, namenodeXiaoyu YaoXiaoyu Yao
HDFS-7700Document quota support for storage typesMajordocumentationXiaoyu YaoXiaoyu Yao
HDFS-7681Fix ReplicaInputStream constructor to take InputStreamsMajordatanodeJoe PallasJoe Pallas
HDFS-7677DistributedFileSystem#truncate should resolve symlinksMajordatanode, namenodeYi LiuYi Liu
HDFS-7676Fix TestFileTruncate to avoid bug of HDFS-7611MajortestKonstantin ShvachkoKonstantin Shvachko
HDFS-7659We should check the new length of truncate can't be a negative value.Majordatanode, namenodeYi LiuYi Liu
HDFS-7656Expose truncate API for HDFS httpfsMajordatanode, namenodeYi LiuYi Liu
HDFS-7655Expose truncate API for Web HDFSMajordatanode, namenodeYi LiuYi Liu
HDFS-7643Test case to ensure lazy persist files cannot be truncatedMajortestArpit AgarwalYi Liu
HDFS-7638Small fix and few refinements for FSN#truncateMajordatanode, namenodeYi LiuYi Liu
HDFS-7634Disallow truncation of Lazy persist filesMajordatanode, namenodeYi LiuYi Liu
HDFS-7623Add htrace configuration properties to core-default.xml and update user doc about how to enable htraceMajor.Yi LiuYi Liu
HDFS-7589Break the dependency between libnative_mini_dfs and libhdfsMajorlibhdfsZhanwei WangZhanwei Wang
HDFS-7573Consolidate the implementation of delete() into a single classMajor.Haohui MaiHaohui Mai
HDFS-7543Avoid path resolution when getting FileStatus for audit logsMajor.Haohui MaiHaohui Mai
HDFS-7528Consolidate symlink-related implementation into a single classMajor.Haohui MaiHaohui Mai
HDFS-7509Avoid resolving path multiple timesMajor.Jing ZhaoJing Zhao
HDFS-7506Consolidate implementation of setting inode attributes into a single classMajor.Haohui MaiHaohui Mai
HDFS-7498Simplify the logic in INodesInPathMajornamenodeJing ZhaoJing Zhao
HDFS-7486Consolidate XAttr-related implementation into a single classMajor.Haohui MaiHaohui Mai
HDFS-7476Consolidate ACL-related operations to a single classMajornamenodeHaohui MaiHaohui Mai
HDFS-7474Avoid resolving path in FSPermissionCheckerMajornamenodeJing ZhaoJing Zhao
HDFS-7468Moving verify* functions to corresponding classesMajor.Li LuLi Lu
HDFS-7467Provide storage tier information for a directory via fsckMajorbalancer & moverBenoy AntonyBenoy Antony
HDFS-7462Consolidate implementation of mkdirs() into a single classMajor.Haohui MaiHaohui Mai
HDFS-7459Consolidate cache-related implementation in FSNamesystem into a single classMajor.Haohui MaiHaohui Mai
HDFS-7450Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single classMajor.Haohui MaiHaohui Mai
HDFS-7440Consolidate snapshot related operations in a single classMajor.Haohui MaiHaohui Mai
HDFS-7438Consolidate the implementation of rename() into a single classMajor.Haohui MaiHaohui Mai
HDFS-7420Delegate permission checks to FSDirectoryMajor.Haohui MaiHaohui Mai
HDFS-7415Move FSNameSystem.resolvePath() to FSDirectoryMajor.Haohui MaiHaohui Mai
HDFS-7413Some unit tests should use NameNodeProtocols instead of FSNameSystemMajortestHaohui MaiHaohui Mai
HDFS-7412Move RetryCache to NameNodeRpcServerMajor.Haohui MaiHaohui Mai
HDFS-7310Mover can give first priority to local DN if it has target storage type available in local DNMajorbalancer & moverUma Maheswara Rao GVinayakumar B
HDFS-7254Add documentation for hot swaping DataNode drivesMajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-7209Populate EDEK cache when creating encryption zoneMajorencryption, performanceYi LiuYi Liu
HDFS-7189Add trace spans for DFSClient metadata operationsMajordatanode, namenodeColin Patrick McCabeColin Patrick McCabe
HDFS-7058Tests for truncate CLIMajortestKonstantin ShvachkoDasha Boudnik
HDFS-7056Snapshot support for truncateMajornamenodeKonstantin ShvachkoPlamen Jeliazkov
HDFS-7055Add tracing to DFSInputStreamMajordatanode, namenodeColin Patrick McCabeColin Patrick McCabe
HDFS-7054Make DFSOutputStream tracing more fine-grainedMajordatanode, namenodeColin Patrick McCabeColin Patrick McCabe
HDFS-7035Make adding a new data directory to the DataNode an atomic operation and improve error handlingMajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-6877Avoid calling checkDisk when an HDFS volume is removed during a write.MajordatanodeLei (Eddy) XuLei (Eddy) Xu
HDFS-6824Additional user documentation for HDFS encryption.MinordocumentationAndrew WangAndrew Wang
HDFS-6803Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent contextMajorhdfs-clientstackstack
HDFS-6673Add delimited format support to PB OIV toolMinor.Lei (Eddy) XuLei (Eddy) Xu
HDFS-5928show namespace and namenode ID on NN dfshealth pageMajor.Siqi LiSiqi Li
HDFS-5782BlockListAsLongs should take lists of Replicas rather than concrete classesMinordatanodeDavid PowellJoe Pallas
HDFS-5631Expose interfaces required by FsDatasetSpi implementationsMinordatanodeDavid PowellJoe Pallas
HDFS-4266BKJM: Separate write and ack quorumMajorhaIvan KellyRakesh R
HDFS-4265BKJM doesn't take advantage of speculative readsMajorhaIvan KellyRakesh R
YARN-3430RMAppAttempt headroom data is missing in RM Web UIBlockerresourcemanager, webapp, yarnXuan GongXuan Gong
YARN-3379Missing data in localityTable and ResourceRequests table in RM WebUIMajorresourcemanager, webapp, yarnXuan GongXuan Gong
YARN-3300outstanding_resource_requests table should not be shown in AHSMajorresourcemanagerXuan GongXuan Gong
YARN-3265CapacityScheduler deadlock when computing absolute max avail capacity (fix for trunk/branch-2)Blockercapacityscheduler, resourcemanagerWangda TanWangda Tan
YARN-3171Sort by Application id, AppAttempt & ContainerID doesn't work in ATS / RM web uiMinortimelineserverJeff ZhangNaganarasimha G R
YARN-3132RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivatedMajorapi, client, resourcemanagerWangda TanWangda Tan
YARN-3124Capacity Scheduler LeafQueue/ParentQueue should use QueueCapacities to track capacities-by-labelMajorapi, client, resourcemanagerWangda TanWangda Tan
YARN-3122Metrics for container's actual CPU usageMajornodemanagerAnubhav DhootAnubhav Dhoot
YARN-3099Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.Majorapi, client, resourcemanagerWangda TanWangda Tan
YARN-3098Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queuesMajorcapacityschedulerWangda TanWangda Tan
YARN-3092Create common ResourceUsage class to track labeled resource usages in Capacity SchedulerMajorapi, client, resourcemanagerWangda TanWangda Tan
YARN-3076Add API/Implementation to YarnClient to retrieve label-to-node mappingMajorclientVarun SaxenaVarun Saxena
YARN-3075NodeLabelsManager implementation to retrieve label to node mappingMajorresourcemanagerVarun SaxenaVarun Saxena
YARN-3028Better syntax for replaceLabelsOnNode in RMAdmin CLIMajorapi, client, resourcemanagerJian HeRohith Sharma K S
YARN-3019Make work-preserving-recovery the default mechanism for RM recoveryMajorresourcemanagerJian HeJian He
YARN-3014Replaces labels on a host should update all NM's labels on that hostMajor.Wangda TanWangda Tan
YARN-3011NM dies because of the failure of resource localizationMajornodemanagerWang HaoVarun Saxena
YARN-2998Abstract out scheduler independent PlanFollower componentsMajorfairschedulerAnubhav DhootAnubhav Dhoot
YARN-2994Document work-preserving RM restartMajorresourcemanagerJian HeJian He
YARN-2984Metrics for container's actual memory usageMajornodemanagerKarthik KambatlaKarthik Kambatla
YARN-2971RM uses conf instead of token service address to renew timeline delegation tokensMajortimelineserverJonathan EaglesJonathan Eagles
YARN-2970NodeLabel operations in RMAdmin CLI get missing in help command.Minorapi, client, resourcemanagerJunping DuVarun Saxena
YARN-2944InMemorySCMStore can not be instantiated with ReflectionUtils#newInstanceMinor.Chris TrezzoChris Trezzo
YARN-2943Add a node-labels page in RM web UIMajorresourcemanagerWangda TanWangda Tan
YARN-2933Capacity Scheduler preemption policy should only consider capacity without labels temporarilyMajorcapacityschedulerWangda TanMayank Bansal
YARN-2927InMemorySCMStore properties are inconsistentMajor.Ray ChiangRay Chiang
YARN-2924Node to labels mapping should not transfer to lowercase when adding from RMAdminCLIMajorclientWangda TanWangda Tan
YARN-2920CapacityScheduler should be notified when labels on nodes changedMajor.Wangda TanWangda Tan
YARN-2914Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetricsMinor.Ted YuVarun Saxena
YARN-2881Implement PlanFollower for FairSchedulerMajorfairschedulerAnubhav DhootAnubhav Dhoot
YARN-2880Add a test in TestRMRestart to make sure node labels will be recovered if it is enabledMajorresourcemanagerWangda TanRohith Sharma K S
YARN-2807Option “--forceactive” not works as described in usage of “yarn rmadmin -transitionToActive”Minordocumentation, resourcemanagerWangda TanMasatake Iwasaki
YARN-2800Remove MemoryNodeLabelsStore and add a way to enable/disable node labels featureMajorclient, resourcemanagerWangda TanWangda Tan
YARN-2786Create yarn cluster CLI to enable list node labels collectionMajorapi, client, resourcemanagerWangda TanWangda Tan
YARN-2766ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containersMajortimelineserverRobert KanterRobert Kanter
YARN-2765Add leveldb-based implementation for RMStateStoreMajorresourcemanagerJason LoweJason Lowe
YARN-2762RMAdminCLI node-labels-related args should be trimmed and checked before sending to RMMinorresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-2738Add FairReservationSystem for FairSchedulerMajorfairschedulerAnubhav DhootAnubhav Dhoot
YARN-2712TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checksMajorresourcemanagerTsuyoshi OzawaTsuyoshi Ozawa
YARN-2694Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANYMajorcapacityscheduler, resourcemanagerWangda TanWangda Tan
YARN-2690Make ReservationSystem and its dependent classes independent of Scheduler typeMajorfairschedulerAnubhav DhootAnubhav Dhoot
YARN-2683registry config options: document and move to core-defaultMajorapi, resourcemanagerSteve LoughranSteve Loughran
YARN-2616Add CLI client to the registry to list, view and manipulate entriesMajorclientSteve LoughranAkshay Radia
YARN-2543Resource usage should be published to the timeline server as wellMajortimelineserverZhijie ShenNaganarasimha G R
YARN-2404Remove ApplicationAttemptState and ApplicationState class in RMStateStore classMajor.Jian HeTsuyoshi Ozawa
YARN-2375Allow enabling/disabling timeline server per frameworkMajor.Jonathan EaglesMit Desai
YARN-2236Shared Cache uploader service on the Node ManagerMajor.Chris TrezzoChris Trezzo
YARN-2217Shared cache client side changesMajor.Chris TrezzoChris Trezzo
YARN-2203Web UI for cache managerMajor.Chris TrezzoChris Trezzo
YARN-2189Admin service for cache managerMajor.Chris TrezzoChris Trezzo
YARN-2188Client service for cache managerMajor.Chris TrezzoChris Trezzo
YARN-2186Node Manager uploader service for cache managerMajor.Chris TrezzoChris Trezzo
YARN-2183Cleaner service for cache managerMajor.Chris TrezzoChris Trezzo
YARN-2180In-memory backing store for cache managerMajor.Chris TrezzoChris Trezzo
YARN-2179Initial cache manager structure and contextMajor.Chris TrezzoChris Trezzo
YARN-2165Timeline server should validate the numeric configuration valuesMajortimelineserverKaram SinghVasanth kumar RJ
YARN-2079Recover NonAggregatingLogHandler state upon nodemanager restartMajornodemanagerJason LoweJason Lowe
YARN-2056Disable preemption at Queue levelMajorresourcemanagerMayank BansalEric Payne
YARN-1984LeveldbTimelineStore does not handle db exceptions properlyMajor.Jason LoweVarun Saxena
YARN-1904Uniform the XXXXNotFound messages from ClientRMService and ApplicationHistoryClientServiceMajor.Zhijie ShenZhijie Shen
YARN-1884ContainerReport should have nodeHttpAddressMajor.Zhijie ShenXuan Gong
YARN-1809Synchronize RM and Generic History Service Web-UIsMajor.Zhijie ShenXuan Gong
YARN-1723AMRMClientAsync missing blacklist addition and removal functionalityMajor.Bikas SahaBartosz Ługowski
YARN-1514Utility to benchmark ZKRMStateStore#loadState for ResourceManager-HAMajor.Tsuyoshi OzawaTsuyoshi Ozawa

OTHER:

JIRASummaryPriorityComponentReporterContributor
HADOOP-11612Workaround for Curator's ChildReaper requiring Guava 15+Major.Robert KanterRobert Kanter
HADOOP-11489Dropping dependency on io.netty from hadoop-nfs' pom.xmlMinornfsTed YuTed Yu
HADOOP-11463Replace method-local TransferManager object with S3AFileSystem#transfersMajorfs/s3Ted YuTed Yu
HADOOP-9329document native build dependencies in BUILDING.txtTrivialdocumentationColin Patrick McCabeVijay Bhat
HDFS-2486Review issues with UnderReplicatedBlocksMinornamenodeSteve LoughranUma Maheswara Rao G
MAPREDUCE-6264Remove httpclient dependency from hadoop-mapreduce-clientMajor.Akira AJISAKABrahma Reddy Battula
MAPREDUCE-5420Remove mapreduce.task.tmp.dir from mapred-default.xmlMajor.Sandy RyzaJames Carman
YARN-2949Add documentation for CGroupsMajordocumentation, nodemanagerVarun VasudevVarun Vasudev
YARN-2213Change proxy-user cookie log in AmIpFilter to DEBUGMinor.Ted YuVarun Saxena