Apache Hadoop Changelog

Release 2.4.0 - 2014-04-07

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-8691FsShell can print “Found xxx items” unnecessarily oftenMinorfsJason LoweDaryn Sharp
HDFS-6102Lower the default maximum items per directory to fix PB fsimage loadingBlockernamenodeAndrew WangAndrew Wang
HDFS-6055Change default configuration to limit file name length in HDFSMajornamenodeSuresh SrinivasChris Nauroth
HDFS-5804HDFS NFS Gateway fails to mount and proxy when using KerberosMajornfsAbin ShahabAbin Shahab
HDFS-5321Clean up the HTTP-related configuration in HDFSMajor.Haohui MaiHaohui Mai
HDFS-5138Support HDFS upgrade in HABlocker.Kihwal LeeAaron T. Myers
MAPREDUCE-5036Default shuffle handler port should not be 8080Major.Sandy RyzaSandy Ryza

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-10184Hadoop Common changes required to support HDFS ACLs.Majorfs, securityChris NaurothChris Nauroth
HDFS-5535Umbrella jira for improved HDFS rolling upgradesMajordatanode, ha, hdfs-client, namenodeNathan RobertsTsz Wo Nicholas Sze
HDFS-4685Implementation of ACLs in HDFSMajorhdfs-client, namenode, securitySachin JoseChris Nauroth

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-10423Clarify compatibility policy document for combination of new client and old server.MinordocumentationChris NaurothChris Nauroth
HADOOP-10386Log proxy hostname in various exceptions being thrown in a HA setupMinorhaArpit GuptaHaohui Mai
HADOOP-10383InterfaceStability annotations should have RetentionPolicy.RUNTIMEMajor.Enis SoztutarEnis Soztutar
HADOOP-10379Protect authentication cookies with the HttpOnly and Secure flagsMajor.Haohui MaiHaohui Mai
HADOOP-10374InterfaceAudience annotations should have RetentionPolicy.RUNTIMEMajor.Enis SoztutarEnis Soztutar
HADOOP-10348Deprecate hadoop.ssl.configuration in branch-2, and remove it in trunkMajor.Haohui MaiHaohui Mai
HADOOP-10343Change info to debug log in LossyRetryInvocationHandlerMinor.Arpit GuptaArpit Gupta
HADOOP-10333Fix grammatical error in overview.html documentTrivial.René NyffeneggerRené Nyffenegger
HADOOP-10295Allow distcp to automatically identify the checksum type of source files and use it for the targetMajortools/distcpJing ZhaoJing Zhao
HADOOP-10221Add a plugin to specify SaslProperties for RPC protocol based on connection propertiesMajorsecurityBenoy AntonyBenoy Antony
HADOOP-10211Enable RPC protocol to negotiate SASL-QOP values between clients and serversMajorsecurityBenoy AntonyBenoy Antony
HADOOP-10139Update and improve the Single Cluster Setup documentMajordocumentationAkira AJISAKAAkira AJISAKA
HADOOP-9454Support multipart uploads for s3nativeMajorfs/s3Jordan MendelsonAkira AJISAKA
HDFS-6150Add inode id information in the logs to make debugging easierMinornamenodeSuresh SrinivasSuresh Srinivas
HDFS-6138User Guide for how to use viewfs with federationMinordocumentationSanjay RadiaSanjay Radia
HDFS-6123Improve datanode error messagesMinordatanodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-6120Fix and improve safe mode log messagesMajornamenodeArpit AgarwalArpit Agarwal
HDFS-6090Use MiniDFSCluster.Builder instead of deprecated constructorsMinortestAkira AJISAKAAkira AJISAKA
HDFS-6085Improve CacheReplicationMonitor log messages a bitMajornamenodeColin Patrick McCabeColin Patrick McCabe
HDFS-6084Namenode UI - “Hadoop” logo link shouldn't go to hadoop homepageMinornamenodeTravis ThompsonTravis Thompson
HDFS-6080Improve NFS gateway performance by making rtmax and wtmax configurableMajornfs, performanceAbin ShahabAbin Shahab
HDFS-6072Clean up dead code of FSImageMajor.Haohui MaiHaohui Mai
HDFS-6070Cleanup use of ReadStatistics in DFSInputStreamTrivial.Andrew WangAndrew Wang
HDFS-6069Quash stack traces when ACLs are disabledTrivialnamenodeAndrew WangChris Nauroth
HDFS-6044Add property for setting the NFS look up time for usersMinornfsBrandon LiBrandon Li
HDFS-6043Give HDFS daemons NFS3 and Portmap their own OPTSMajornfsBrandon LiBrandon Li
HDFS-6018Exception recorded in LOG when IPCLoggerChannel#close is calledTrivial.Jing ZhaoJing Zhao
HDFS-6006Remove duplicate code in FSNameSystem#getFileInfoTrivialnamenodeAkira AJISAKAAkira AJISAKA
HDFS-5979Typo and logger fix for fsimage PB codeMinor.Andrew WangAndrew Wang
HDFS-5939WebHdfs returns misleading error code and logs nothing if trying to create a file with no DNs in clusterMajorhdfs-clientYongjun ZhangYongjun Zhang
HDFS-5935New Namenode UI FS browser should throw smarter error messagesMinornamenodeTravis ThompsonTravis Thompson
HDFS-5929Add Block pool % usage to HDFS federated nn pageMajorfederationSiqi LiSiqi Li
HDFS-5910Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-textMajorsecurityBenoy AntonyBenoy Antony
HDFS-5908Change AclFeature to capture list of ACL entries in an ImmutableList.MinornamenodeChris NaurothChris Nauroth
HDFS-5781Use an array to record the mapping between FSEditLogOpCode and the corresponding byte valueMinornamenodeJing ZhaoJing Zhao
HDFS-5776Support ‘hedged’ reads in DFSClientMajorhdfs-clientLiang XieLiang Xie
HDFS-5775Consolidate the code for serialization in CacheManagerMajornamenodeHaohui MaiHaohui Mai
HDFS-5768Consolidate the serialization code in DelegationTokenSecretManagerMajornamenodeHaohui MaiHaohui Mai
HDFS-5709Improve NameNode upgrade with existing reserved paths and path componentsMajornamenodeAndrew WangAndrew Wang
HDFS-5698Use protobuf to serialize / deserialize FSImageMajornamenodeHaohui MaiHaohui Mai
HDFS-5318Support read-only and read-write paths to shared replicasMajornamenodeEric Sirianni
HDFS-5153Datanode should send block reports for each storage in a separate messageMajordatanodeArpit AgarwalArpit Agarwal
HDFS-4911Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepaliveMinor.Colin Patrick McCabeColin Patrick McCabe
HDFS-4370Fix typo Blanacer in DataNodeMajordatanodeKonstantin ShvachkoChu Tong
HDFS-4200Reduce the size of synchronized sections in PacketResponderMajordatanodeSuresh SrinivasAndrew Wang
HDFS-3405Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimagesMajor.Aaron T. MyersVinayakumar B
MAPREDUCE-5773Provide dedicated MRAppMaster syslog length limitBlockermr-amGera ShegalovGera Shegalov
MAPREDUCE-5761Add a log message like “encrypted shuffle is ON” in nodemanager logsTrivial.Yesha VoraJian He
MAPREDUCE-5754Preserve Job diagnostics in historyMajorjobhistoryserver, mr-amGera ShegalovGera Shegalov
MAPREDUCE-5732Report proper queue when job has been automatically placedMajor.Sandy RyzaSandy Ryza
MAPREDUCE-5553Add task state filters on Application/MRJob page for MR Application masterMinorapplicationmasterPaul HanPaul Han
MAPREDUCE-2349speed up list[located]status calls from input formatsMajortaskJoydeep Sen SarmaSiddharth Seth
YARN-1789ApplicationSummary does not escape newlines in the app nameMinorresourcemanagerAkira AJISAKATsuyoshi Ozawa
YARN-1771many getFileStatus calls made from node manager for localizing a public distributed cache resourceCriticalnodemanagerSangjin LeeSangjin Lee
YARN-1570Formatting the lines within 80 chars in YarnCommands.apt.vmMinordocumentationAkira AJISAKAAkira AJISAKA
YARN-1536Cleanup: Get rid of ResourceManager#get*SecretManager() methods and use the RMContext methods insteadMinorresourcemanagerKarthik KambatlaAnubhav Dhoot
YARN-1512Enhance CS to decouple scheduling from node heartbeatsMajor.Arun C MurthyArun C Murthy
YARN-1171Add default queue properties to Fair Scheduler documentationMajordocumentation, schedulerSandy RyzaNaren Koneru

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-10450Build zlib native code bindings in hadoop.dll for Windows.Majorio, nativeChris NaurothChris Nauroth
HADOOP-10442Group look-up can cause segmentation fault when certain JNI-based mapping module is used.Blocker.Kihwal LeeKihwal Lee
HADOOP-10441Namenode metric “rpc.RetryCache/NameNodeRetryCache.CacheHit” can't be correctly processed by GangliaBlockermetricsJing ZhaoJing Zhao
HADOOP-10440HarFsInputStream of HarFileSystem, when reading data, computing the position has bugMajorfsguodongdongguodongdong
HADOOP-10425Incompatible behavior of LocalFileSystem:getContentSummaryCriticalfsBrandon LiTsz Wo Nicholas Sze
HADOOP-10422Remove redundant logging of RPC retry attempts.MinoripcChris NaurothChris Nauroth
HADOOP-10395TestCallQueueManager is flakyMinortestArpit AgarwalArpit Agarwal
HADOOP-10394TestAuthenticationFilter is flakyMajortestArpit AgarwalArpit Agarwal
HADOOP-10368InputStream is not closed in VersionInfo ctorMinorutilTed YuTsuyoshi Ozawa
HADOOP-10361Correct alignment in CLI output for ACLs.MinorfsChris NaurothChris Nauroth
HADOOP-10355TestLoadGenerator#testLoadGenerator failsMajor.Akira AJISAKAHaohui Mai
HADOOP-10354TestWebHDFS fails after merge of HDFS-4685 to trunkMajorfsYongjun ZhangChris Nauroth
HADOOP-10353FsUrlStreamHandlerFactory is not thread safeMajorfsTudor ScurtuTudor Scurtu
HADOOP-10352Recursive setfacl erroneously attempts to apply default ACL to files.MajorfsChris NaurothChris Nauroth
HADOOP-10346Deadlock while logging tokensBlockersecurityJason LoweJason Lowe
HADOOP-10338Cannot get the FileStatus of the root inode from the new GlobberMajor.Andrew WangColin Patrick McCabe
HADOOP-10337ConcurrentModificationException from MetricsDynamicMBeanBase.createMBeanInfo()MajormetricsLiang XieLiang Xie
HADOOP-10330TestFrameDecoder fails if it cannot bind port 12345MajortestArpit AgarwalArpit Agarwal
HADOOP-10328loadGenerator exit code is not reliableMajortoolsArpit GuptaHaohui Mai
HADOOP-10327Trunk windows build broken after HDFS-5746BlockernativeVinayakumar BVinayakumar B
HADOOP-10326M/R jobs can not access S3 if Kerberos is enabledMajorsecurityManuel DE FERRANbc Wong
HADOOP-10320Javadoc in InterfaceStability.java lacks final </ul>TrivialdocumentationRené NyffeneggerRené Nyffenegger
HADOOP-10314The ls command help still shows outdated 0.16 format.Major.Kihwal LeeRushabh S Shah
HADOOP-10301AuthenticationFilter should return Forbidden for failed authenticationBlockersecurityDaryn SharpDaryn Sharp
HADOOP-10249LdapGroupsMapping should trim ldap password read from fileMajor.Dilli ArumugamDilli Arumugam
HADOOP-10191Missing executable permission on viewfs internal dirsBlockerviewfsGera ShegalovGera Shegalov
HADOOP-10085CompositeService should allow adding services while being initedBlocker.Karthik KambatlaSteve Loughran
HADOOP-10070RPC client doesn‘t use per-connection conf to determine server’s expected Kerberos principal nameMajorsecurityAaron T. MyersAaron T. Myers
HADOOP-10015UserGroupInformation prints out excessive ERROR warningsMinorsecurityHaohui MaiNicolas Liochon
HDFS-6237TestDFSShell#testGet fails on Windows due to invalid file system path.Trivialhdfs-client, testChris NaurothChris Nauroth
HDFS-6166revisit balancer so_timeoutBlockerbalancer & moverNathan RobertsNathan Roberts
HDFS-6163Fix a minor bug in the HA upgrade documentMinordocumentationFengdong YuFengdong Yu
HDFS-6157Fix the entry point of OfflineImageViewer for hdfs.cmdMajor.Haohui MaiHaohui Mai
HDFS-6140WebHDFS cannot create a file with spaces in the name after HA failover changes.MajorwebhdfsChris NaurothChris Nauroth
HDFS-6135In HDFS upgrade with HA setup, JournalNode cannot handle layout version bump when rolling backBlockerjournal-nodeJing ZhaoJing Zhao
HDFS-6131Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFSMajordocumentationJing ZhaoJing Zhao
HDFS-6130NPE when upgrading namenode from fsimages older than -32BlockernamenodeFengdong YuHaohui Mai
HDFS-6129When a replica is not found for deletion, do not throw exception.MinordatanodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-6127WebHDFS tokens cannot be renewed in HA setupMajorhaArpit GuptaHaohui Mai
HDFS-6117Print file path information in FileNotFoundExceptionMinornamenodeSuresh SrinivasSuresh Srinivas
HDFS-6115flush() should be called for every append on block scan verification logMinordatanodeVinayakumar BVinayakumar B
HDFS-6107When a block can't be cached due to limited space on the DataNode, that block becomes uncacheableMajordatanodeColin Patrick McCabeColin Patrick McCabe
HDFS-6106Reduce default for dfs.namenode.path.based.cache.refresh.interval.msMajor.Colin Patrick McCabeColin Patrick McCabe
HDFS-6105NN web UI for DN list loads the same jmx page multiple times.Major.Kihwal LeeHaohui Mai
HDFS-6100DataNodeWebHdfsMethods does not failover in HA modeMajorhaArpit GuptaHaohui Mai
HDFS-6099HDFS file system limits not enforced on renames.MajornamenodeChris NaurothChris Nauroth
HDFS-6097zero-copy reads are incorrectly disabled on file offsets above 2GBMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-6096TestWebHdfsTokens may timeoutMinortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-6094The same block can be counted twice towards safe mode thresholdMajornamenodeArpit AgarwalArpit Agarwal
HDFS-6089Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspendedMajorhaArpit GuptaJing Zhao
HDFS-6079Timeout for getFileBlockStorageLocations does not workMajorhdfs-clientAndrew WangAndrew Wang
HDFS-6078TestIncrementalBlockReports is flakyMinortestArpit AgarwalArpit Agarwal
HDFS-6077running slive with webhdfs on secure HA cluster fails with unkown host exceptionMajor.Arpit GuptaJing Zhao
HDFS-6071BlockReaderLocal doesn't return -1 on EOF when doing a zero-length read on a short fileMajor.Colin Patrick McCabeColin Patrick McCabe
HDFS-6068Disallow snapshot names that are also invalid directory namesMajorsnapshotsAndrew Wangsathish
HDFS-6067TestPread.testMaxOutHedgedReadPool is flakyMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-6065HDFS zero-copy reads should return null on EOF when doing ZCRMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-6064DFSConfigKeys.DFS_BLOCKREPORT_INTERVAL_MSEC_DEFAULT is not updated with latest block report interval of 6 hrsMinordatanodeVinayakumar BVinayakumar B
HDFS-6063TestAclCLI fails intermittently when running test 24: copyFromLocalMinortest, toolsColin Patrick McCabeChris Nauroth
HDFS-6062TestRetryCacheWithHA#testConcat is flakyMinor.Jing ZhaoJing Zhao
HDFS-6059TestBlockReaderLocal fails if native library is not availableMajor.Akira AJISAKAAkira AJISAKA
HDFS-6058Fix TestHDFSCLI failures after HADOOP-8691 changeMajor.Vinayakumar BHaohui Mai
HDFS-6057DomainSocketWatcher.watcherThread should be marked as daemon threadBlockerhdfs-clientEric SirianniColin Patrick McCabe
HDFS-6053Fix TestDecommissioningStatus and TestDecommission in branch-2MajornamenodeJing ZhaoJing Zhao
HDFS-6051HDFS cannot run on Windows since short-circuit shared memory segment changes.Blockerhdfs-clientChris NaurothColin Patrick McCabe
HDFS-6047TestPread NPE inside in DFSInputStream hedgedFetchBlockByteRangeMajor.stackstack
HDFS-6039Uploading a File under a Dir with default acls throws “Duplicated ACLFeature”MajornamenodeYesha VoraChris Nauroth
HDFS-6033PBImageXmlWriter incorrectly handles processing cache directivesMajorcachingAaron T. MyersAaron T. Myers
HDFS-6028Print clearer error message when user attempts to delete required mask entry from ACL.TrivialnamenodeChris NaurothChris Nauroth
HDFS-6008Namenode dead node link is giving HTTP error 500MinornamenodeBenoy AntonyBenoy Antony
HDFS-5988Bad fsimage always generated after upgradeBlockernamenodeAndrew WangAndrew Wang
HDFS-5982Need to update snapshot manager when applying editlog for deleting a snapshottable directoryCriticalnamenodeTassapol AthiapinyaJing Zhao
HDFS-5981PBImageXmlWriter generates malformed XMLMinortoolsHaohui MaiHaohui Mai
HDFS-5962Mtime and atime are not persisted for symbolic linksCritical.Kihwal LeeAkira AJISAKA
HDFS-5961OIV cannot load fsimages containing a symbolic linkCritical.Kihwal LeeKihwal Lee
HDFS-5959Fix typo at section name in FSImageFormatProtobuf.javaMinor.Akira AJISAKAAkira AJISAKA
HDFS-5949New Namenode UI when trying to download a file, the browser doesn't know the file nameMinornamenodeTravis ThompsonTravis Thompson
HDFS-5948TestBackupNode flakes with port in use errorMajor.Andrew WangHaohui Mai
HDFS-5944LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ right and cause SecondaryNameNode failed do checkpointMajornamenodezhaoyunjiongzhaoyunjiong
HDFS-5943‘dfs.namenode.https-address.ns1’ property is not used in federation setupMajor.Yesha VoraSuresh Srinivas
HDFS-5941add dfs.namenode.secondary.https-address and dfs.namenode.secondary.https-address in hdfs-default.xmlMajordocumentation, namenodeHaohui MaiHaohui Mai
HDFS-5934New Namenode UI back button doesn't work as expectedMinornamenodeTravis ThompsonTravis Thompson
HDFS-5922DN heartbeat thread can get stuck in tight loopMajordatanodeAaron T. MyersArpit Agarwal
HDFS-5915Refactor FSImageFormatProtobuf to simplify cross section readsMajornamenodeHaohui MaiHaohui Mai
HDFS-5913Nfs3Utils#getWccAttr() should check attr parameter against nullMinornfsTed YuBrandon Li
HDFS-5904TestFileStatus fails intermittently on trunk and branch2Major.Mit DesaiMit Desai
HDFS-5901NameNode new UI doesn't support IE8 and IE9 on windows 7MajornamenodeVinayakumar BVinayakumar B
HDFS-5900Cannot set cache pool limit of “unlimited” via CacheAdminMajorcachingTassapol AthiapinyaAndrew Wang
HDFS-5895HDFS cacheadmin -listPools has exit_code of 1 when the command returns 0 result.MajortoolsTassapol AthiapinyaTassapol Athiapinya
HDFS-5893HftpFileSystem.RangeHeaderUrlOpener uses the default URLConnectionFactory which does not import SSL certificatesMajor.Yesha VoraHaohui Mai
HDFS-5891webhdfs should not try connecting the DN during redirectionMajornamenode, webhdfsHaohui MaiHaohui Mai
HDFS-5886Potential null pointer deference in RpcProgramNfs3#readlink()MajornfsTed YuBrandon Li
HDFS-5881Fix skip() of the short-circuit local reader (legacy).Critical.Kihwal LeeKihwal Lee
HDFS-5879Some TestHftpFileSystem tests do not close streamsMajortestGera ShegalovGera Shegalov
HDFS-5859DataNode#checkBlockToken should check block tokens even if security is not enabledMajordatanodeColin Patrick McCabeColin Patrick McCabe
HDFS-5857TestWebHDFS#testNamenodeRestart fails intermittently with NPEMajor.Mit DesaiMit Desai
HDFS-5856DataNode.checkDiskError might throw NPEMinordatanodeJosh ElserJosh Elser
HDFS-5846Assigning DEFAULT_RACK in resolveNetworkLocation method can break data resiliencyMajornamenodeNikola VujicNikola Vujic
HDFS-5843DFSClient.getFileChecksum() throws IOException if checksum is disabledMajordatanodeLaurent GoujonLaurent Goujon
HDFS-5840Follow-up to HDFS-5138 to improve error handling during partial upgrade failuresBlockerha, journal-node, namenodeAaron T. MyersJing Zhao
HDFS-5828BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is trueMajornamenodeTaylor, BuddyTaylor, Buddy
HDFS-5821TestHDFSCLI fails for user names with the dash characterMajortestGera ShegalovGera Shegalov
HDFS-5807TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails intermittently on Branch-2MajortestMit DesaiChen He
HDFS-5803TestBalancer.testBalancer0 failsMajor.Mit DesaiChen He
HDFS-5791TestHttpsFileSystem should use a random port to avoid binding error during testingMajortestBrandon LiHaohui Mai
HDFS-5790LeaseManager.findPath is very slow when many leases need recoveryMajornamenode, performanceTodd LipconTodd Lipcon
HDFS-5780TestRBWBlockInvalidation times out intemittently on branch-2Major.Mit DesaiMit Desai
HDFS-5767NFS implementation assumes userName userId mapping to be unique, which is not true sometimesBlockernfsYongjun ZhangYongjun Zhang
HDFS-5759Web UI does not show up during the period of loading FSImageMajor.Haohui MaiHaohui Mai
HDFS-5742DatanodeCluster (mini cluster of DNs) fails to startMinortestArpit AgarwalArpit Agarwal
HDFS-5716Allow WebHDFS to use pluggable authentication filterMajorwebhdfsHaohui MaiHaohui Mai
HDFS-5705TestSecondaryNameNodeUpgrade#testChangeNsIDFails may fail due to ConcurrentModificationExceptionMajordatanodeTed YuTed Yu
HDFS-5626dfsadmin -report shows incorrect cache valuesMajorcachingStephen ChuColin Patrick McCabe
HDFS-5516WebHDFS does not require user name when anonymous http requests are disallowed.MajorwebhdfsChris NaurothMiodrag Radulovic
HDFS-5492Port HDFS-2069 (Incorrect default trash interval in the docs) to trunkMinordocumentationAkira AJISAKAAkira AJISAKA
HDFS-5339WebHDFS URI does not accept logical nameservices when security is enabledMajorwebhdfsStephen ChuHaohui Mai
HDFS-5244TestNNStorageRetentionManager#testPurgeMultipleDirs failsMajortestJinghui WangJinghui Wang
HDFS-5064Standby checkpoints should not block concurrent readersMajorha, namenodeAaron T. MyersAaron T. Myers
HDFS-4858HDFS DataNode to NameNode RPC should timeoutMinordatanodeJagane SundarHenry Wang
HDFS-3969Small bug fixes and improvements for disk locations APIMajorhdfs-clientTodd LipconTodd Lipcon
HDFS-3128Unit tests should not use a test root in /tmpMinortestEli CollinsAndrew Wang
MAPREDUCE-5813YarnChild does not load job.xml with mapreduce.job.classloader=trueBlockermrv2, taskGera ShegalovGera Shegalov
MAPREDUCE-5810TestStreamingTaskLog#testStreamingTaskLogWithHadoopCmd is failingMajorcontrib/streamingMit DesaiAkira AJISAKA
MAPREDUCE-5806Log4j settings in container-log4j.properties cannot be overriddenMajor.Eugene KoifmanVarun Vasudev
MAPREDUCE-5805Unable to parse launch time from job history fileMajorjobhistoryserverFengdong YuAkira AJISAKA
MAPREDUCE-5795Job should be marked as Failed if it is recovered from commit.Major.Yesha VoraXuan Gong
MAPREDUCE-5794SliveMapper always uses default FileSystem.MinortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
MAPREDUCE-5791Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficientlyMajorclientNikola VujicNikola Vujic
MAPREDUCE-5789Average Reduce time is incorrect on Job Overview pageMajorjobhistoryserver, webappsRushabh S ShahRushabh S Shah
MAPREDUCE-5780SliveTest always uses default FileSystemMinortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
MAPREDUCE-5778JobSummary does not escape newlines in the job nameMajorjobhistoryserverJason LoweAkira AJISAKA
MAPREDUCE-5770Redirection from AM-URL is broken with HTTPS_ONLY policyMajor.Yesha VoraJian He
MAPREDUCE-5769Unregistration to RM should not be called if AM is crashed before registering with RMMajor.Rohith Sharma K SRohith Sharma K S
MAPREDUCE-5768TestMRJobs.testContainerRollingLog fails on trunkMajor.Zhijie ShenGera Shegalov
MAPREDUCE-5766Ping messages from attempts should be moved to DEBUGMinorapplicationmasterRamya SunilJian He
MAPREDUCE-5757ConcurrentModificationException in JobControl.toListMajorclientJason LoweJason Lowe
MAPREDUCE-5751MR app master fails to start in some cases if mapreduce.job.classloader is trueMajor.Sangjin LeeSangjin Lee
MAPREDUCE-5746Job diagnostics can implicate wrong task for a failed jobMajorjobhistoryserverJason LoweJason Lowe
MAPREDUCE-5699Allow setting tags on MR jobsMajorapplicationmasterKarthik KambatlaKarthik Kambatla
MAPREDUCE-5688TestStagingCleanup fails intermittently with JDK7Major.Mit DesaiMit Desai
MAPREDUCE-5670CombineFileRecordReader should report progress when moving to the next fileMinormrv2Jason LoweChen He
MAPREDUCE-5570Map task attempt with fetch failure has incorrect attempt finish timeMajormr-am, mrv2Jason LoweRushabh S Shah
MAPREDUCE-5028Maps fail when io.sort.mb is set to high valueCritical.Karthik KambatlaKarthik Kambatla
MAPREDUCE-4052Windows eclipse cannot submit job from Windows client to Linux/Unix Hadoop cluster.Majorjob submissionxieguimingJian He
YARN-1873TestDistributedShell#testDSShell fails when the test cases are out of orderMajor.Mit DesaiMit Desai
YARN-1867NPE while fetching apps via the REST APIBlockerresourcemanagerKarthik KambatlaVinod Kumar Vavilapalli
YARN-1866YARN RM fails to load state store with delegation token parsing errorBlocker.Arpit GuptaJian He
YARN-1859WebAppProxyServlet will throw ApplicationNotFoundException if the app is no longer cached in RMMajor.Zhijie ShenZhijie Shen
YARN-1852Application recovery throws InvalidStateTransitonException for FAILED and KILLED jobsMajorresourcemanagerRohith Sharma K SRohith Sharma K S
YARN-1849NPE in ResourceTrackerService#registerNodeManager for UAMBlockerresourcemanagerKarthik KambatlaKarthik Kambatla
YARN-1846TestRM#testNMTokenSentForNormalContainer assumes CapacitySchedulerMajor.Robert KanterRobert Kanter
YARN-1839Capacity scheduler preempts an AM out. AM attempt 2 fails to launch task container with SecretManager$InvalidToken: No NMToken sentCriticalapplications, capacityschedulerTassapol AthiapinyaJian He
YARN-1833TestRMAdminService Fails in trunk and branch-2 : Assert Fails due to different count of UserGroups for currentUser()Major.Mit DesaiMit Desai
YARN-1830TestRMRestart.testQueueMetricsOnRMRestart failureMajorresourcemanagerKarthik KambatlaZhijie Shen
YARN-1824Make Windows client work with Linux/Unix clusterMajor.Jian HeJian He
YARN-1793yarn application -kill doesn't kill UnmanagedAMsCriticalresourcemanagerKarthik KambatlaKarthik Kambatla
YARN-1788AppsCompleted/AppsKilled metric is incorrect when MR job is killed with yarn application -killCriticalresourcemanagerTassapol AthiapinyaVarun Vasudev
YARN-1785FairScheduler treats app lookup failures as ERRORsMajor.bc Wongbc Wong
YARN-1783yarn application does not make any progress even when no other application is running when RM is being restarted in the backgroundCritical.Arpit GuptaJian He
YARN-1774FS: Submitting to non-leaf queue throws NPEBlockerfairschedulerAnubhav DhootAnubhav Dhoot
YARN-1768yarn kill non-existent application is too verboseMinorclientHitesh ShahTsuyoshi Ozawa
YARN-1760TestRMAdminService assumes CapacitySchedulerTrivial.Karthik KambatlaKarthik Kambatla
YARN-1758MiniYARNCluster broken post YARN-1666Blocker.Hitesh ShahXuan Gong
YARN-1752Unexpected Unregistered event at Attempt Launched stateMajor.Jian HeRohith Sharma K S
YARN-1748hadoop-yarn-server-tests packages core-site.xml breaking downstream testsBlocker.Sravya TirukkovalurSravya Tirukkovalur
YARN-1742Fix javadoc of parameter DEFAULT_NM_MIN_HEALTHY_DISKS_FRACTIONTrivialdocumentationAkira AJISAKAAkira AJISAKA
YARN-1724Race condition in Fair Scheduler when continuous scheduling is turned onCriticalschedulerSandy RyzaSandy Ryza
YARN-1721When moving app between queues in Fair Scheduler, grab lock on FSSchedulerAppCriticalschedulerSandy RyzaSandy Ryza
YARN-1697NodeManager reports negative running containersMajornodemanagerSandy RyzaSandy Ryza
YARN-1692ConcurrentModificationException in fair scheduler AppSchedulableMajorschedulerSangjin LeeSangjin Lee
YARN-1689RMAppAttempt is not killed when RMApp is at ACCEPTEDCriticalresourcemanagerDeepesh KhandelwalVinod Kumar Vavilapalli
YARN-1686NodeManager.resyncWithRM() does not handle exception which cause NodeManger to Hang.MajornodemanagerRohith Sharma K SRohith Sharma K S
YARN-1673Valid yarn kill application prints out help message.BlockerclientTassapol AthiapinyaMayank Bansal
YARN-1672YarnConfiguration is missing a default for yarn.nodemanager.log.retain-secondsTrivialnodemanagerKarthik KambatlaNaren Koneru
YARN-1670aggregated log writer can write more log data then it says is the log lengthCritical.Thomas GravesMit Desai
YARN-1661AppMaster logs says failing even if an application does succeed.Majorapplications/distributed-shellTassapol AthiapinyaVinod Kumar Vavilapalli
YARN-1632TestApplicationMasterServices should be under org.apache.hadoop.yarn.server.resourcemanager packageMinor.Chen HeChen He
YARN-1617Remove ancient comment and surround LOG.debug in AppSchedulingInfo.allocateMajorschedulerSandy RyzaSandy Ryza
YARN-1591TestResourceTrackerService fails randomly on trunkMajor.Vinod Kumar VavilapalliTsuyoshi Ozawa
YARN-1590_HOST doesn't expand properly for RM, NM, ProxyServer and JHSMajorresourcemanagerMohammad Kamrul IslamMohammad Kamrul Islam
YARN-1553Do not use HttpConfig.isSecure() in YARNMajor.Haohui MaiHaohui Mai
YARN-1531True up yarn command documentationMajordocumentationAkira AJISAKAAkira AJISAKA
YARN-1528Allow setting auth for ZK connectionsBlockerresourcemanagerKarthik KambatlaKarthik Kambatla
YARN-1470Add audience annotation to MiniYARNClusterMajor.Sandy RyzaAnubhav Dhoot
YARN-1444RM crashes when node resource request sent without corresponding off-switch requestBlockerclient, resourcemanagerRobert GrandlWangda Tan
YARN-1417RM may issue expired container tokens to AM while issuing new containers.Blocker.Omkar Vinit JoshiJian He
YARN-1398Deadlock in capacity scheduler leaf queue and parent queue for getQueueInfo and completedContainer callBlockerresourcemanagerSunil GVinod Kumar Vavilapalli
YARN-1301Need to log the blacklist additions/removals when YarnSchedule#allocateMinor.Zhijie ShenTsuyoshi Ozawa
YARN-1285Inconsistency of default “yarn.acl.enable” valueMajor.Zhijie ShenKenji Kikushima
YARN-1206AM container log link broken on NM web pageBlocker.Jian HeRohith Sharma K S
YARN-1166YARN ‘appsFailed’ metric should be of type ‘counter’BlockerresourcemanagerSrimanth GunturiZhijie Shen
YARN-1071ResourceManager's decommissioned and lost node count is 0 after restartMajorresourcemanagerSrimanth GunturiJian He
YARN-713ResourceManager can exit unexpectedly if DNS is unavailableCriticalresourcemanagerJason LoweJian He

TESTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-9525Add tests that validate winutils chmod behavior on foldersMajortest, utilIvan MiticIvan Mitic
HDFS-5953TestBlockReaderFactory fails if libhadoop.so has not been builtMajor.Ted YuAkira AJISAKA
HDFS-5936MiniDFSCluster does not clean data left behind by SecondaryNameNode.Majornamenode, testAndrew WangBinglin Chang
HDFS-5882TestAuditLogs is flakyMinor.Jimmy XiangJimmy Xiang
HDFS-5672TestHASafeMode#testSafeBlockTracking fails in trunkMajornamenodeTed YuJing Zhao
YARN-1863TestRMFailover fails with ‘AssertionError: null’Blocker.Ted YuXuan Gong
YARN-1855TestRMFailover#testRMWebAppRedirect fails in trunkCritical.Ted YuZhijie Shen
YARN-1854Race condition in TestRMHA#testStartAndTransitionsBlocker.Mit DesaiRohith Sharma K S

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-10449Fix the javac warnings in the security packages.MinorsecurityTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-10437Fix the javac warnings in the conf and the util packageMinorconf, utilTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-10407Fix the javac warnings in the ipc package.MinoripcTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-10399FileContext API for ACLs.MajorfsChris NaurothVinayakumar B
HADOOP-10393Fix hadoop-auth javac warningsMinorsecurityTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-10285Admin interface to swap callqueue at runtimeMajor.Chris LiChris Li
HADOOP-10280Make Schedulables return a configurable identity of user or groupMajor.Chris LiChris Li
HADOOP-10278Refactor to make CallQueue pluggableMajoripcChris LiChris Li
HDFS-6124Add final modifier to class membersMajor.Suresh SrinivasSuresh Srinivas
HDFS-6086Fix a case where zero-copy or no-checksum reads were not allowed even when the block was cachedMajordatanodeColin Patrick McCabeColin Patrick McCabe
HDFS-6076SimulatedDataSet should not create DatanodeRegistration with namenode layout version and typeMinordatanode, testTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-6061Allow dfs.datanode.shared.file.descriptor.path to contain multiple entries and fall back when neededMajordatanodeColin Patrick McCabeColin Patrick McCabe
HDFS-6060NameNode should not check DataNode layout versionMajornamenodeBrandon LiBrandon Li
HDFS-6046add dfs.client.mmap.enabledMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-6040fix DFSClient issue without libhadoop.so and some other ShortCircuitShm cleanupsBlockerhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-6038Allow JournalNode to handle editlog produced by new release with future layoutversionMajorjournal-node, namenodeHaohui MaiJing Zhao
HDFS-5986Capture the number of blocks pending deletion on namenode webUIMajornamenodeSuresh SrinivasChris Nauroth
HDFS-5973add DomainSocket#shutdown methodMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-5956A file size is multiplied by the replication factor in ‘hdfs oiv -p FileDistribution’ optionMajortoolsAkira AJISAKAAkira AJISAKA
HDFS-5950The DFSClient and DataNode should use shared memory segments to communicate short-circuit informationMajordatanode, hdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-5942Fix javadoc in OfflineImageViewerMinordocumentation, toolsAkira AJISAKAAkira AJISAKA
HDFS-5940Minor cleanups to ShortCircuitReplica, FsDatasetCache, and DomainSocketWatcherMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-5938Make BlockReaderFactory#BlockReaderPeer a static classTrivialhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-5898Allow NFS gateway to login/relogin from its kerberos keytabMajornfsJing ZhaoAbin Shahab
HDFS-5868Make hsync implementation pluggableMajordatanodeTaylor, BuddyTaylor, Buddy
HDFS-5866‘-maxSize’ and ‘-step’ option fail in OfflineImageViewerMajortoolsAkira AJISAKAAkira AJISAKA
HDFS-5847Consolidate INodeReference into a separate sectionMajor.Haohui MaiJing Zhao
HDFS-5810Unify mmap cache and short-circuit file descriptor cacheMajorhdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-5746add ShortCircuitSharedMemorySegmentMajordatanode, hdfs-clientColin Patrick McCabeColin Patrick McCabe
HDFS-5726Fix compilation error in AbstractINodeDiff for JDK7MinornamenodeJing ZhaoJing Zhao
HDFS-5715Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiffMajornamenodeJing ZhaoJing Zhao
HDFS-5647Merge INodeDirectory.Feature and INodeFile.FeatureMajornamenodeHaohui MaiHaohui Mai
HDFS-5638HDFS implementation of FileContext API for ACLs.Majorhdfs-clientChris NaurothVinayakumar B
HDFS-5632Add Snapshot feature to INodeDirectoryMajornamenodeJing ZhaoJing Zhao
HDFS-5623NameNode: add tests for skipping ACL enforcement when permission checks are disabled, user is superuser or user is member of supergroup.MajornamenodeChris NaurothChris Nauroth
HDFS-5554Add Snapshot Feature to INodeFileMajornamenodeJing ZhaoJing Zhao
HDFS-5537Remove FileWithSnapshot interfaceMajornamenode, snapshotsJing ZhaoJing Zhao
HDFS-5531Combine the getNsQuota() and getDsQuota() methods in INodeMinornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-5483NN should gracefully handle multiple block replicas on same DNMajornamenodeArpit AgarwalArpit Agarwal
HDFS-5286Flatten INodeDirectory hierarchy: add DirectoryWithQuotaFeatureMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-5285Flatten INodeFile hierarchy: Add UnderContruction FeatureMajornamenodeTsz Wo Nicholas SzeJing Zhao
HDFS-5167Add metrics about the NameNode retry cacheMinorha, namenodeJing ZhaoTsuyoshi Ozawa
HDFS-4564Webhdfs returns incorrect http response codes for denied operationsBlockerwebhdfsDaryn SharpDaryn Sharp
MAPREDUCE-5787Modify ShuffleHandler to support Keep-AliveCriticalnodemanagerRajesh BalamohanRajesh Balamohan
YARN-1893Make ApplicationMasterProtocol#allocate AtMostOnceBlockerresourcemanagerXuan GongXuan Gong
YARN-1850Make enabling timeline service configurableMajor.Zhijie ShenZhijie Shen
YARN-1838Timeline service getEntities API should provide ability to get entities from given idMajor.Srimanth GunturiBillie Rinaldi
YARN-1821NPE on registerNodeManager if the request has containers for UnmanagedAMsBlockerresourcemanagerKarthik KambatlaKarthik Kambatla
YARN-1816Succeeded application remains in accepted after RM restartMajor.Arpit GuptaJian He
YARN-1812Job stays in PREP state for long time after RM RestartsMajor.Yesha VoraJian He
YARN-1811RM HA: AM link broken if the AM is on nodes other than RMMajorresourcemanagerRobert KanterRobert Kanter
YARN-1800YARN NodeManager with java.util.concurrent.RejectedExecutionExceptionCriticalnodemanagerPaul IsaychukVarun Vasudev
YARN-1787yarn applicationattempt/container print wrong usage informationMajor.Zhijie ShenZhijie Shen
YARN-1781NM should allow users to specify max disk utilization for local disksMajornodemanagerVarun VasudevVarun Vasudev
YARN-1780Improve logging in timeline serviceMajor.Zhijie ShenZhijie Shen
YARN-1776renewDelegationToken should survive RM failoverMajor.Zhijie ShenZhijie Shen
YARN-1775Create SMAPBasedProcessTree to get PSS informationMajornodemanagerRajesh BalamohanRajesh Balamohan
YARN-1766When RM does the initiation, it should use loaded Configuration instead of bootstrap configuration.Major.Xuan GongXuan Gong
YARN-1765Write test cases to verify that killApplication API works in RM HAMajor.Xuan GongXuan Gong
YARN-1764Handle RM fail overs after the submitApplication call.Major.Xuan GongXuan Gong
YARN-1761RMAdminCLI should check whether HA is enabled before executes transitionToActive/transitionToStandbyMajor.Xuan GongXuan Gong
YARN-1749Review AHS configs and sync them up with the timeline-service configsMajor.Zhijie ShenZhijie Shen
YARN-1734RM should get the updated Configurations when it transits from Standby to ActiveCritical.Xuan GongXuan Gong
YARN-1732Change types of related entities and primary filters in ATSEntityMajor.Billie RinaldiBillie Rinaldi
YARN-1730Leveldb timeline store needs simple write lockingMajor.Billie RinaldiBillie Rinaldi
YARN-1729TimelineWebServices always passes primary and secondary filters as stringsMajor.Billie RinaldiBillie Rinaldi
YARN-1719ATSWebServices produces jersey warningsMajor.Billie RinaldiBillie Rinaldi
YARN-1717Enable offline deletion of entries in leveldb timeline storeMajor.Billie RinaldiBillie Rinaldi
YARN-1706Create an utility function to dump timeline records to jsonMajor.Zhijie ShenZhijie Shen
YARN-1705Reset cluster-metrics on transition to standbyMajorresourcemanagerKarthik KambatlaRohith Sharma K S
YARN-1704Review LICENSE and NOTICE to reflect new levelDB releated libraries being usedBlocker.Billie RinaldiBillie Rinaldi
YARN-1698Replace MemoryApplicationTimelineStore with LeveldbApplicationTimelineStore as defaultMajor.Zhijie ShenZhijie Shen
YARN-1690Sending timeline entities+events from Distributed shellMajor.Mayank BansalMayank Bansal
YARN-1687Refactoring timeline classes to remove “app” related wordsMajor.Zhijie ShenZhijie Shen
YARN-1685Bugs around log URLMajor.Mayank BansalZhijie Shen
YARN-1684Fix history server heap size in yarn scriptMajor.Billie RinaldiBillie Rinaldi
YARN-1676Make admin refreshUserToGroupsMappings of configuration work across RM failoverMajor.Xuan GongXuan Gong
YARN-1669Make admin refreshServiceAcls work across RM failoverMajor.Xuan GongXuan Gong
YARN-1668Make admin refreshAdminAcls work across RM failoverMajor.Xuan GongXuan Gong
YARN-1667Make admin refreshSuperUserGroupsConfiguration work across RM failoverMajor.Xuan GongXuan Gong
YARN-1666Make admin refreshNodes work across RM failoverMajor.Xuan GongXuan Gong
YARN-1665Set better defaults for HA configs for automatic failoverMajorresourcemanagerArpit GuptaXuan Gong
YARN-1660add the ability to set yarn.resourcemanager.hostname.rm-id instead of setting all the various host:port properties for RMMajorresourcemanagerArpit GuptaXuan Gong
YARN-1659Define the ApplicationTimelineStore store as an abstraction for implementing different storage impls for storing timeline informationMajor.Billie RinaldiBillie Rinaldi
YARN-1658Webservice should redirect to active RM when HA is enabled.Major.Cindy LiCindy Li
YARN-1641ZK store should attempt a write periodically to ensure it is still ActiveMajorresourcemanagerKarthik KambatlaKarthik Kambatla
YARN-1640Manual Failover does not work in secure clustersBlocker.Xuan GongXuan Gong
YARN-1639YARM RM HA requires different configs on different RM hostsMajorresourcemanagerArpit GuptaXuan Gong
YARN-1637Implement a client library for java users to post entities+eventsMajor.Vinod Kumar VavilapalliZhijie Shen
YARN-1636Implement timeline related web-services inside AHS for storing and retrieving entities+eventsMajor.Vinod Kumar VavilapalliZhijie Shen
YARN-1635Implement a Leveldb based ApplicationTimelineStoreMajor.Vinod Kumar VavilapalliBillie Rinaldi
YARN-1634Define an in-memory implementation of ApplicationTimelineStoreMajor.Vinod Kumar VavilapalliZhijie Shen
YARN-1633Define user-faced entity, entity-info and event objectsMajor.Vinod Kumar VavilapalliZhijie Shen
YARN-1625mvn apache-rat:check outputs warning message in YARN-321 branchTrivial.Shinichi YamashitaShinichi Yamashita
YARN-1613Fix config name YARN_HISTORY_SERVICE_ENABLEDMajor.Zhijie ShenAkira AJISAKA
YARN-1611Make admin refresh of capacity scheduler configuration work across RM failoverMajor.Xuan GongXuan Gong
YARN-1605Fix formatting issues with new module in YARN-321 branchMajor.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-1597FindBugs warnings on YARN-321 branchMajor.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-1596Javadoc failures on YARN-321 branchMajor.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-1595Test failures on YARN-321 branchMajor.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-1594YARN-321 branch needs to be updated after YARN-888 pom changesMajor.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-1588Rebind NM tokens for previous attempt's running containers to the new attemptMajor.Jian HeJian He
YARN-1587[YARN-321] Merge Patch for YARN-321Major.Mayank BansalVinod Kumar Vavilapalli
YARN-1578Fix how to read history file in FileSystemApplicationHistoryStoreMajor.Shinichi YamashitaShinichi Yamashita
YARN-1577Unmanaged AM is broken because of YARN-1493Blocker.Jian HeJian He
YARN-1566Change distributed-shell to retain containers from previous AppAttemptMajor.Jian HeJian He
YARN-1555[YARN-321] Failing tests in org.apache.hadoop.yarn.server.applicationhistoryservice.*Major.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-1534TestAHSWebApp failed in YARN-321 branchMajor.Shinichi YamashitaShinichi Yamashita
YARN-1525Web UI should redirect to active RM when HA is enabled.Major.Xuan GongCindy Li
YARN-1521Mark appropriate protocol methods with the idempotent annotation or AtMostOnce annotationBlocker.Xuan GongXuan Gong
YARN-1504RM changes for moving apps between queuesMajorresourcemanagerSandy RyzaSandy Ryza
YARN-1499Fair Scheduler changes for moving apps between queuesMajorschedulerSandy RyzaSandy Ryza
YARN-1498Common scheduler changes for moving apps between queuesMajorresourcemanagerSandy RyzaSandy Ryza
YARN-1497Expose moving apps between queues on the command lineMajorclientSandy RyzaSandy Ryza
YARN-1496Protocol additions to allow moving apps between queuesMajorschedulerSandy RyzaSandy Ryza
YARN-1493Schedulers don't recognize apps separately from app-attemptsMajor.Jian HeJian He
YARN-1490RM should optionally not kill all containers when an ApplicationMaster exitsMajor.Vinod Kumar VavilapalliJian He
YARN-1461RM API and RM changes to handle tags for running jobsMajorresourcemanagerKarthik KambatlaKarthik Kambatla
YARN-1459RM services should depend on ConfigurationProvider during startup tooMajorresourcemanagerKarthik KambatlaXuan Gong
YARN-1428RM cannot write the final state of RMApp/RMAppAttempt to the application history store in the transition to the final stateMajor.Zhijie ShenZhijie Shen
YARN-1410Handle RM fails over after getApplicationID() and before submitApplication().Major.Bikas SahaXuan Gong
YARN-1389ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIsMajor.Mayank BansalMayank Bansal
YARN-1379[YARN-321] AHS protocols need to be in yarn proto package name after YARN-1170Major.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-1345Removing FINAL_SAVING from YarnApplicationAttemptStateMajor.Zhijie ShenZhijie Shen
YARN-1266Implement PB service and client wrappers for ApplicationHistoryProtocolMajor.Mayank BansalMayank Bansal
YARN-1242Script changes to start AHS as an individual processMajor.Zhijie ShenMayank Bansal
YARN-1191[YARN-321] Update artifact versions for application history serviceMajor.Mayank BansalMayank Bansal
YARN-1123[YARN-321] Adding ContainerReport and Protobuf implementationMajor.Zhijie ShenMayank Bansal
YARN-1041Protocol changes for RM to bind and notify a restarted AM of existing containersMajorresourcemanagerSteve LoughranJian He
YARN-1023[YARN-321] Webservices REST API's support for Application HistoryMajor.Devaraj KZhijie Shen
YARN-1017Document RM Restart featureBlockerresourcemanagerJian HeJian He
YARN-1007[YARN-321] Enhance History Reader interface for ContainersMajor.Devaraj KMayank Bansal
YARN-987Adding ApplicationHistoryManager responsible for exposing reports to all clientsMajor.Mayank BansalMayank Bansal
YARN-986RM DT token service should have service addresses of both RMsBlocker.Vinod Kumar VavilapalliKarthik Kambatla
YARN-984[YARN-321] Move classes from applicationhistoryservice.records.pb.impl package to applicationhistoryservice.records.impl.pbMajor.Devaraj KDevaraj K
YARN-979[YARN-321] Add more APIs related to ApplicationAttempt and Container in ApplicationHistoryProtocolMajor.Mayank BansalMayank Bansal
YARN-978[YARN-321] Adding ApplicationAttemptReport and Protobuf implementationMajor.Mayank BansalMayank Bansal
YARN-975Add a file-system implementation for history-storageMajor.Zhijie ShenZhijie Shen
YARN-974RMContainer should collect more useful information to be recorded in Application-HistoryMajor.Zhijie ShenZhijie Shen
YARN-967[YARN-321] Command Line Interface(CLI) for Reading Application History Storage DataMajor.Devaraj KMayank Bansal
YARN-962Update application_history_service.protoMajor.Zhijie ShenZhijie Shen
YARN-956[YARN-321] Add a testable in-memory HistoryStorageMajor.Vinod Kumar VavilapalliZhijie Shen
YARN-955[YARN-321] Implementation of ApplicationHistoryProtocolMajor.Vinod Kumar VavilapalliMayank Bansal
YARN-954[YARN-321] History Service should create the webUI and wire it to HistoryStorageMajor.Vinod Kumar VavilapalliZhijie Shen
YARN-953[YARN-321] Enable ResourceManager to write history dataMajor.Vinod Kumar VavilapalliZhijie Shen
YARN-947Defining the history data classes for the implementation of the reading/writing interfaceMajor.Zhijie ShenZhijie Shen
YARN-935YARN-321 branch is broken due to applicationhistoryserver module's pom.xmlMajor.Zhijie ShenZhijie Shen
YARN-934HistoryStorage writer interface for Application History ServerMajor.Zhijie ShenZhijie Shen
YARN-930Bootstrap ApplicationHistoryService moduleMajor.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
YARN-925HistoryStorage Reader Interface for Application History ServerMajor.Mayank BansalMayank Bansal

OTHER:

JIRASummaryPriorityComponentReporterContributor
HDFS-6030Remove an unused constructor in INode.javaTrivial.Yongjun ZhangYongjun Zhang
HDFS-6025Update findbugsExcludeFile.xmlMinorbuildTsz Wo Nicholas SzeTsz Wo Nicholas Sze
YARN-1891Document NodeManager health-monitoringMinor.Varun VasudevVarun Vasudev
YARN-1452Document the usage of the generic application history and the timeline data serviceMajor.Zhijie ShenZhijie Shen