Apache Hadoop Changelog

Release 2.6.0 - 2014-11-18

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-8944	Shell command fs -count should include human readable option	Trivial	.	Jonathan Allen	Jonathan Allen
YARN-2615	ClientToAMTokenIdentifier and DelegationTokenIdentifier should allow extended fields	Blocker	.	Junping Du	Junping Du
YARN-1051	YARN Admission Control/Planner: enhancing the resource allocation model with time.	Major	capacityscheduler, resourcemanager, scheduler	Carlo Curino	Carlo Curino
YARN-668	TokenIdentifier serialization should consider Unknown fields	Blocker	.	Siddharth Seth	Junping Du

IMPORTANT ISSUES:

JIRA	Summary	Priority	Component	Reporter	Contributor

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-10893	isolated classloader on the client side	Major	util	Sangjin Lee	Sangjin Lee
HADOOP-10719	Add generateEncryptedKey and decryptEncryptedKey methods to KeyProvider	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10607	Create an API to Separate Credentials/Password Storage from Applications	Major	security	Larry McCay	Larry McCay
HADOOP-10400	Incorporate new S3A FileSystem implementation	Major	fs, fs/s3	Jordan Mendelson	Jordan Mendelson
HADOOP-10150	Hadoop cryptographic file system	Major	security	Yi Liu	Yi Liu
HDFS-6959	Make the HDFS home directory location customizable.	Minor	.	Kevin Odell	Yongjun Zhang
HDFS-6634	inotify in HDFS	Major	hdfs-client, namenode, qjm	James Thomas	James Thomas
HDFS-6584	Support Archival Storage	Major	balancer & mover, namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6581	Write to single replica in memory	Major	datanode, hdfs-client, namenode	Arpit Agarwal	Arpit Agarwal
HDFS-6134	Transparent data at rest encryption	Major	security	Alejandro Abdelnur	Charles Lamb
HDFS-4257	The ReplaceDatanodeOnFailure policies could have a forgiving option	Minor	hdfs-client	Harsh J	Tsz Wo Nicholas Sze
MAPREDUCE-6007	Add support to distcp to preserve raw.* namespace extended attributes	Major	distcp	Charles Lamb	Charles Lamb
MAPREDUCE-5890	Support for encrypting Intermediate data and spills in local filesystem	Major	security	Alejandro Abdelnur	Arun Suresh
YARN-2395	FairScheduler: Preemption timeout should be configurable per queue	Major	fairscheduler	Ashwin Shankar	Wei Yan
YARN-2394	FairScheduler: Configure fairSharePreemptionThreshold per queue	Major	fairscheduler	Ashwin Shankar	Wei Yan
YARN-2393	FairScheduler: Add the notion of steady fair share	Major	fairscheduler	Ashwin Shankar	Wei Yan
YARN-2131	Add a way to format the RMStateStore	Major	resourcemanager	Karthik Kambatla	Robert Kanter
YARN-1964	Create Docker analog of the LinuxContainerExecutor in YARN	Major	.	Arun C Murthy	Abin Shahab
YARN-415	Capture aggregate memory allocation at the app-level for chargeback	Major	resourcemanager	Kendall Thrapp	Eric Payne

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-11216	Improve Openssl library finding	Major	security	Yi Liu	Colin Patrick McCabe
HADOOP-11195	Move Id-Name mapping in NFS to the hadoop-common area for better maintenance	Major	nfs, security	Yongjun Zhang	Yongjun Zhang
HADOOP-11184	Update Hadoop's lz4 to r123	Major	native	Colin Patrick McCabe	Colin Patrick McCabe
HADOOP-11153	Make number of KMS threads configurable	Major	kms	Andrew Wang	Andrew Wang
HADOOP-11111	MiniKDC to use locale EN_US for case conversions	Minor	tools	Steve Loughran	Steve Loughran
HADOOP-11106	Document considerations of HAR and Encryption	Minor	documentation	Andrew Wang	Charles Lamb
HADOOP-11101	How about inputstream close statement from catch block to finally block in FileContext#copy() ?	Minor	.	skrho	skrho
HADOOP-11068	Match hadoop.auth cookie format to jetty output	Major	security	Gregory Chanan	Gregory Chanan
HADOOP-11057	checknative command to probe for winutils.exe on windows	Minor	native	Steve Loughran	Xiaoyu Yao
HADOOP-11054	Add a KeyProvider instantiation based on a URI	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11030	Define a variable jackson.version instead of using constant at multiple places	Minor	.	Juan Yu	Juan Yu
HADOOP-11021	Configurable replication factor in the hadoop archive command	Minor	.	Zhe Zhang	Zhe Zhang
HADOOP-11017	KMS delegation token secret manager should be able to use zookeeper as store	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-11016	KMS should support signing cookies with zookeeper secret manager	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11015	Http server/client utils to propagate and recreate Exceptions from server to client	Major	.	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11009	Add Timestamp Preservation to DistCp	Major	tools/distcp	Gary Steelman	Gary Steelman
HADOOP-11007	Reinstate building of ant tasks support	Major	build, fs	Jason Lowe	Jason Lowe
HADOOP-10998	Fix bash tab completion code to work	Trivial	scripts	Jim Hester	Jim Hester
HADOOP-10990	Add missed NFSv3 request and response classes	Major	nfs	Brandon Li	Brandon Li
HADOOP-10982	KMS: Support for multiple Kerberos principals	Major	.	Andrew Wang	Alejandro Abdelnur
HADOOP-10975	org.apache.hadoop.util.DataChecksum should support native checksum calculation	Major	performance	James Thomas	James Thomas
HADOOP-10970	Cleanup KMS configuration keys	Major	.	Andrew Wang	Andrew Wang
HADOOP-10967	Improve DefaultCryptoExtension#generateEncryptedKey performance	Major	security	Yi Liu	Yi Liu
HADOOP-10954	Adding site documents of hadoop-tools	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HADOOP-10936	Change default KeyProvider bitlength to 128	Major	.	Andrew Wang	Andrew Wang
HADOOP-10922	User documentation for CredentialShell	Major	.	Andrew Wang	Larry McCay
HADOOP-10903	Enhance hadoop classpath command to expand wildcards or write classpath into jar manifest.	Major	scripts, util	Chris Nauroth	Chris Nauroth
HADOOP-10902	Deletion of directories with snapshots will not output reason for trash move failure	Minor	.	Stephen Chu	Stephen Chu
HADOOP-10891	Add EncryptedKeyVersion factory method to KeyProviderCryptoExtension	Major	.	Andrew Wang	Andrew Wang
HADOOP-10881	Clarify usage of encryption and encrypted encryption key in KeyProviderCryptoExtension	Major	.	Andrew Wang	Andrew Wang
HADOOP-10863	KMS should have a blacklist for decrypting EEKs	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10855	Allow Text to be read with a known length	Minor	io	Todd Lipcon	Todd Lipcon
HADOOP-10845	Add common tests for ACLs in combination with viewfs.	Major	fs, test	Chris Nauroth	Stephen Chu
HADOOP-10841	EncryptedKeyVersion should have a key name property	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10839	Add unregisterSource() to MetricsSystem API	Major	metrics	shanyu zhao	shanyu zhao
HADOOP-10838	Byte array native checksumming	Major	performance	James Thomas	James Thomas
HADOOP-10835	Implement HTTP proxyuser support in HTTP authentication client/server libraries	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10833	Remove unused cache in UserProvider	Major	security	Benoy Antony	Benoy Antony
HADOOP-10826	Iteration on KeyProviderFactory.serviceLoader is thread-unsafe	Major	security	Benoy Antony	Benoy Antony
HADOOP-10824	Refactor KMSACLs to avoid locking	Major	security	Benoy Antony	Benoy Antony
HADOOP-10817	ProxyUsers configuration should support configurable prefixes	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10815	Implement Windows equivalent of mlock.	Major	native	Chris Nauroth	Chris Nauroth
HADOOP-10812	Delegate KeyProviderExtension#toString to underlying KeyProvider	Trivial	.	Andrew Wang	Andrew Wang
HADOOP-10808	Remove unused native code for munlock.	Minor	native	Chris Nauroth	Chris Nauroth
HADOOP-10793	KeyShell args should use single-dash style	Major	security	Mike Yoder	Andrew Wang
HADOOP-10791	AuthenticationFilter should support externalizing the secret for signing and provide rotation support	Major	security	Alejandro Abdelnur	Robert Kanter
HADOOP-10771	Refactor HTTP delegation support out of httpfs to common	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10770	KMS add delegation token support	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10769	Create KeyProvider extension to handle delegation tokens	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10758	KMS: add ACLs on per key basis.	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10757	KeyProvider KeyVersion should provide the key name	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10756	KMS audit log should consolidate successful similar requests	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10755	Support negative caching of user-group mapping	Major	security	Andrew Wang	Lei (Eddy) Xu
HADOOP-10750	KMSKeyProviderCache should be in hadoop-common	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10736	Add key attributes to the key shell	Major	security	Mike Yoder	Mike Yoder
HADOOP-10731	Remove @date JavaDoc comment in ProgramDriver class	Trivial	documentation	Henry Saputra	Henry Saputra
HADOOP-10720	KMS: Implement generateEncryptedKey and decryptEncryptedKey in the REST API	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10698	KMS, add proxyuser support	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10696	Add optional attributes to KeyProvider Options and Metadata	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10695	KMSClientProvider should respect a configurable timeout.	Major	.	Andrew Wang	Mike Yoder
HADOOP-10675	Add server-side encryption functionality to s3a	Major	fs/s3	David S. Wang	David S. Wang
HADOOP-10610	Upgrade S3n fs.s3.buffer.dir to support multi directories	Minor	fs/s3	Ted Malaska	Ted Malaska
HADOOP-10433	Key Management Server based on KeyProvider API	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10432	Refactor SSLFactory to expose static method to determine HostnameVerifier	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10431	Change visibility of KeyStore.Options getter methods to public	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10430	KeyProvider Metadata should have an optional description, there should be a method to retrieve the metadata from all keys	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10429	KeyStores should have methods to generate the materials themselves, KeyShell should use them	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10428	JavaKeyStoreProvider should accept keystore password via configuration falling back to ENV VAR	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10427	KeyProvider implementations should be thread safe	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10373	create tools/hadoop-amazon for aws/EMR support	Major	fs/s3	Steve Loughran	Steve Loughran
HADOOP-10335	An ip whilelist based implementation to resolve Sasl properties per connection	Major	.	Benoy Antony	Benoy Antony
HADOOP-10231	Add some components in Native Libraries document	Minor	documentation	Akira AJISAKA	Akira AJISAKA
HADOOP-9540	Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing.	Minor	fs/s3, test	Hari	Hari
HADOOP-9457	add an SCM-ignored XML filename to keep secrets in (auth-keys.xml?)	Minor	build	Steve Loughran
HADOOP-8896	Javadoc points to Wrong Reader and Writer classes in SequenceFile	Trivial	documentation, io	Timothy Mann	Ray Chiang
HADOOP-8815	RandomDatum overrides equals(Object) but no hashCode()	Minor	test	Brandon Li	Brandon Li
HADOOP-8069	Enable TCP_NODELAY by default for IPC	Major	ipc	Todd Lipcon	Todd Lipcon
HADOOP-7664	o.a.h.conf.Configuration complains of overriding final parameter even if the value with which its attempting to override is the same.	Minor	conf	Ravi Prakash	Ravi Prakash
HDFS-7313	Support optional configuration of AES cipher suite on DataTransferProtocol.	Major	datanode, hdfs-client, security	Chris Nauroth	Chris Nauroth
HDFS-7276	Limit the number of byte arrays used by DFSOutputStream	Major	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7260	Make DFSOutputStream.MAX_PACKETS configurable	Minor	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7233	NN logs unnecessary org.apache.hadoop.hdfs.protocol.UnresolvedPathException	Major	namenode	Rushabh S Shah	Rushabh S Shah
HDFS-7230	Add rolling downgrade documentation	Major	documentation	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7228	Add an SSD policy into the default BlockStoragePolicySuite	Major	.	Jing Zhao	Jing Zhao
HDFS-7217	Better batching of IBRs	Major	.	Kihwal Lee	Kihwal Lee
HDFS-7215	Add JvmPauseMonitor to NFS gateway	Minor	nfs	Brandon Li	Brandon Li
HDFS-7195	Update user doc of secure mode about Datanodes don't require root or jsvc	Major	documentation, security	Yi Liu	Chris Nauroth
HDFS-7158	Reduce the memory usage of WebImageViewer	Major	.	Haohui Mai	Haohui Mai
HDFS-7153	Add storagePolicy to NN edit log during file creation	Major	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-7128	Decommission slows way down when it gets towards the end	Major	namenode	Ming Ma	Ming Ma
HDFS-7093	Add config key to restrict setStoragePolicy	Major	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-7059	HAadmin transtionToActive with forceActive option can show confusing message.	Minor	.	Rushabh S Shah	Rushabh S Shah
HDFS-6943	Improve NN allocateBlock log to include replicas' datanode IPs	Minor	namenode	Ming Ma	Ming Ma
HDFS-6899	Allow changing MiniDFSCluster volumes per DN and capacity per volume	Major	datanode, test	Arpit Agarwal	Arpit Agarwal
HDFS-6886	Use single editlog record for creating file + overwrite.	Critical	namenode	Yi Liu	Yi Liu
HDFS-6858	Allow dfs.data.transfer.saslproperties.resolver.class default to hadoop.security.saslproperties.resolver.class	Minor	security	Benoy Antony	Benoy Antony
HDFS-6850	Move NFS out of order write unit tests into TestWrites class	Minor	nfs	Zhe Zhang	Zhe Zhang
HDFS-6849	Replace HttpFS custom proxyuser handling with common implementation	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HDFS-6837	Code cleanup for Balancer and Dispatcher	Minor	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6836	HDFS INFO logging is verbose & uses file appenders	Major	datanode	Gopal V	Nathan Yao
HDFS-6828	Separate block replica dispatching from Balancer	Major	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6812	Remove addBlock and replaceBlock from DatanodeDescriptor	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6809	Move some Balancer's inner classes to standalone classes	Minor	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6800	Support Datanode layout changes with rolling upgrade	Major	datanode	Colin Patrick McCabe	James Thomas
HDFS-6798	Add test case for incorrect data node condition during balancing	Major	balancer & mover	Benoy Antony	Benoy Antony
HDFS-6796	Improving the argument check during balancer command line parsing	Minor	balancer & mover	Benoy Antony	Benoy Antony
HDFS-6794	Update BlockManager methods to use DatanodeStorageInfo where possible	Minor	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-6781	Separate HDFS commands from CommandsManual.apt.vm	Major	documentation	Akira AJISAKA	Akira AJISAKA
HDFS-6779	Add missing version subcommand for hdfs	Minor	scripts	Allen Wittenauer	Sasaki Toru
HDFS-6773	MiniDFSCluster should skip edit log fsync by default	Major	namenode	Daryn Sharp	Stephen Chu
HDFS-6772	Get DN storages out of blockContentsStale state faster after NN restarts	Major	.	Ming Ma	Ming Ma
HDFS-6758	block writer should pass the expected block size to DataXceiverServer	Major	datanode, hdfs-client	Arpit Agarwal	Arpit Agarwal
HDFS-6755	There is an unnecessary sleep in the code path where DFSOutputStream#close gives up its attempt to contact the namenode	Major	.	Mit Desai	Mit Desai
HDFS-6739	Add getDatanodeStorageReport to ClientProtocol	Major	hdfs-client, namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6701	Make seed optional in NetworkTopology#sortByDistance	Major	namenode	Ashwin Shankar	Ashwin Shankar
HDFS-6700	BlockPlacementPolicy shoud choose storage but not datanode for deletion	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6690	Deduplicate xattr names in memory	Major	namenode	Andrew Wang	Andrew Wang
HDFS-6685	Balancer should preserve storage type of replicas	Major	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6655	Add ‘header banner’ to ‘explorer.html’ also in Namenode UI	Major	.	Vinayakumar B	Vinayakumar B
HDFS-6643	Refactor INodeFile.HeaderFormat and INodeWithAdditionalFields.PermissionStatusFormat	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6627	Rename DataNode#checkWriteAccess to checkReadAccess.	Major	datanode	Liang Xie	Liang Xie
HDFS-6613	Improve logging in caching classes	Minor	caching	Andrew Wang	Andrew Wang
HDFS-6606	Optimize HDFS Encrypted Transport performance	Major	datanode, hdfs-client, security	Yi Liu	Yi Liu
HDFS-6597	Add a new option to NN upgrade to terminate the process after upgrade on NN is completed	Major	namenode	Danilo Vunjak	Danilo Vunjak
HDFS-6570	add api that enables checking if a user has certain permissions on a file	Major	hdfs-client, namenode, webhdfs	Thejas M Nair	Jitendra Nath Pandey
HDFS-6519	Document oiv_legacy command	Major	documentation	Akira AJISAKA	Akira AJISAKA
HDFS-6511	BlockManager#computeInvalidateWork() could do nothing	Minor	.	Juan Yu	Juan Yu
HDFS-6482	Use block ID-based block layout on datanodes	Major	datanode	James Thomas	James Thomas
HDFS-6441	Add ability to exclude/include specific datanodes while balancing	Major	balancer & mover	Benoy Antony	Benoy Antony
HDFS-6188	An ip whitelist based implementation of TrustedChannelResolver	Major	security	Benoy Antony	Benoy Antony
HDFS-5202	Support Centralized Cache Management on Windows.	Major	datanode	Colin Patrick McCabe	Chris Nauroth
HDFS-5182	BlockReaderLocal must allow zero-copy reads only when the DN believes it's valid	Major	hdfs-client	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-4486	Add log category for long-running DFSClient notices	Minor	.	Todd Lipcon	Zhe Zhang
HDFS-4120	Add a new “-skipSharedEditsCheck” option for BootstrapStandby	Minor	ha, namenode	Liang Xie	Rakesh R
HDFS-3851	Make DFSOuputSteram$Packet default constructor reuse the other constructor	Trivial	hdfs-client	Jing Zhao	Jing Zhao
HDFS-3528	Use native CRC32 in DFS write path	Major	datanode, hdfs-client, performance	Todd Lipcon	James Thomas
HDFS-2856	Fix block protocol so that Datanodes don't require root or jsvc	Major	datanode, security	Owen O'Malley	Chris Nauroth
HDFS-573	Porting libhdfs to Windows	Major	libhdfs	Ziliang Guo	Chris Nauroth
MAPREDUCE-6086	mapreduce.job.credentials.binary should allow all URIs	Major	security	zhihai xu	zhihai xu
MAPREDUCE-6072	Remove INSTALL document	Minor	documentation	Akira AJISAKA	Akira AJISAKA
MAPREDUCE-6071	JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs	Trivial	client	Tsuyoshi Ozawa	Tsuyoshi Ozawa
MAPREDUCE-6070	yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented	Trivial	documentation	Tsuyoshi Ozawa	Tsuyoshi Ozawa
MAPREDUCE-6024	java.net.SocketTimeoutException in Fetcher caused jobs stuck for more than 1 hour	Critical	mr-am, task	zhaoyunjiong	zhaoyunjiong
MAPREDUCE-5971	Move the default options for distcp -p to DistCpOptionSwitch	Trivial	distcp	Charles Lamb	Charles Lamb
MAPREDUCE-5970	Provide a boolean switch to enable MR-AM profiling	Minor	applicationmaster, client	Gera Shegalov	Gera Shegalov
MAPREDUCE-5943	Separate mapred commands from CommandsManual.apt.vm	Minor	documentation	Akira AJISAKA	Akira AJISAKA
MAPREDUCE-5906	Inconsistent configuration in property “mapreduce.reduce.shuffle.input.buffer.percent”	Minor	.	Akira AJISAKA	Akira AJISAKA
MAPREDUCE-5130	Add missing job config options to mapred-default.xml	Major	documentation	Sandy Ryza	Ray Chiang
MAPREDUCE-4791	Javadoc for KeyValueTextInputFormat should include default separator and how to change it	Minor	documentation	Matt Lavin	Akira AJISAKA
MAPREDUCE-883	harchive: Document how to unarchive	Minor	documentation, harchive	Koji Noguchi	Akira AJISAKA
YARN-2627	Add logs when attemptFailuresValidityInterval is enabled	Major	.	Xuan Gong	Xuan Gong
YARN-2577	Clarify ACL delimiter and how to configure ACL groups only	Trivial	documentation, fairscheduler	Miklos Christine	Miklos Christine
YARN-2539	FairScheduler: Set the default value for maxAMShare to 0.5	Minor	.	Wei Yan	Wei Yan
YARN-2531	CGroups - Admins should be allowed to enforce strict cpu limits	Major	.	Varun Vasudev	Varun Vasudev
YARN-2448	RM should expose the resource types considered during scheduling when AMs register	Major	.	Varun Vasudev	Varun Vasudev
YARN-2411	[Capacity Scheduler] support simple user and group mappings to queues	Major	capacityscheduler	Ram Venkatesh	Ram Venkatesh
YARN-2399	FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt	Major	fairscheduler	Karthik Kambatla	Karthik Kambatla
YARN-2377	Localization exception stack traces are not passed as diagnostic info	Major	nodemanager	Gera Shegalov	Gera Shegalov
YARN-2372	There are Chinese Characters in the FairScheduler's document	Minor	documentation	Fengdong Yu	Fengdong Yu
YARN-2361	RMAppAttempt state machine entries for KILLED state has duplicate event entries	Trivial	resourcemanager	zhihai xu	zhihai xu
YARN-2352	FairScheduler: Collect metrics on duration of critical methods that affect performance	Major	scheduler	Karthik Kambatla	Karthik Kambatla
YARN-2343	Improve error message on token expire exception	Trivial	.	Li Lu	Li Lu
YARN-2337	ResourceManager sets ClientRMService in RMContext multiple times	Trivial	resourcemanager	zhihai xu	zhihai xu
YARN-2323	FairShareComparator creates too many Resource objects	Minor	fairscheduler	Hong Zhiguo	Hong Zhiguo
YARN-2294	Update sample program and documentations for writing YARN Application	Major	.	Li Lu
YARN-2274	FairScheduler: Add debug information about cluster capacity, availability and reservations	Trivial	fairscheduler	Karthik Kambatla	Karthik Kambatla
YARN-2214	FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness	Major	scheduler	Ashwin Shankar	Ashwin Shankar
YARN-2209	Replace AM resync/shutdown command with corresponding exceptions	Major	.	Jian He	Jian He
YARN-2198	Remove the need to run NodeManager as privileged account for Windows Secure Container Executor	Major	.	Remus Rusanu	Remus Rusanu
YARN-2197	Add a link to YARN CHANGES.txt in the left side of doc	Minor	documentation	Akira AJISAKA	Akira AJISAKA
YARN-1994	Expose YARN/MR endpoints on multiple interfaces	Major	nodemanager, resourcemanager, webapp	Arpit Agarwal	Craig Welch
YARN-1954	Add waitFor to AMRMClient(Async)	Major	client	Zhijie Shen	Tsuyoshi Ozawa
YARN-1918	Typo in description and error message for ‘yarn.resourcemanager.cluster-id’	Trivial	.	Devaraj K	Anandha L Ranganathan
YARN-1769	CapacityScheduler: Improve reservations	Major	capacityscheduler	Thomas Graves	Thomas Graves
YARN-666	[Umbrella] Support rolling upgrades in YARN	Major	graceful, rolling upgrade	Siddharth Seth

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-11286	Map/Reduce dangerously adds Guava @Beta class to CryptoUtils	Blocker	.	Christopher Tubbs
HADOOP-11282	Skip NFS TestShellBasedIdMapping tests that are irrelevant on Windows.	Trivial	test	Chris Nauroth	Chris Nauroth
HADOOP-11280	TestWinUtils#testChmod fails after removal of NO_PROPAGATE_INHERIT_ACE.	Trivial	native, test	Chris Nauroth	Chris Nauroth
HADOOP-11265	Credential and Key Shell Commands not available on Windows	Major	scripts	Larry McCay	Larry McCay
HADOOP-11260	Patch up Jetty to disable SSLv3	Blocker	security	Karthik Kambatla	Mike Yoder
HADOOP-11254	Promoting AccessControlList to be public	Major	.	Zhijie Shen	Zhijie Shen
HADOOP-11250	fix endmacro of set_find_shared_library_without_version in CMakeLists	Minor	build	Yi Liu	Yi Liu
HADOOP-11247	Fix a couple javac warnings in NFS	Major	nfs	Brandon Li	Brandon Li
HADOOP-11243	SSLFactory shouldn't allow SSLv3	Blocker	.	Wei Yan	Wei Yan
HADOOP-11233	hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default	Minor	conf	Steve Loughran	Stephen Chu
HADOOP-11228	winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject	Major	.	Remus Rusanu	Remus Rusanu
HADOOP-11221	JAVA specification for hashcode does not enforce it to be non-negative, but IdentityHashStore assumes System.identityHashCode() is non-negative	Major	util	Jinghui Wang	Jinghui Wang
HADOOP-11217	Disable SSLv3 in KMS	Blocker	kms	Robert Kanter	Robert Kanter
HADOOP-11207	DelegationTokenAuthenticationHandler needs to support DT operations for proxy user	Major	security	Zhijie Shen	Zhijie Shen
HADOOP-11198	Fix typo in javadoc for FileSystem#listStatus()	Minor	.	Ted Yu	Li Lu
HADOOP-11194	Ignore .keep files	Major	.	Karthik Kambatla	Karthik Kambatla
HADOOP-11193	Fix uninitialized variables in NativeIO.c	Major	native	Xiaoyu Yao	Xiaoyu Yao
HADOOP-11182	GraphiteSink emits wrong timestamps	Major	.	Sascha Coenen	Ravi Prakash
HADOOP-11181	o.a.h.security.token.delegation.DelegationTokenManager should be more generalized to handle other DelegationTokenIdentifier	Major	security	Zhijie Shen	Zhijie Shen
HADOOP-11179	Tarball as local resource type archive fails to localize on Windows	Major	.	Hitesh Shah	Craig Welch
HADOOP-11178	Fix findbugs exclude file	Minor	build	Arun Suresh	Arun Suresh
HADOOP-11176	KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user	Major	.	Arun Suresh	Arun Suresh
HADOOP-11175	Fix several issues of hadoop security configuration in user doc.	Trivial	documentation, security	Yi Liu	Yi Liu
HADOOP-11174	Delegation token for KMS should only be got once if it already exists	Major	kms, security	Yi Liu	Yi Liu
HADOOP-11170	ZKDelegationTokenSecretManager fails to renewToken created by a peer	Major	.	Arun Suresh	Arun Suresh
HADOOP-11169	Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator	Major	.	Arun Suresh	Arun Suresh
HADOOP-11168	Remove duplicated entry “dfs.webhdfs.enabled” in the user doc	Trivial	documentation	Yi Liu	Yi Liu
HADOOP-11163	MetricsSystemImpl may miss a registered source	Minor	metrics	Chuan Liu	Chuan Liu
HADOOP-11161	Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources	Major	.	Arun Suresh	Arun Suresh
HADOOP-11160	Fix typo in nfs3 server duplicate entry reporting	Trivial	nfs	Charles Lamb	Charles Lamb
HADOOP-11154	Update BUILDING.txt to state that CMake 3.0 or newer is required on Mac.	Trivial	documentation, native	Chris Nauroth	Chris Nauroth
HADOOP-11151	Automatically refresh auth token and retry on auth failure	Major	security	zhubin	Arun Suresh
HADOOP-11145	TestFairCallQueue fails	Major	test	Akira AJISAKA	Akira AJISAKA
HADOOP-11143	NetUtils.wrapException loses inner stack trace on BindException	Minor	net	Steve Loughran	Steve Loughran
HADOOP-11140	hadoop-aws only need test-scoped dependency on hadoop-common's tests jar	Major	.	Juan Yu	Juan Yu
HADOOP-11133	Should trim the content of keystore password file for JavaKeyStoreProvider	Minor	security	zhubin	Yi Liu
HADOOP-11130	NFS updateMaps OS check is reversed	Major	nfs	Allen Wittenauer	Brandon Li
HADOOP-11122	Fix findbugs in ZK DelegationTokenSecretManagers	Blocker	.	Karthik Kambatla	Arun Suresh
HADOOP-11113	Namenode not able to reconnect to KMS after KMS restart	Major	security	Arun Suresh	Arun Suresh
HADOOP-11112	TestKMSWithZK does not use KEY_PROVIDER_URI	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11110	JavaKeystoreProvider should not report a key as created if it was not flushed to the backing file	Major	.	Andrew Wang	Arun Suresh
HADOOP-11109	Site build is broken	Major	.	Jian He	Jian He
HADOOP-11105	MetricsSystemImpl could leak memory in registered callbacks	Major	metrics	Chuan Liu	Chuan Liu
HADOOP-11099	KMS return HTTP UNAUTHORIZED 401 on ACL failure	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11097	kms docs say proxyusers, not proxyuser for config params	Trivial	documentation	Charles Lamb	Charles Lamb
HADOOP-11096	KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11091	Eliminate old configuration parameter names from s3a	Minor	fs/s3	David S. Wang	David S. Wang
HADOOP-11085	Excessive logging by org.apache.hadoop.util.Progress when value is NaN	Major	.	Mit Desai	Mit Desai
HADOOP-11083	After refactoring of HTTP proxyuser to common, doAs param is case sensitive	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11077	NPE if hosts not specified in ProxyUsers	Major	security	Gregory Chanan	Gregory Chanan
HADOOP-11069	KMSClientProvider should use getAuthenticationMethod() to determine if in proxyuser mode or not	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11067	warning message ‘ssl.client.truststore.location has not been set’ gets printed for hftp command	Major	.	Yesha Vora	Xiaoyu Yao
HADOOP-11064	UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes	Blocker	native	Steve Loughran	Chris Nauroth
HADOOP-11063	KMS cannot deploy on Windows, because class names are too long.	Blocker	.	Chris Nauroth	Chris Nauroth
HADOOP-11062	CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used	Major	security, test	Alejandro Abdelnur	Arun Suresh
HADOOP-11056	OsSecureRandom.setConf() might leak file descriptors.	Major	security	Yongjun Zhang	Yongjun Zhang
HADOOP-11049	javax package system class default is too broad	Minor	util	Sangjin Lee	Sangjin Lee
HADOOP-11048	user/custom LogManager fails to load if the client classloader is enabled	Minor	util	Sangjin Lee	Sangjin Lee
HADOOP-11040	Return value of read(ByteBuffer buf) in CryptoInputStream is incorrect in some cases	Major	security	Yi Liu	Yi Liu
HADOOP-11036	Add build directory to .gitignore	Minor	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
HADOOP-11012	hadoop fs -text of zero-length file causes EOFException	Major	fs	Eric Payne	Eric Payne
HADOOP-11005	Fix HTTP content type for ReconfigurationServlet	Minor	conf	Lei (Eddy) Xu	Lei (Eddy) Xu
HADOOP-10989	Work around buggy getgrouplist() implementations on Linux that return 0 on failure	Major	native	Chris Nauroth	Chris Nauroth
HADOOP-10973	Native Libraries Guide contains format error	Minor	documentation	Peter Klavins	Peter Klavins
HADOOP-10972	Native Libraries Guide contains mis-spelt build line	Major	documentation	Peter Klavins	Peter Klavins
HADOOP-10968	hadoop native build fails to detect java_libarch on ppc64le	Major	build	Dinar Valeev
HADOOP-10966	Hadoop Common native compilation broken in windows	Blocker	native	Vinayakumar B	David Villegas
HADOOP-10964	Small fix for NetworkTopologyWithNodeGroup#sortByDistance	Minor	.	Yi Liu	Yi Liu
HADOOP-10962	Flags for posix_fadvise are not valid in some architectures	Major	native	David Villegas	David Villegas
HADOOP-10946	Fix a bunch of typos in log messages	Trivial	.	Ray Chiang	Ray Chiang
HADOOP-10939	Fix TestKeyProviderFactory testcases to use default 128 bit length keys	Major	.	Arun Suresh	Arun Suresh
HADOOP-10937	Need to set version name correctly before decrypting EEK	Major	security	Arun Suresh	Arun Suresh
HADOOP-10931	compile error on project “Apache Hadoop OpenStack support”	Minor	build, fs/swift	xukun
HADOOP-10929	Typo in Configuration.getPasswordFromCredentialProviders	Trivial	security	Larry McCay	Larry McCay
HADOOP-10928	Incorrect usage on ‘hadoop credential list’	Trivial	security	Josh Elser	Josh Elser
HADOOP-10927	Fix CredentialShell help behavior and error codes	Minor	security	Josh Elser	Josh Elser
HADOOP-10925	Compilation fails in native link0 function on Windows.	Blocker	native	Chris Nauroth	Chris Nauroth
HADOOP-10920	site plugin couldn't parse hadoop-kms index.apt.vm	Minor	documentation	Ted Yu	Akira AJISAKA
HADOOP-10918	JMXJsonServlet fails when used within Tomcat	Major	.	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10911	hadoop.auth cookie after HADOOP-10710 still not proper according to RFC2109	Major	security	Gregory Chanan
HADOOP-10900	CredentialShell args should use single-dash style	Minor	.	Andrew Wang	Andrew Wang
HADOOP-10887	Add XAttrs to ViewFs and make XAttrs + ViewFileSystem internal dir behavior consistent	Major	fs, test	Stephen Chu	Stephen Chu
HADOOP-10880	Move HTTP delegation tokens out of URL querystring to a header	Blocker	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10866	RawLocalFileSystem fails to read symlink targets via the stat command when the format of stat command uses non-curly quotes	Major	.	Yongjun Zhang	Yongjun Zhang
HADOOP-10862	Miscellaneous trivial corrections to KMS classes	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10857	Native Libraries Guide doen't mention a dependency on openssl-development package	Major	documentation	Tsuyoshi Ozawa	Tsuyoshi Ozawa
HADOOP-10851	NetgroupCache does not remove group memberships	Major	security	Benoy Antony	Benoy Antony
HADOOP-10843	TestGridmixRecord unit tests failure on PowerPC	Major	test, tools	Jinghui Wang	Jinghui Wang
HADOOP-10842	CryptoExtension generateEncryptedKey method should receive the key name	Major	security	Alejandro Abdelnur	Arun Suresh
HADOOP-10830	Missing lock in JavaKeyStoreProvider.createCredentialEntry	Major	security	Benoy Antony	Benoy Antony
HADOOP-10820	Throw an exception in GenericOptionsParser when passed an empty Path	Minor	.	Alex Holmes	zhihai xu
HADOOP-10816	KeyShell returns -1 on error to the shell, should be 1	Major	security	Mike Yoder	Mike Yoder
HADOOP-10814	Update Tomcat version used by HttpFS and KMS to latest 6.x version	Major	.	Alejandro Abdelnur	Robert Kanter
HADOOP-10810	Clean up native code compilation warnings.	Minor	native	Chris Nauroth	Chris Nauroth
HADOOP-10781	Unportable getgrouplist() usage breaks FreeBSD	Major	.	Dmitry Sivachenko	Dmitry Sivachenko
HADOOP-10780	hadoop_user_info_alloc fails on FreeBSD due to incorrect sysconf use	Major	.	Dmitry Sivachenko	Dmitry Sivachenko
HADOOP-10744	LZ4 Compression fails to recognize PowerPC Little Endian Architecture	Major	io, native	Ayappan	Bert Sanders
HADOOP-10733	Potential null dereference in CredentialShell#promptForCredential()	Minor	.	Ted Yu	Ted Yu
HADOOP-10732	Update without holding write lock in JavaKeyStoreProvider#innerSetCredential()	Minor	.	Ted Yu	Ted Yu
HADOOP-10681	Remove synchronized blocks from SnappyCodec and ZlibCodec buffering inner loop	Major	performance	Gopal V	Gopal V
HADOOP-10677	ExportSnapshot fails on kerberized cluster using s3a	Major	fs/s3	David S. Wang	David S. Wang
HADOOP-10676	S3AOutputStream not reading new config knobs for multipart configs	Major	fs/s3	David S. Wang	David S. Wang
HADOOP-10673	Update rpc metrics when the call throws an exception	Major	.	Ming Ma	Ming Ma
HADOOP-10645	TestKMS fails because race condition writing acl files	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10611	KMS, keyVersion name should not be assumed to be keyName@versionNumber	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10591	Compression codecs must used pooled direct buffers or deallocate direct buffers when stream is closed	Major	.	Hari Shreedharan	Colin Patrick McCabe
HADOOP-10586	KeyShell doesn't allow setting Options via CLI	Minor	bin	Charles Lamb	Charles Lamb
HADOOP-10583	bin/hadoop key throws NPE with no args and assorted other fixups	Minor	bin	Charles Lamb	Charles Lamb
HADOOP-10552	Fix usage and example at FileSystemShell.apt.vm	Trivial	documentation	Kenji Kikushima	Kenji Kikushima
HADOOP-10534	KeyProvider API should using windowing for retrieving metadata	Major	.	Owen O'Malley	Owen O'Malley
HADOOP-10507	FsShell setfacl can throw ArrayIndexOutOfBoundsException when no perm is specified	Minor	fs	Stephen Chu	sathish
HADOOP-10488	TestKeyProviderFactory fails randomly	Major	test	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10404	Some accesses to DomainSocketWatcher#closed are not protected by lock	Minor	.	Ted Yu	Colin Patrick McCabe
HADOOP-10402	Configuration.getValByRegex does not substitute for variables	Major	.	Robert Kanter	Robert Kanter
HADOOP-10244	TestKeyShell improperly tests the results of a Delete	Major	security	Larry McCay	Larry McCay
HADOOP-10237	JavaKeyStoreProvider needs to set keystore permissions properly	Major	security	Larry McCay	Larry McCay
HADOOP-10224	JavaKeyStoreProvider has to protect against corrupting underlying store	Major	security	Larry McCay	Arun Suresh
HADOOP-10177	Create CLI tools for managing keys via the KeyProvider API	Major	security	Owen O'Malley	Larry McCay
HADOOP-10141	Create an API to separate encryption key storage from applications	Major	security	Owen O'Malley	Owen O'Malley
HADOOP-10131	NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree	Major	.	Vinayakumar B	Vinayakumar B
HADOOP-10121	Fix javadoc spelling for HadoopArchives#writeTopLevelDirs	Trivial	documentation	Akira AJISAKA	Akira AJISAKA
HADOOP-10059	RPC authentication and authorization metrics overflow to negative values on busy clusters	Minor	metrics	Jason Lowe	Tsuyoshi Ozawa
HADOOP-10037	s3n read truncated, but doesn't throw exception	Major	fs/s3	David Rosenstrauch
HADOOP-9989	Bug introduced in HADOOP-9374, which parses the -tokenCacheFile as binary file but set it to the configuration as JSON file.	Major	security, util	Jinghui Wang	zhihai xu
HADOOP-9921	daemon scripts should remove pid file on stop call after stop or process is found not running	Major	.	Vinayakumar B	Vinayakumar B
HADOOP-9740	FsShell's Text command does not read avro data files stored on HDFS	Major	fs	Allan Yan	Allan Yan
HADOOP-9576	Make NetUtils.wrapException throw EOFException instead of wrapping it as IOException	Major	.	Jian He	Steve Loughran
HADOOP-8808	Update FsShell documentation to mention deprecation of some of the commands, and mention alternatives	Major	documentation, fs	Hemanth Yamijala	Akira AJISAKA
HADOOP-8158	Interrupting hadoop fs -put from the command line causes a LeaseExpiredException	Major	.	Todd Lipcon	Daryn Sharp
HDFS-7391	Renable SSLv2Hello in HttpFS	Blocker	webhdfs	Robert Kanter	Robert Kanter
HDFS-7387	NFS may only do partial commit due to a race between COMMIT and write	Critical	nfs	Brandon Li	Brandon Li
HDFS-7385	ThreadLocal used in FSEditLog class causes FSImage permission mess up	Blocker	namenode	jiangyu	jiangyu
HDFS-7383	DataNode.requestShortCircuitFdsForRead may throw NullPointerException	Major	datanode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7382	DataNode in secure mode may throw NullPointerException if client connects before DataNode registers itself with NameNode.	Minor	datanode, security	Chris Nauroth	Chris Nauroth
HDFS-7379	TestBalancer#testBalancerWithRamDisk creates test files incorrectly	Minor	test	Xiaoyu Yao	Xiaoyu Yao
HDFS-7367	HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol.	Major	hdfs-client	Chris Nauroth	Chris Nauroth
HDFS-7364	Balancer always shows zero Bytes Already Moved	Minor	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7359	NameNode in secured HA cluster fails to start if dfs.namenode.secondary.http-address cannot be interpreted as a network address.	Major	journal-node, namenode	Chris Nauroth	Chris Nauroth
HDFS-7340	make rollingUpgrade start/finalize idempotent	Major	ha	Arpit Gupta	Jing Zhao
HDFS-7334	Fix periodic failures of TestCheckpoint#testTooManyEditReplayFailures	Minor	test	Charles Lamb	Charles Lamb
HDFS-7328	TestTraceAdmin assumes Unix line endings.	Trivial	test	Chris Nauroth	Chris Nauroth
HDFS-7309	XMLUtils.mangleXmlString doesn't seem to handle less than sign	Minor	.	Ravi Prakash	Colin Patrick McCabe
HDFS-7305	NPE seen in wbhdfs FS while running SLive	Minor	webhdfs	Arpit Gupta	Jing Zhao
HDFS-7300	The getMaxNodesPerRack() method in BlockPlacementPolicyDefault is flawed	Critical	.	Kihwal Lee	Kihwal Lee
HDFS-7296	HdfsConstants#MEMORY_STORAGE_POLICY_ID and HdfsConstants#MEMORY_STORAGE_POLICY_ID are missing in branch-2	Minor	.	Jing Zhao	Jing Zhao
HDFS-7287	The OfflineImageViewer (OIV) can output invalid XML depending on the filename	Major	.	Ravi Prakash	Ravi Prakash
HDFS-7274	Disable SSLv3 in HttpFS	Blocker	webhdfs	Robert Kanter	Robert Kanter
HDFS-7259	Unresponseive NFS mount point due to deferred COMMIT response	Major	nfs	Brandon Li	Brandon Li
HDFS-7243	HDFS concat operation should not be allowed in Encryption Zone	Major	encryption, namenode	Yi Liu	Charles Lamb
HDFS-7237	namenode -rollingUpgrade throws ArrayIndexOutOfBoundsException	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7236	Fix TestOpenFilesWithSnapshot#testOpenFilesWithMultipleSnapshots	Major	.	Yongjun Zhang	Yongjun Zhang
HDFS-7226	TestDNFencing.testQueueingWithAppend failed often in latest test	Major	ha	Yongjun Zhang	Yongjun Zhang
HDFS-7221	TestDNFencingWithReplication fails consistently	Minor	test	Charles Lamb	Charles Lamb
HDFS-7218	FSNamesystem ACL operations should write to audit log on failure	Minor	namenode	Charles Lamb	Charles Lamb
HDFS-7208	NN doesn't schedule replication when a DN storage fails	Major	namenode	Ming Ma	Ming Ma
HDFS-7199	DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception	Critical	hdfs-client	Jason Lowe	Rushabh S Shah
HDFS-7185	The active NameNode will not accept an fsimage sent from the standby during rolling upgrade	Major	namenode	Colin Patrick McCabe	Jing Zhao
HDFS-7180	NFSv3 gateway frequently gets stuck due to GC	Critical	nfs	Eric Zhiqiang Ma	Brandon Li
HDFS-7178	Additional unit test for replica write with full disk	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-7176	The namenode usage message doesn't include “-rollingupgrade started”	Minor	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-7172	Test data files may be checked out of git with incorrect line endings, causing test failures in TestHDFSCLI.	Trivial	test	Chris Nauroth	Chris Nauroth
HDFS-7169	Fix a findbugs warning in ReplaceDatanodeOnFailure	Minor	build	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7167	NPE while running Mover if the given path is for a file	Major	balancer & mover	Prabushankar Chinnasamy	Jing Zhao
HDFS-7162	Wrong path when deleting through fuse-dfs a file which already exists in trash	Major	fuse-dfs	Chengbing Liu	Chengbing Liu
HDFS-7156	Fsck documentation is outdated.	Major	documentation	Konstantin Shvachko	Masahiro Yamaguchi
HDFS-7148	TestEncryptionZones#testIsEncryptedMethod fails on branch-2 after archival storage merge	Major	encryption	Andrew Wang	Andrew Wang
HDFS-7147	Update archival storage user documentation	Blocker	documentation	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7132	hdfs namenode -metadataVersion command does not honor configured name dirs	Minor	namenode	Charles Lamb	Charles Lamb
HDFS-7131	During HA upgrade, JournalNode should create a new committedTxnId file in the current directory	Major	qjm	Jing Zhao	Jing Zhao
HDFS-7130	TestDataTransferKeepalive fails intermittently on Windows.	Major	test	Chris Nauroth	Chris Nauroth
HDFS-7127	TestLeaseRecovery leaks MiniDFSCluster instances.	Major	test	Chris Nauroth	Chris Nauroth
HDFS-7122	Use of ThreadLocal<Random> results in poor block placement	Blocker	namenode	Jeff Buell	Andrew Wang
HDFS-7111	TestSafeMode assumes Unix line endings in safe mode tip.	Trivial	test	Chris Nauroth	Chris Nauroth
HDFS-7110	Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read.	Minor	test	Chris Nauroth	Chris Nauroth
HDFS-7109	TestDataStorage does not release file locks between tests.	Minor	test	Chris Nauroth	Chris Nauroth
HDFS-7107	Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth.	Trivial	ha	Chris Nauroth	Chris Nauroth
HDFS-7106	Reconfiguring DataNode volumes does not release the lock files in removed volumes.	Major	datanode	Chris Nauroth	Chris Nauroth
HDFS-7105	Fix TestJournalNode#testFailToStartWithBadConfig to match log output change	Minor	test	Ray Chiang	Ray Chiang
HDFS-7104	Fix and clarify INodeInPath getter functions	Minor	.	Zhe Zhang	Zhe Zhang
HDFS-7096	Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI	Minor	test	Charles Lamb	Charles Lamb
HDFS-7075	hadoop-fuse-dfs fails because it cannot find JavaKeyStoreProvider$Factory	Major	.	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-7073	Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases.	Major	datanode, hdfs-client, security	Chris Nauroth	Chris Nauroth
HDFS-7065	Pipeline close recovery race can cause block corruption	Critical	datanode	Kihwal Lee	Kihwal Lee
HDFS-7049	TestByteRangeInputStream.testPropagatedClose fails and throw NPE on branch-2	Minor	test	Juan Yu	Juan Yu
HDFS-7046	HA NN can NPE upon transition to active	Critical	namenode	Daryn Sharp	Kihwal Lee
HDFS-7045	Fix NameNode deadlock when opening file under /.reserved path	Critical	namenode	Yi Liu	Yi Liu
HDFS-7042	Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode.	Blocker	journal-node	Chris Nauroth	Chris Nauroth
HDFS-7005	DFS input streams do not timeout	Critical	hdfs-client	Daryn Sharp	Daryn Sharp
HDFS-7001	Tests in TestTracing should not depend on the order of execution	Minor	.	Masatake Iwasaki	Masatake Iwasaki
HDFS-6996	SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file	Major	snapshots	Jing Zhao	Jing Zhao
HDFS-6995	Block should be placed in the client's ‘rack-local’ node if ‘client-local’ node is not available	Major	namenode	Vinayakumar B	Vinayakumar B
HDFS-6981	Fix DN upgrade with layout version change	Major	datanode	James Thomas	Arpit Agarwal
HDFS-6979	hdfs.dll does not produce .pdb files	Minor	hdfs-client	Remus Rusanu	Chris Nauroth
HDFS-6972	TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctly	Major	.	Yongjun Zhang	Yongjun Zhang
HDFS-6965	NN continues to issue block locations for DNs with full disks	Major	namenode	Daryn Sharp	Rushabh S Shah
HDFS-6954	With crypto, no native lib systems are too verbose	Major	encryption	Allen Wittenauer	Charles Lamb
HDFS-6948	DN rejects blocks if it has older UC block	Major	.	Daryn Sharp	Eric Payne
HDFS-6942	Fix typos in log messages	Trivial	.	Ray Chiang	Ray Chiang
HDFS-6912	SharedFileDescriptorFactory should not allocate sparse files	Minor	caching	Gopal V	Colin Patrick McCabe
HDFS-6908	incorrect snapshot directory diff generated by snapshot deletion	Critical	snapshots	Juan Yu	Juan Yu
HDFS-6905	fs-encryption merge triggered release audit failures	Blocker	.	Allen Wittenauer	Charles Lamb
HDFS-6904	YARN unable to renew delegation token fetched via webhdfs due to incorrect service port	Critical	webhdfs	Varun Vasudev	Jitendra Nath Pandey
HDFS-6902	FileWriter should be closed in finally block in BlockReceiver#receiveBlock()	Minor	.	Ted Yu	Tsuyoshi Ozawa
HDFS-6898	DN must reserve space for a full block when an RBW block is created	Major	datanode	Gopal V	Arpit Agarwal
HDFS-6890	NFS readdirplus doesn't return dotdot attributes	Major	nfs	Brandon Li	Brandon Li
HDFS-6870	Blocks and INodes could leak for Rename with overwrite flag	Major	namenode	Yi Liu	Yi Liu
HDFS-6868	portmap and nfs3 are documented as hadoop commands instead of hdfs	Major	documentation, nfs	Allen Wittenauer	Brandon Li
HDFS-6862	Add missing timeout annotations to tests	Major	test	Arpit Agarwal	Xiaoyu Yao
HDFS-6848	Lack of synchronization on access to datanodeUuid in DataStorage#format()	Minor	.	Ted Yu	Xiaoyu Yao
HDFS-6840	Clients are always sent to the same datanode when read is off rack	Critical	.	Jason Lowe	Andrew Wang
HDFS-6838	Code cleanup for unnecessary INode replacement	Minor	namenode	Jing Zhao	Jing Zhao
HDFS-6831	Inconsistency between ‘hdfs dfsadmin’ and ‘hdfs dfsadmin -help’	Minor	.	Akira AJISAKA	Xiaoyu Yao
HDFS-6830	BlockInfo.addStorage fails when DN changes the storage for a block replica	Major	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-6829	DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster	Minor	tools	zhaoyunjiong	zhaoyunjiong
HDFS-6825	Edit log corruption due to delayed block removal	Major	namenode	Yongjun Zhang	Yongjun Zhang
HDFS-6823	dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS	Minor	namenode	Allen Wittenauer	Allen Wittenauer
HDFS-6810	StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports	Minor	namenode	Ted Yu	Tsz Wo Nicholas Sze
HDFS-6802	Some tests in TestDFSClientFailover are missing @Test annotation	Major	test	Akira AJISAKA	Akira AJISAKA
HDFS-6799	The invalidate method in SimulatedFSDataset.java failed to remove (invalidate) blocks from the file system.	Minor	datanode, test	Megasthenis Asteris	Megasthenis Asteris
HDFS-6797	DataNode logs wrong layoutversion during upgrade	Major	datanode	Benoy Antony	Benoy Antony
HDFS-6791	A block could remain under replicated if all of its replicas are on decommissioned nodes	Major	.	Ming Ma	Ming Ma
HDFS-6790	DFSUtil Should Use configuration.getPassword for SSL passwords	Major	.	Larry McCay	Larry McCay
HDFS-6789	TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7	Major	test	Rushabh S Shah	Akira AJISAKA
HDFS-6788	Improve synchronization in BPOfferService with read write lock	Major	datanode	Yongjun Zhang	Yongjun Zhang
HDFS-6787	Remove duplicate code in FSDirectory#unprotectedConcat	Major	namenode	Yi Liu	Yi Liu
HDFS-6783	Fix HDFS CacheReplicationMonitor rescan logic	Major	caching	Yi Liu	Yi Liu
HDFS-6778	The extended attributes javadoc should simply refer to the user docs	Major	.	Charles Lamb	Charles Lamb
HDFS-6776	Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work	Major	.	Yongjun Zhang	Yongjun Zhang
HDFS-6768	Fix a few unit tests that use hard-coded port numbers	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-6754	TestNamenodeCapacityReport.testXceiverCount may sometimes fail due to lack of retry	Major	.	Mit Desai	Mit Desai
HDFS-6749	FSNamesystem methods should call resolvePath	Major	namenode	Charles Lamb	Charles Lamb
HDFS-6731	Run “hdfs zkfc-formatZK” on a server in a non-namenode will cause a null pointer exception.	Major	auto-failover, ha	WenJin Ma	Masatake Iwasaki
HDFS-6715	webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode	Major	ha, webhdfs	Arpit Gupta	Jing Zhao
HDFS-6714	TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster	Minor	test	Vinayakumar B	Vinayakumar B
HDFS-6704	Fix the command to launch JournalNode in HDFS-HA document	Minor	documentation	Akira AJISAKA	Akira AJISAKA
HDFS-6702	DFSClient should create blocks using StorageType	Major	datanode, hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-6693	TestDFSAdminWithHA fails on windows	Major	test, tools	Vinayakumar B	Vinayakumar B
HDFS-6689	NFS doesn't return correct lookup access for directories	Major	nfs	Yesha Vora	Brandon Li
HDFS-6678	MiniDFSCluster may still be partially running after initialization fails.	Minor	test	Chris Nauroth	Chris Nauroth
HDFS-6667	In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error	Major	security	Jian He	Jing Zhao
HDFS-6664	HDFS permissions guide documentation states incorrect default group mapping class.	Trivial	documentation	Chris Nauroth	Ray Chiang
HDFS-6646	[ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missed	Major	tools	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-6640	[ Web HDFS ] Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly(missed webhdfs/v1).).	Major	documentation, webhdfs	Brahma Reddy Battula	Stephen Chu
HDFS-6630	Unable to fetch the block information by Browsing the file system on Namenode UI through IE9	Major	namenode	J.Andreina	Haohui Mai
HDFS-6621	Hadoop Balancer prematurely exits iterations	Major	balancer & mover	Benjamin Bowman	Rafal Wojdyla
HDFS-6616	bestNode shouldn't always return the first DataNode	Minor	webhdfs	zhaoyunjiong	zhaoyunjiong
HDFS-6582	Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)	Minor	nfs	Ted Yu	Abhiraj Butala
HDFS-6569	OOB message can't be sent to the client when DataNode shuts down for upgrade	Major	datanode	Brandon Li	Brandon Li
HDFS-6567	Normalize the order of public final in HdfsFileStatus	Major	.	Haohui Mai	Tassapol Athiapinya
HDFS-6544	Broken Link for GFS in package.html	Minor	.	Suraj Nayak M	Suraj Nayak M
HDFS-6534	Fix build on macosx: HDFS parts	Minor	.	Binglin Chang	Binglin Chang
HDFS-6517	Remove hadoop-metrics2.properties from hdfs project	Major	.	Akira AJISAKA	Akira AJISAKA
HDFS-6506	Newly moved block replica been invalidated and deleted in TestBalancer	Major	balancer & mover, test	Binglin Chang	Binglin Chang
HDFS-6478	RemoteException can't be retried properly for non-HA scenario	Major	.	Ming Ma	Ming Ma
HDFS-6456	NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts	Major	nfs	Yesha Vora	Abhiraj Butala
HDFS-6455	NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hosts	Major	nfs	Yesha Vora	Abhiraj Butala
HDFS-6451	NFS should not return NFS3ERR_IO for AccessControlException	Major	nfs	Brandon Li	Abhiraj Butala
HDFS-6376	Distcp data between two HA clusters requires another configuration	Major	datanode, federation, hdfs-client	Dave Marion	Dave Marion
HDFS-6247	Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer	Major	balancer & mover, datanode	Vinayakumar B	Vinayakumar B
HDFS-6114	Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr	Critical	datanode	Vinayakumar B	Vinayakumar B
HDFS-5919	FileJournalManager doesn't purge empty and corrupt inprogress edits files	Major	namenode	Vinayakumar B	Vinayakumar B
HDFS-5809	BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop	Critical	datanode	ikweesung	Colin Patrick McCabe
HDFS-5723	Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction	Major	namenode	Vinayakumar B	Vinayakumar B
HDFS-5185	DN fails to startup if one of the data dir is full	Critical	datanode	Vinayakumar B	Vinayakumar B
HDFS-5089	When a LayoutVersion support SNAPSHOT, it must support FSIMAGE_NAME_OPTIMIZATION.	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-4852	libhdfs documentation is out of date	Minor	.	Andrew Wang	Chris Nauroth
HDFS-4629	Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA	Major	tools	Amir Sanjar
HDFS-4227	Document dfs.namenode.resource.*	Major	documentation	Eli Collins	Daisuke Kobayashi
HDFS-4165	Faulty sanity check in FsDirectory.unprotectedSetQuota	Trivial	namenode	Binglin Chang	Binglin Chang
HDFS-3482	hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified without arguments	Minor	balancer & mover	Stephen Chu	madhukara phatak
HDFS-2976	Remove unnecessary method (tokenRefetchNeeded) in DFSClient	Trivial	hdfs-client	Uma Maheswara Rao G	Uma Maheswara Rao G
HDFS-2975	Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).	Major	namenode	Uma Maheswara Rao G	Yi Liu
MAPREDUCE-6156	Fetcher - connect() doesn't handle connection refused correctly	Blocker	.	Sidharta Seethana	Junping Du
MAPREDUCE-6126	(Rumen) Rumen tool returns error “ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type”	Major	.	Junping Du	Junping Du
MAPREDUCE-6125	TestContainerLauncherImpl sometimes fails	Major	test	Mit Desai	Mit Desai
MAPREDUCE-6123	TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances.	Trivial	test	Chris Nauroth	Chris Nauroth
MAPREDUCE-6122	TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings.	Trivial	test	Chris Nauroth	Chris Nauroth
MAPREDUCE-6109	Fix minor typo in distcp -p usage text	Trivial	distcp	Charles Lamb	Charles Lamb
MAPREDUCE-6104	TestJobHistoryParsing.testPartialJob fails in branch-2	Major	.	Mit Desai	Mit Desai
MAPREDUCE-6095	Enable DistributedCache for uber-mode Jobs	Major	applicationmaster, distributed-cache	Gera Shegalov	Gera Shegalov
MAPREDUCE-6094	TestMRCJCFileInputFormat.testAddInputPath() fails on trunk	Minor	test	Sangjin Lee	Akira AJISAKA
MAPREDUCE-6093	minor distcp doc edits	Trivial	distcp, documentation	Charles Lamb	Charles Lamb
MAPREDUCE-6091	YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view	Major	client	Sangjin Lee	Sangjin Lee
MAPREDUCE-6090	mapred hsadmin getGroups fails to connect in some cases	Major	client	Robert Kanter	Robert Kanter
MAPREDUCE-6087	MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS config name is wrong	Major	.	Jian He	Akira AJISAKA
MAPREDUCE-6075	HistoryServerFileSystemStateStore can create zero-length files	Major	jobhistoryserver	Jason Lowe	Jason Lowe
MAPREDUCE-6073	Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags	Trivial	documentation	Tsuyoshi Ozawa	Tsuyoshi Ozawa
MAPREDUCE-6063	In sortAndSpill of MapTask.java, size is calculated wrongly when bufend < bufstart.	Major	mrv1, mrv2	zhihai xu	zhihai xu
MAPREDUCE-6052	Support overriding log4j.properties per job	Major	.	Junping Du	Junping Du
MAPREDUCE-6051	Fix typos in log messages	Trivial	.	Ray Chiang	Ray Chiang
MAPREDUCE-6044	Fully qualified intermediate done directory will break per-user dir creation on Windows	Major	jobhistoryserver	Zhijie Shen	Zhijie Shen
MAPREDUCE-6041	Fix TestOptionsParser	Major	security	Charles Lamb	Charles Lamb
MAPREDUCE-6036	TestJobEndNotifier fails intermittently in branch-2	Major	.	Mit Desai	Chang Li
MAPREDUCE-6032	Unable to check mapreduce job status if submitted using a non-default namenode	Major	jobhistoryserver	Benjamin Zhitomirsky	Benjamin Zhitomirsky
MAPREDUCE-6029	TestCommitterEventHandler fails in trunk	Major	.	Ted Yu	Mit Desai
MAPREDUCE-6022	map_input_file is missing from streaming job environment	Major	.	Jason Lowe	Jason Lowe
MAPREDUCE-6021	MR AM should have working directory in LD_LIBRARY_PATH	Major	mr-am	Jason Lowe	Jason Lowe
MAPREDUCE-6019	MapReduce changes for exposing YARN/MR endpoints on multiple interfaces.	Major	.	Xuan Gong	Craig Welch
MAPREDUCE-6014	New task status field in task attempts table can lead to an empty web page	Major	.	Mit Desai	Mit Desai
MAPREDUCE-6012	DBInputSplit creates invalid ranges on Oracle	Major	.	Julien Serdaru	Wei Yan
MAPREDUCE-6010	HistoryServerFileSystemStateStore fails to update tokens	Major	jobhistoryserver	Jason Lowe	Jason Lowe
MAPREDUCE-5999	Fix dead link in InputFormat javadoc	Minor	documentation	Akira AJISAKA	Akira AJISAKA
MAPREDUCE-5998	CompositeInputFormat javadoc is broken	Minor	documentation	Akira AJISAKA	Akira AJISAKA
MAPREDUCE-5960	JobSubmitter's check whether job.jar is local is incorrect with no authority in job jar path.	Major	client	Gera Shegalov	Gera Shegalov
MAPREDUCE-5958	Wrong reduce task progress if map output is compressed	Minor	.	Emilio Coppa	Emilio Coppa
MAPREDUCE-5957	AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used	Major	.	Sangjin Lee	Sangjin Lee
MAPREDUCE-5950	incorrect description in distcp2 document	Major	documentation	Yongjun Zhang	Akira AJISAKA
MAPREDUCE-5931	Validate SleepJob command line parameters	Minor	test	Gera Shegalov	Gera Shegalov
MAPREDUCE-5885	build/test/test.mapred.spill causes release audit warnings	Major	test	Jason Lowe	Chen He
MAPREDUCE-5878	some standard JDK APIs are not part of system classes defaults	Major	mrv2	Sangjin Lee	Sangjin Lee
MAPREDUCE-5873	Shuffle bandwidth computation includes time spent waiting for maps	Major	.	Siqi Li	Siqi Li
MAPREDUCE-5831	Old MR client is not compatible with new MR application	Blocker	client, mr-am	Zhijie Shen	Junping Du
MAPREDUCE-5796	Use current version of the archive name in DistributedCacheDeploy document	Minor	documentation	Akira AJISAKA	Akira AJISAKA
MAPREDUCE-5756	CombineFileInputFormat.getSplits() including directories in its results	Major	.	Jason Dere	Jason Dere
MAPREDUCE-5597	Missing alternatives in javadocs for deprecated constructors in mapreduce.Job	Minor	client, documentation, job submission	Christopher Tubbs	Akira AJISAKA
MAPREDUCE-5595	Typo in MergeManagerImpl.java	Trivial	.	Efe Gencer	Akira AJISAKA
MAPREDUCE-5542	Killing a job just as it finishes can generate an NPE in client	Major	client, mrv2	Jason Lowe	Rohith Sharma K S
MAPREDUCE-5363	Fix doc and spelling for TaskCompletionEvent#getTaskStatus and getStatus	Minor	mrv1, mrv2	Sandy Ryza	Akira AJISAKA
MAPREDUCE-5279	Jobs can deadlock if headroom is limited by cpu instead of memory	Critical	mrv2, scheduler	Peng Zhang	Peng Zhang
YARN-2853	Killing app may hang while AM is unregistering	Major	.	Jian He	Jian He
YARN-2846	Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart.	Blocker	nodemanager	Junping Du	Junping Du
YARN-2834	Resource manager crashed with Null Pointer Exception	Blocker	.	Yesha Vora	Jian He
YARN-2830	Add backwords compatible ContainerId.newInstance constructor for use within Tez Local Mode	Blocker	.	Jonathan Eagles	Jonathan Eagles
YARN-2827	Fix bugs of yarn queue CLI	Critical	client	Wangda Tan	Wangda Tan
YARN-2826	User-Group mappings not updated by RM when a user is removed from a group.	Critical	.	Sidharta Seethana	Wangda Tan
YARN-2825	Container leak on NM	Critical	.	Jian He	Jian He
YARN-2823	NullPointerException in RM HA enabled 3-node cluster	Critical	resourcemanager	Gour Saha	Jian He
YARN-2819	NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6	Critical	timelineserver	Gopal V	Zhijie Shen
YARN-2818	Remove the logic to inject entity owner as the primary filter	Critical	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2813	NPE from MemoryTimelineStore.getDomains	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2805	RM2 in HA setup tries to login using the RM1's kerberos principal	Blocker	resourcemanager	Arpit Gupta	Wangda Tan
YARN-2804	Timeline server .out log have JAXB binding exceptions and warnings.	Critical	.	Zhijie Shen	Zhijie Shen
YARN-2803	MR distributed cache not working correctly on Windows after NodeManager privileged account changes.	Critical	nodemanager	Chris Nauroth	Craig Welch
YARN-2798	YarnClient doesn't need to translate Kerberos name of timeline DT renewer	Blocker	timelineserver	Arpit Gupta	Zhijie Shen
YARN-2794	Fix log msgs about distributing system-credentials	Major	.	Jian He	Jian He
YARN-2790	NM can't aggregate logs past HDFS delegation token expiry.	Critical	nodemanager	Tassapol Athiapinya	Jian He
YARN-2788	yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0	Blocker	log-aggregation	Gopal V	Xuan Gong
YARN-2779	SystemMetricsPublisher can use Kerberos directly instead of timeline DT	Critical	resourcemanager, timelineserver	Zhijie Shen	Zhijie Shen
YARN-2769	Timeline server domain not set correctly when using shell_command on Windows	Major	applications/distributed-shell	Varun Vasudev	Varun Vasudev
YARN-2760	Completely remove word ‘experimental’ from FairScheduler docs	Trivial	documentation	Harsh J	Harsh J
YARN-2755	NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661	Critical	.	Siqi Li	Siqi Li
YARN-2752	ContainerExecutor always append “nice -n” in command on branch-2	Critical	.	Xuan Gong	Xuan Gong
YARN-2743	Yarn jobs via oozie fail with failed to renew token (secure) or digest mismatch (unsecure) errors when RM is being killed	Blocker	resourcemanager	Arpit Gupta	Jian He
YARN-2741	Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanager is running on)	Major	nodemanager	Craig Welch	Craig Welch
YARN-2734	If a sub-folder is encountered by log aggregator it results in invalid aggregated file	Major	log-aggregation	Sumit Mohanty	Xuan Gong
YARN-2732	Fix syntax error in SecureContainer.apt.vm	Major	.	Jian He	Jian He
YARN-2730	DefaultContainerExecutor runs only one localizer at a time	Critical	.	Siqi Li	Siqi Li
YARN-2724	If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed	Major	log-aggregation	Sumit Mohanty	Xuan Gong
YARN-2721	Race condition: ZKRMStateStore retry logic may throw NodeExist exception	Blocker	.	Jian He	Jian He
YARN-2720	Windows: Wildcard classpath variables not expanded against resources contained in archives	Major	nodemanager	Craig Welch	Craig Welch
YARN-2715	Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.	Blocker	resourcemanager	Zhijie Shen	Zhijie Shen
YARN-2707	Potential null dereference in FSDownload	Minor	.	Ted Yu	Gera Shegalov
YARN-2701	Potential race condition in startLocalizer when using LinuxContainerExecutor	Blocker	.	Xuan Gong	Xuan Gong
YARN-2682	WindowsSecureContainerExecutor should not depend on DefaultContainerExecutor#getFirstApplicationDir.	Minor	nodemanager	zhihai xu	zhihai xu
YARN-2671	ApplicationSubmissionContext change breaks the existing app submission	Blocker	resourcemanager	Zhijie Shen	Wangda Tan
YARN-2667	Fix the release audit warning caused by hadoop-yarn-registry	Minor	.	Yi Liu	Yi Liu
YARN-2662	TestCgroupsLCEResourcesHandler leaks file descriptors.	Minor	test	Chris Nauroth	Chris Nauroth
YARN-2656	RM web services authentication filter should add support for proxy user	Major	resourcemanager	Varun Vasudev	Zhijie Shen
YARN-2649	Flaky test TestAMRMRPCNodeUpdates	Major	.	Ming Ma	Ming Ma
YARN-2635	TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS	Major	.	Wei Yan	Wei Yan
YARN-2630	TestDistributedShell#testDSRestartWithPreviousRunningContainers fails	Major	.	Jian He	Jian He
YARN-2628	Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free	Major	capacityscheduler	Varun Vasudev	Varun Vasudev
YARN-2624	Resource Localization fails on a cluster due to existing cache directories	Blocker	nodemanager	Anubhav Dhoot	Anubhav Dhoot
YARN-2617	NM does not need to send finished container whose APP is not running to RM	Major	nodemanager	Jun Gong	Jun Gong
YARN-2610	Hamlet should close table tags	Major	.	Ray Chiang	Ray Chiang
YARN-2608	FairScheduler: Potential deadlocks in loading alloc files and clock access	Major	.	Wei Yan	Wei Yan
YARN-2606	Application History Server tries to access hdfs before doing secure login	Major	timelineserver	Mit Desai	Mit Desai
YARN-2602	Generic History Service of TimelineServer sometimes not able to handle NPE	Major	timelineserver	Karam Singh	Zhijie Shen
YARN-2594	Potential deadlock in RM when querying ApplicationResourceUsageReport	Blocker	resourcemanager	Karam Singh	Wangda Tan
YARN-2588	Standby RM does not transitionToActive if previous transitionToActive is failed with ZK exception.	Major	resourcemanager	Rohith Sharma K S	Rohith Sharma K S
YARN-2579	Deadlock when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time	Blocker	resourcemanager	Rohith Sharma K S	Rohith Sharma K S
YARN-2568	TestAMRMClientOnRMRestart test fails	Major	.	Jian He	Jian He
YARN-2565	RM shouldn't use the old RMApplicationHistoryWriter unless explicitly setting FileSystemApplicationHistoryStore	Major	resourcemanager, timelineserver	Karam Singh	Zhijie Shen
YARN-2563	On secure clusters call to timeline server fails with authentication errors when running a job via oozie	Blocker	timelineserver	Arpit Gupta	Zhijie Shen
YARN-2562	ContainerId@toString() is unreadable for epoch >0 after YARN-2182	Critical	.	Vinod Kumar Vavilapalli	Tsuyoshi Ozawa
YARN-2559	ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher	Major	resourcemanager, timelineserver	Karam Singh	Zhijie Shen
YARN-2557	Add a parameter “attempt_Failures_Validity_Interval” in DistributedShell	Major	applications/distributed-shell	Xuan Gong	Xuan Gong
YARN-2546	REST API for application creation/submission is using strings for numeric & boolean values	Major	api	Doug Haigh	Varun Vasudev
YARN-2541	Fix ResourceManagerRest.apt.vm syntax error	Major	.	Jian He	Jian He
YARN-2540	FairScheduler: Queue filters not working on scheduler page in RM UI	Major	scheduler	Ashwin Shankar	Ashwin Shankar
YARN-2534	FairScheduler: Potential integer overflow calculating totalMaxShare	Major	scheduler	zhihai xu	zhihai xu
YARN-2527	NPE in ApplicationACLsManager	Major	resourcemanager	Benoy Antony	Benoy Antony
YARN-2526	SLS can deadlock when all the threads are taken by AMSimulators	Critical	scheduler-load-simulator	Wei Yan	Wei Yan
YARN-2523	ResourceManager UI showing negative value for “Decommissioned Nodes” field	Major	resourcemanager, webapp	Nishan Shetty	Rohith Sharma K S
YARN-2484	FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block	Trivial	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-2462	TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync should have a test timeout	Major	.	Jason Lowe	Eric Payne
YARN-2460	Remove obsolete entries from yarn-default.xml	Minor	.	Ray Chiang	Ray Chiang
YARN-2459	RM crashes if App gets rejected for any reason and HA is enabled	Major	resourcemanager	Mayank Bansal	Mayank Bansal
YARN-2453	TestProportionalCapacityPreemptionPolicy fails with FairScheduler	Major	.	zhihai xu	zhihai xu
YARN-2452	TestRMApplicationHistoryWriter fails with FairScheduler	Major	.	zhihai xu	zhihai xu
YARN-2450	Fix typos in log messages	Trivial	.	Ray Chiang	Ray Chiang
YARN-2449	Timelineserver returns invalid Delegation token in secure kerberos enabled cluster when hadoop.http.filter.initializers are not set	Critical	timelineserver	Karam Singh	Varun Vasudev
YARN-2447	RM web services app submission doesn't pass secrets correctly	Major	.	Varun Vasudev	Varun Vasudev
YARN-2440	Cgroups should allow YARN containers to be limited to allocated cores	Major	.	Varun Vasudev	Varun Vasudev
YARN-2426	ResourceManger is not able renew WebHDFS token when application submitted by Yarn WebService	Major	nodemanager, resourcemanager, webapp	Karam Singh	Varun Vasudev
YARN-2424	LCE should support non-cgroups, non-secure mode	Blocker	nodemanager	Allen Wittenauer	Allen Wittenauer
YARN-2409	Active to StandBy transition does not stop rmDispatcher that causes 1 AsyncDispatcher thread leak.	Critical	resourcemanager	Nishan Shetty	Rohith Sharma K S
YARN-2405	NPE in FairSchedulerAppsBlock	Major	.	Maysam Yabandeh	Tsuyoshi Ozawa
YARN-2400	TestAMRestart fails intermittently	Major	.	Jian He	Jian He
YARN-2397	RM and TS web interfaces sometimes return request is a replay error in secure mode	Critical	.	Varun Vasudev	Varun Vasudev
YARN-2387	Resource Manager crashes with NPE due to lack of synchronization	Blocker	.	Mit Desai	Mit Desai
YARN-2374	YARN trunk build failing TestDistributedShell.testDSShell	Major	.	Varun Vasudev	Varun Vasudev
YARN-2373	WebAppUtils Should Use configuration.getPassword for Accessing SSL Passwords	Major	.	Larry McCay	Larry McCay
YARN-2370	Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo	Trivial	resourcemanager	Wenwu Peng	Wenwu Peng
YARN-2363	Submitted applications occasionally lack a tracking URL	Major	resourcemanager	Jason Lowe	Jason Lowe
YARN-2359	Application hangs when it fails to launch AM container	Critical	resourcemanager	zhihai xu	zhihai xu
YARN-2321	NodeManager web UI can incorrectly report Pmem enforcement	Major	nodemanager	Leitao Guo	Leitao Guo
YARN-2314	ContainerManagementProtocolProxy can create thousands of threads for a large cluster	Critical	client	Jason Lowe	Jason Lowe
YARN-2313	Livelock can occur in FairScheduler when there are lots of running apps	Major	fairscheduler	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-2308	NPE happened when RM restart after CapacityScheduler queue configuration changed	Critical	resourcemanager, scheduler	Wangda Tan	Chang Li
YARN-2273	NPE in ContinuousScheduling thread when we lose a node	Major	fairscheduler, resourcemanager	Andy Skelton	Wei Yan
YARN-2269	External links need to be removed from YARN UI	Major	.	Yesha Vora	Craig Welch
YARN-2264	Race in DrainDispatcher can cause random test failures	Major	.	Siddharth Seth	Li Lu
YARN-2252	Intermittent failure of TestFairScheduler.testContinuousScheduling	Major	scheduler	Ratandeep Ratti
YARN-2251	Avoid negative elapsed time in JHS/MRAM web UI and services	Major	.	Zhijie Shen	Zhijie Shen
YARN-2244	FairScheduler missing handling of containers for unknown application attempts	Critical	fairscheduler	Anubhav Dhoot	Anubhav Dhoot
YARN-2219	AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts	Major	resourcemanager	Ashwin Shankar	Jian He
YARN-2181	Add preemption info to RM Web UI and add logs when preemption occurs	Major	resourcemanager, webapp	Wangda Tan	Wangda Tan
YARN-2161	Fix build on macosx: YARN parts	Major	.	Binglin Chang	Binglin Chang
YARN-2147	client lacks delegation token exception details when application submit fails	Minor	resourcemanager	Jason Lowe	Chen He
YARN-2138	Cleanup notifyDone* methods in RMStateStore	Major	.	Jian He	Varun Saxena
YARN-2088	Fix code bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder	Major	.	Binglin Chang	Binglin Chang
YARN-2034	Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect	Minor	nodemanager	Jason Lowe	Chen He
YARN-2026	Fair scheduler: Consider only active queues for computing fairshare	Major	scheduler	Ashwin Shankar	Ashwin Shankar
YARN-2010	Handle app-recovery failures gracefully	Blocker	resourcemanager	bc Wong	Karthik Kambatla
YARN-1959	Fix headroom calculation in FairScheduler	Major	.	Sandy Ryza	Anubhav Dhoot
YARN-1922	Process group remains alive after container process is killed externally	Major	nodemanager	Billie Rinaldi	Billie Rinaldi
YARN-1919	Potential NPE in EmbeddedElectorService#stop	Minor	resourcemanager	Devaraj K	Tsuyoshi Ozawa
YARN-1796	container-executor shouldn't require o-r permissions	Minor	nodemanager	Aaron T. Myers	Aaron T. Myers

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-11253	Hadoop streaming test TestStreamXmlMultipleRecords fails on Windows	Major	tools	Varun Vasudev	Varun Vasudev
HADOOP-11241	TestNMSimulator fails sometimes due to timing issue	Major	.	Varun Vasudev	Varun Vasudev
HADOOP-11088	Unittest TestKeyShell, TestCredShell and TestKMS assume UNIX path separator for JECKS key store path	Major	security	Xiaoyu Yao	Xiaoyu Yao
HADOOP-11073	Credential Provider related Unit Tests Failure on Windows	Major	security	Xiaoyu Yao	Xiaoyu Yao
HADOOP-11071	KMSClientProvider should drain the local generated EEK cache on key rollover	Minor	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11070	Create MiniKMS for testing	Major	security, test	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-11060	Create a CryptoCodec test that verifies interoperability between the JCE and OpenSSL implementations	Major	security	Alejandro Abdelnur	Yi Liu
HDFS-7355	TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails on Windows, because we cannot deny access to the file owner.	Trivial	test	Chris Nauroth	Chris Nauroth
HDFS-7126	TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path	Minor	security, test	Xiaoyu Yao	Xiaoyu Yao
HDFS-7115	TestEncryptionZones assumes Unix path separator for KMS key store path	Major	encryption	Xiaoyu Yao	Xiaoyu Yao
HDFS-7051	TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator.	Minor	datanode, test	Chris Nauroth	Chris Nauroth
HDFS-7025	HDFS Credential Provider related Unit Test Failure	Major	encryption	Xiaoyu Yao	Xiaoyu Yao
HDFS-7006	Test encryption zones with KMS	Major	security, test	Alejandro Abdelnur	Alejandro Abdelnur
HDFS-6878	Change MiniDFSCluster to support StorageType configuration for individual directories	Minor	test	Tsz Wo Nicholas Sze	Arpit Agarwal
HDFS-6665	Add tests for XAttrs in combination with viewfs	Major	hdfs-client	Stephen Chu	Stephen Chu
HDFS-6645	Add test for successive Snapshots between XAttr modifications	Minor	snapshots, test	Stephen Chu	Stephen Chu
HDFS-6638	shorten test run time with a smaller retry timeout setting	Major	test	Liang Xie	Liang Xie
HDFS-6617	Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op	Minor	auto-failover, test	Liang Xie	Liang Xie
HDFS-5624	Add HDFS tests for ACLs in combination with viewfs.	Major	hdfs-client, test	Chris Nauroth	Stephen Chu
MAPREDUCE-6115	TestPipeApplication#testSubmitter fails in trunk	Minor	.	Ted Yu	Binglin Chang
MAPREDUCE-6048	TestJavaSerialization fails in trunk build	Minor	.	Ted Yu	Varun Vasudev
MAPREDUCE-5866	TestFixedLengthInputFormat fails in windows	Major	client, test	Varun Vasudev	Varun Vasudev
YARN-2812	TestApplicationHistoryServer is likely to fail on less powerful machine	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2810	TestRMProxyUsersConf fails on Windows VMs	Major	resourcemanager	Varun Vasudev	Varun Vasudev
YARN-2785	TestContainerResourceUsage fails intermittently	Major	.	Varun Vasudev	Varun Vasudev
YARN-2767	RM web services - add test case to ensure the http static user cannot kill or submit apps in secure mode	Major	resourcemanager	Varun Vasudev	Varun Vasudev
YARN-2758	Update TestApplicationHistoryClientService to use the new generic history store	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2747	TestAggregatedLogFormat fails in trunk	Major	.	Xuan Gong	Xuan Gong
YARN-2711	TestDefaultContainerExecutor#testContainerLaunchError fails on Windows	Major	.	Varun Vasudev	Varun Vasudev
YARN-2607	TestDistributedShell fails in trunk	Major	.	Ted Yu	Wangda Tan
YARN-2596	TestWorkPreservingRMRestart fails with FairScheduler	Major	.	Junping Du	Karthik Kambatla
YARN-2584	TestContainerManagerSecurity fails on trunk	Major	.	Zhijie Shen	Jian He
YARN-2549	TestContainerLaunch fails due to classpath problem with hamcrest classes.	Minor	nodemanager, test	Chris Nauroth	Chris Nauroth
YARN-2519	Credential Provider related unit tests failed on Windows	Major	webapp	Xiaoyu Yao	Xiaoyu Yao
YARN-2388	TestTimelineWebServices fails on trunk after HADOOP-10791	Major	.	Zhijie Shen	Zhijie Shen
YARN-2158	TestRMWebServicesAppsModification sometimes fails in trunk	Minor	.	Ted Yu	Varun Vasudev

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-11074	Move s3-related FS connector code to hadoop-aws	Major	fs/s3	David S. Wang	David S. Wang
HADOOP-10933	FileBasedKeyStoresFactory Should use Configuration.getPassword for SSL Passwords	Major	security	Larry McCay	Larry McCay
HADOOP-10905	LdapGroupsMapping Should use configuration.getPassword for SSL and LDAP Passwords	Major	security	Larry McCay	Larry McCay
HADOOP-10886	CryptoCodec#getCodecclasses throws NPE when configurations not loaded.	Major	fs	Uma Maheswara Rao G	Uma Maheswara Rao G
HADOOP-10884	Fix dead link in Configuration javadoc	Minor	documentation	Akira AJISAKA	Akira AJISAKA
HADOOP-10868	Create a ZooKeeper-backed secret provider	Major	security	Robert Kanter	Robert Kanter
HADOOP-10650	Add ability to specify a reverse ACL (black list) of users and groups	Major	security	Benoy Antony	Benoy Antony
HADOOP-10635	Add a method to CryptoCodec to generate SRNs for IV	Major	security	Alejandro Abdelnur	Yi Liu
HADOOP-10632	Minor improvements to Crypto input and output streams	Major	security	Alejandro Abdelnur	Yi Liu
HADOOP-10282	Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls	Major	.	Chris Li	Chris Li
HADOOP-10281	Create a scheduler, which assigns schedulables a priority level	Major	.	Chris Li	Chris Li
HADOOP-10201	Add Listing Support to Key Management APIs	Major	security	Larry McCay	Larry McCay
HDFS-7291	Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows	Major	datanode	Xiaoyu Yao	Xiaoyu Yao
HDFS-7181	Remove incorrect precondition check on key length in FileEncryptionInfo	Critical	encryption	Andrew Wang	Andrew Wang
HDFS-7179	DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtension	Critical	encryption	Andrew Wang	Andrew Wang
HDFS-7171	Fix Jenkins failures in HDFS-6581 branch	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-7159	Use block storage policy to set lazy persist preference	Major	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-7157	Using Time.now() for recording start/end time of reconfiguration tasks	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-7155	Bugfix in createLocatedFileStatus caused by bad merge	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-7154	Fix returning value of starting reconfiguration task	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-7144	Fix findbugs warnings in RamDiskReplicaTracker	Minor	datanode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7143	Fix findbugs warnings in HDFS-6581 branch	Major	datanode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-7140	Add a tool to list all the existing block storage policies	Minor	hdfs-client, namenode	Jing Zhao	Jing Zhao
HDFS-7139	Unit test for creating encryption zone on root path	Minor	.	Zhe Zhang	Zhe Zhang
HDFS-7138	Fix hftp to work with encryption	Major	namenode	Charles Lamb	Charles Lamb
HDFS-7129	Metrics to track usage of memory for writes	Major	datanode	Arpit Agarwal	Xiaoyu Yao
HDFS-7124	Remove EncryptionZoneManager.NULL_EZ	Minor	namenode	Charles Lamb	Charles Lamb
HDFS-7119	Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics.	Minor	journal-node	Chris Nauroth	Chris Nauroth
HDFS-7118	Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename.	Major	journal-node, namenode	Chris Nauroth	Chris Nauroth
HDFS-7112	LazyWriter should use either async IO or one thread per physical disk	Major	datanode	Arpit Agarwal	Xiaoyu Yao
HDFS-7108	Fix unit test failures in SimulatedFsDataset	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-7100	Make eviction scheme pluggable	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-7095	TestStorageMover often fails in Jenkins	Minor	test	Tsz Wo Nicholas Sze	Jing Zhao
HDFS-7091	Add forwarding constructor for INodeFile for existing callers	Minor	namenode, test	Arpit Agarwal	Arpit Agarwal
HDFS-7090	Use unbuffered writes when persisting in-memory replicas	Major	datanode	Arpit Agarwal	Xiaoyu Yao
HDFS-7084	FsDatasetImpl#copyBlockFiles debug log can be improved	Minor	datanode	Xiaoyu Yao	Xiaoyu Yao
HDFS-7081	Add new DistributedFileSystem API for getting all the existing storage policies	Major	balancer & mover, namenode	Jing Zhao	Jing Zhao
HDFS-7080	Fix finalize and upgrade unit test failures	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-7079	Few more unit test fixes for HDFS-6581	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-7078	Fix listEZs to work correctly with snapshots	Major	encryption	Andrew Wang	Andrew Wang
HDFS-7077	Separate CipherSuite from crypto protocol version	Major	encryption	Andrew Wang	Andrew Wang
HDFS-7066	LazyWriter#evictBlocks misses a null check for replicaState	Minor	datanode	Xiaoyu Yao	Xiaoyu Yao
HDFS-7064	Fix unit test failures in HDFS-6581 branch	Major	test	Arpit Agarwal	Xiaoyu Yao
HDFS-7061	Add test to verify encryption zone creation after NameNode restart without saving namespace	Minor	encryption, test	Stephen Chu	Stephen Chu
HDFS-7047	Expose FileStatus#isEncrypted in libhdfs	Major	encryption	Andrew Wang	Colin Patrick McCabe
HDFS-7032	Add WebHDFS support for reading and writing to encryption zones	Major	encryption, webhdfs	Stephen Chu	Charles Lamb
HDFS-7004	Update KeyProvider instantiation to create by URI	Major	encryption	Andrew Wang	Andrew Wang
HDFS-7003	Add NFS Gateway support for reading and writing to encryption zones	Major	encryption, nfs	Stephen Chu	Charles Lamb
HDFS-6991	Notify NN of evicted block before deleting it from RAM disk	Major	datanode, namenode	Arpit Agarwal	Arpit Agarwal
HDFS-6990	Add unit test for evict/delete RAM_DISK block with open handle	Major	datanode	Xiaoyu Yao	Xiaoyu Yao
HDFS-6988	Improve HDFS-6581 eviction configuration	Major	datanode	Arpit Agarwal	Xiaoyu Yao
HDFS-6987	Move CipherSuite xattr information up to the encryption zone root	Major	encryption	Andrew Wang	Zhe Zhang
HDFS-6986	DistributedFileSystem must get delegation tokens from configured KeyProvider	Major	security	Alejandro Abdelnur	Zhe Zhang
HDFS-6978	Directory scanner should correctly reconcile blocks on RAM disk	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6977	Delete all copies when a block is deleted from the block space	Major	datanode	Nathan Yao	Arpit Agarwal
HDFS-6970	Move startFile EDEK retries to the DFSClient	Major	encryption	Andrew Wang	Andrew Wang
HDFS-6966	Add additional unit tests for encryption zones	Major	encryption	Stephen Chu	Stephen Chu
HDFS-6960	Bugfix in LazyWriter, fix test case and some refactoring	Major	datanode, test	Arpit Agarwal	Arpit Agarwal
HDFS-6956	Allow dynamically changing the tracing level in Hadoop servers	Major	datanode, namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-6951	Correctly persist raw namespace xattrs to edit log and fsimage	Major	encryption	Stephen Chu	Charles Lamb
HDFS-6950	Add Additional unit tests for HDFS-6581	Major	.	Xiaoyu Yao	Xiaoyu Yao
HDFS-6934	Move checksum computation off the hot path when writing to RAM disk	Major	datanode, hdfs-client	Arpit Agarwal	Chris Nauroth
HDFS-6932	Balancer and Mover tools should ignore replicas on RAM_DISK	Major	datanode	Arpit Agarwal	Xiaoyu Yao
HDFS-6931	Move lazily persisted replicas to finalized directory on DN startup	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6930	Improve replica eviction from RAM disk	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6929	NN periodically unlinks lazy persist files with missing replicas from namespace	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6928	‘hdfs put’ command should accept lazyPersist flag for testing	Major	datanode	Tassapol Athiapinya	Arpit Agarwal
HDFS-6927	Add unit tests	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6926	DN support for saving replicas to persistent storage and evicting in-memory replicas	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6925	DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6924	Add new RAM_DISK storage type	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6923	Propagate LazyPersist flag to DNs via DataTransferProtocol	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-6921	Add LazyPersist flag to FileStatus	Major	.	Arpit Agarwal	Arpit Agarwal
HDFS-6894	Add XDR parser method for each NFS response	Major	nfs	Brandon Li	Brandon Li
HDFS-6892	Add XDR packaging method for each NFS request	Major	nfs	Brandon Li	Brandon Li
HDFS-6880	Adding tracing to DataNode data transfer protocol	Major	.	Masatake Iwasaki	Masatake Iwasaki
HDFS-6879	Adding tracing to Hadoop RPC	Major	.	Masatake Iwasaki	Masatake Iwasaki
HDFS-6865	Byte array native checksumming on client side (HDFS changes)	Major	hdfs-client, performance	James Thomas	James Thomas
HDFS-6851	Refactor EncryptionZoneWithId and EncryptionZone	Major	namenode, security	Charles Lamb	Charles Lamb
HDFS-6843	Create FileStatus isEncrypted() method	Major	namenode, security	Charles Lamb	Charles Lamb
HDFS-6808	Add command line option to ask DataNode reload configuration.	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-6777	Supporting consistent edit log reads when in-progress edit log segments are included	Major	qjm	James Thomas	James Thomas
HDFS-6774	Make FsDataset and DataStore support removing volumes.	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-6750	The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale	Major	datanode, hdfs-client	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-6740	Make FSDataset support adding data volumes dynamically	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-6728	Dynamically add new volumes to DataStorage, formatted if necessary.	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-6727	Refresh data volumes on DataNode based on configuration changes	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-6722	Display readable last contact time for dead nodes on NN webUI	Major	.	Ming Ma	Ming Ma
HDFS-6717	Jira HDFS-5804 breaks default nfs-gateway behavior for unsecured config	Minor	nfs	Jeff Hansen	Brandon Li
HDFS-6705	Create an XAttr that disallows the HDFS admin from accessing a file	Major	namenode, security	Charles Lamb	Charles Lamb
HDFS-6609	Use DirectorySnapshottableFeature to represent a snapshottable directory	Major	namenode	Jing Zhao	Jing Zhao
HDFS-6385	Show when block deletion will start after NameNode startup in WebUI	Major	.	Jing Zhao	Chris Nauroth
HDFS-6036	Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long	Major	caching, datanode	Colin Patrick McCabe	Colin Patrick McCabe
MAPREDUCE-6142	Test failure in TestJobHistoryEventHandler and TestMRTimelineEventHandling	Critical	.	Zhijie Shen	Zhijie Shen
MAPREDUCE-6018	Create a framework specific config to enable timeline server	Major	.	Jonathan Eagles	Robert Kanter
MAPREDUCE-5974	Allow specifying multiple MapOutputCollectors with fallback	Major	task	Todd Lipcon	Todd Lipcon
MAPREDUCE-5963	ShuffleHandler DB schema should be versioned with compatible/incompatible changes	Major	.	Junping Du	Junping Du
MAPREDUCE-5956	MapReduce AM should not use maxAttempts to determine if this is the last retry	Blocker	applicationmaster, mrv2	Vinod Kumar Vavilapalli	Wangda Tan
MAPREDUCE-5945	Update the description of GenericOptionsParser -jt option	Minor	documentation	Akira AJISAKA	Akira AJISAKA
MAPREDUCE-5942	Remove MRv1 commands from CommandsManual.apt.vm	Minor	documentation	Akira AJISAKA	Akira AJISAKA
MAPREDUCE-5933	Enable MR AM to post history events to the timeline server	Major	mr-am	Zhijie Shen	Robert Kanter
MAPREDUCE-5891	Improved shuffle error handling across NM restarts	Major	.	Jason Lowe	Junping Du
YARN-2843	NodeLabels manager should trim all inputs for hosts and labels	Major	resourcemanager	Sushmitha Sreenivasan	Wangda Tan
YARN-2841	RMProxy should retry EOFException	Critical	resourcemanager	Jian He	Jian He
YARN-2824	Capacity of labels should be zero by default	Critical	resourcemanager	Wangda Tan	Wangda Tan
YARN-2795	Resource Manager fails startup with HDFS label storage and secure cluster	Major	resourcemanager	Phil D'Amore	Wangda Tan
YARN-2778	YARN node CLI should display labels on returned node reports	Major	client	Wangda Tan	Wangda Tan
YARN-2770	Timeline delegation tokens need to be automatically renewed by the RM	Critical	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2753	Fix potential issues and code clean up for *NodeLabelsManager	Major	.	zhihai xu	zhihai xu
YARN-2744	Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist	Critical	capacityscheduler	Sumit Mohanty	Wangda Tan
YARN-2726	CapacityScheduler should explicitly log when an accessible label has no capacity	Minor	capacityscheduler	Phil D'Amore	Wangda Tan
YARN-2723	rmadmin -replaceLabelsOnNode does not correctly parse port	Major	client	Phil D'Amore	Naganarasimha G R
YARN-2717	containerLogNotFound log shows multiple time for the same container	Major	log-aggregation	Xuan Gong	Xuan Gong
YARN-2709	Add retry for timeline client getDelegationToken method	Major	.	Li Lu	Li Lu
YARN-2705	Changes of RM node label manager default configuration	Critical	api, client, resourcemanager	Wangda Tan	Wangda Tan
YARN-2704	Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time	Critical	.	Jian He	Jian He
YARN-2703	Add logUploadedTime into LogValue for better display	Major	nodemanager, resourcemanager	Xuan Gong	Xuan Gong
YARN-2700	TestSecureRMRegistryOperations failing on windows: auth problems	Major	api, resourcemanager	Steve Loughran	Steve Loughran
YARN-2699	Fix test timeout in TestResourceTrackerOnHA#testResourceTrackerOnHA	Blocker	client	Wangda Tan	Wangda Tan
YARN-2698	Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService	Critical	api, client, resourcemanager	Wangda Tan	Wangda Tan
YARN-2692	ktutil test hanging on some machines/ktutil versions	Major	.	Steve Loughran	Steve Loughran
YARN-2689	TestSecureRMRegistryOperations failing on windows: secure ZK won't start	Major	api, resourcemanager	Steve Loughran	Steve Loughran
YARN-2685	Resource on each label not correct when multiple NMs in a same host and some has label some not	Major	api, client, resourcemanager	Wangda Tan	Wangda Tan
YARN-2678	Improved Yarn Registry service record structure	Major	api, resourcemanager	Gour Saha	Steve Loughran
YARN-2677	registry punycoding of usernames doesn't fix all usernames to be DNS-valid	Major	api, resourcemanager	Steve Loughran	Steve Loughran
YARN-2676	Timeline authentication filter should add support for proxy user	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2673	Add retry for timeline client put APIs	Major	.	Li Lu	Li Lu
YARN-2668	yarn-registry JAR won't link against ZK 3.4.5	Major	client	Steve Loughran	Steve Loughran
YARN-2652	add hadoop-yarn-registry package under hadoop-yarn	Major	api	Steve Loughran	Steve Loughran
YARN-2651	Spin off the LogRollingInterval from LogAggregationContext	Major	nodemanager, resourcemanager	Xuan Gong	Xuan Gong
YARN-2647	Add yarn queue CLI to get queue infos	Major	client	Wangda Tan	Sunil G
YARN-2644	Recalculate headroom more frequently to keep it accurate	Major	.	Craig Welch	Craig Welch
YARN-2632	Document NM Restart feature	Blocker	nodemanager	Junping Du	Junping Du
YARN-2629	Make distributed shell use the domain-based timeline ACLs	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2621	Simplify the output when the user doesn't have the access for getDomain(s)	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2611	Fix jenkins findbugs warning and test case failures for trunk merge patch	Major	capacityscheduler, resourcemanager, scheduler	Subru Krishnan	Subru Krishnan
YARN-2591	AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2583	Modify the LogDeletionService to support Log aggregation for LRS	Major	nodemanager, resourcemanager	Xuan Gong	Xuan Gong
YARN-2582	Log related CLI and Web UI changes for Aggregated Logs in LRS	Major	nodemanager, resourcemanager	Xuan Gong	Xuan Gong
YARN-2581	NMs need to find a way to get LogAggregationContext	Major	nodemanager, resourcemanager	Xuan Gong	Xuan Gong
YARN-2576	Prepare yarn-1051 branch for merging with trunk	Major	capacityscheduler, resourcemanager, scheduler	Subru Krishnan	Subru Krishnan
YARN-2569	API changes for handling logs of long-running services	Major	nodemanager, resourcemanager	Xuan Gong	Xuan Gong
YARN-2566	DefaultContainerExecutor should pick a working directory randomly	Critical	nodemanager	zhihai xu	zhihai xu
YARN-2561	MR job client cannot reconnect to AM after NM restart.	Blocker	.	Tassapol Athiapinya	Junping Du
YARN-2558	Updating ContainerTokenIdentifier#read/write to use ContainerId#getContainerId	Blocker	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-2547	Cross Origin Filter throws UnsupportedOperationException upon destroy	Major	timelineserver	Jonathan Eagles	Mit Desai
YARN-2544	Common server side PB changes (not include user API PB changes)	Major	api, client, resourcemanager	Wangda Tan	Wangda Tan
YARN-2542	“yarn application -status <appId>” throws NPE when retrieving the app from the timelineserver	Major	.	Zhijie Shen	Zhijie Shen
YARN-2538	Add logs when RM send new AMRMToken to ApplicationMaster	Major	resourcemanager	Xuan Gong	Xuan Gong
YARN-2529	Generic history service RPC interface doesn't work when service authorization is enabled	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2528	Cross Origin Filter Http response split vulnerability protection rejects valid origins	Major	timelineserver	Jonathan Eagles	Jonathan Eagles
YARN-2515	Update ConverterUtils#toContainerId to parse epoch	Major	resourcemanager	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-2512	Allow for origin pattern matching in cross origin filter	Major	timelineserver	Jonathan Eagles	Jonathan Eagles
YARN-2511	Allow All Origins by default when Cross Origin Filter is enabled	Major	timelineserver	Jonathan Eagles	Jonathan Eagles
YARN-2509	Enable Cross Origin Filter for timeline server only and not all Yarn servers	Major	timelineserver	Jonathan Eagles	Mit Desai
YARN-2508	Cross Origin configuration parameters prefix are not honored	Major	timelineserver	Jonathan Eagles	Mit Desai
YARN-2507	Document Cross Origin Filter Configuration for ATS	Major	documentation, timelineserver	Jonathan Eagles	Jonathan Eagles
YARN-2505	Support get/add/remove/change labels in RM REST API	Major	resourcemanager	Wangda Tan	Craig Welch
YARN-2504	Support get/add/remove/change labels in RM admin CLI	Critical	resourcemanager	Wangda Tan	Wangda Tan
YARN-2503	Changes in RM Web UI to better show labels to end users	Major	resourcemanager	Wangda Tan	Wangda Tan
YARN-2502	Changes in distributed shell to support specify labels	Major	resourcemanager	Wangda Tan	Wangda Tan
YARN-2501	Changes in AMRMClient to support labels	Major	resourcemanager	Wangda Tan	Wangda Tan
YARN-2500	Miscellaneous changes in ResourceManager to support labels	Major	resourcemanager	Wangda Tan	Wangda Tan
YARN-2496	Changes for capacity scheduler to support allocate resource respect labels	Major	resourcemanager	Wangda Tan	Wangda Tan
YARN-2494	Node label manager API and storage implementations	Major	resourcemanager	Wangda Tan	Wangda Tan
YARN-2493	API changes for users	Major	api	Wangda Tan	Wangda Tan
YARN-2475	ReservationSystem: replan upon capacity reduction	Major	resourcemanager	Carlo Curino	Carlo Curino
YARN-2468	Log handling for LRS	Major	log-aggregation, nodemanager, resourcemanager	Xuan Gong	Xuan Gong
YARN-2456	Possible livelock in CapacityScheduler when RM is recovering apps	Major	resourcemanager	Jian He	Jian He
YARN-2446	Using TimelineNamespace to shield the entities of a user	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2434	RM should not recover containers from previously failed attempt when AM restart is not enabled	Major	.	Jian He	Jian He
YARN-2431	NM restart: cgroup is not removed for reacquired containers	Major	nodemanager	Jason Lowe	Jason Lowe
YARN-2406	Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto	Major	.	Jian He	Tsuyoshi Ozawa
YARN-2389	Adding support for drainig a queue, ie killing all apps in the queue	Major	capacityscheduler, fairscheduler	Subru Krishnan	Subru Krishnan
YARN-2378	Adding support for moving apps between queues in Capacity Scheduler	Major	capacityscheduler	Subru Krishnan	Subru Krishnan
YARN-2354	DistributedShell may allocate more containers than client specified after it restarts	Major	.	Jian He	Li Lu
YARN-2347	Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common	Major	.	Junping Du	Junping Du
YARN-2317	Update documentation about how to write YARN applications	Major	documentation	Li Lu	Li Lu
YARN-2312	Marking ContainerId#getId as deprecated	Major	resourcemanager	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-2302	Refactor TimelineWebServices	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2298	Move TimelineClient to yarn-common project	Major	client	Zhijie Shen	Zhijie Shen
YARN-2295	Refactor YARN distributed shell with existing public stable API	Major	.	Li Lu	Li Lu
YARN-2288	Data persistent in timelinestore should be versioned	Major	timelineserver	Junping Du	Junping Du
YARN-2279	Add UTs to cover timeline server authentication	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-2277	Add Cross-Origin support to the ATS REST API	Major	timelineserver	Jonathan Eagles	Jonathan Eagles
YARN-2260	Add containers to launchedContainers list in RMNode on container recovery	Major	resourcemanager	Jian He	Jian He
YARN-2249	AM release request may be lost on RM restart	Major	resourcemanager	Jian He	Jian He
YARN-2248	Capacity Scheduler changes for moving apps between queues	Major	capacityscheduler	Janos Matyas	Janos Matyas
YARN-2242	Improve exception information on AM launch crashes	Major	.	Li Lu	Li Lu
YARN-2237	MRAppMaster changes for AMRMToken roll-up	Major	resourcemanager	Xuan Gong	Xuan Gong
YARN-2229	ContainerId can overflow with RM restart	Major	resourcemanager	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-2228	TimelineServer should load pseudo authentication filter when authentication = simple	Major	.	Zhijie Shen	Zhijie Shen
YARN-2212	ApplicationMaster needs to find a way to update the AMRMToken periodically	Major	resourcemanager	Xuan Gong	Xuan Gong
YARN-2211	RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens	Major	resourcemanager	Xuan Gong	Xuan Gong
YARN-2208	AMRMTokenManager need to have a way to roll over AMRMToken	Major	resourcemanager	Xuan Gong	Xuan Gong
YARN-2182	Update ContainerId#toString() to avoid conflicts before and after RM restart	Major	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-2174	Enabling HTTPs for the writer REST API of TimelineServer	Major	.	Zhijie Shen	Zhijie Shen
YARN-2153	Ensure distributed shell work with RM work-preserving recovery	Major	resourcemanager	Jian He	Jian He
YARN-2102	More generalized timeline ACLs	Major	.	Zhijie Shen	Zhijie Shen
YARN-2080	Admission Control: Integrate Reservation subsystem with ResourceManager	Major	resourcemanager	Subru Krishnan	Subru Krishnan
YARN-2070	DistributedShell publishes unfriendly user information to the timeline server	Minor	.	Zhijie Shen	Robert Kanter
YARN-2045	Data persisted in NM should be versioned	Major	nodemanager	Junping Du	Junping Du
YARN-2035	FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode	Major	.	Jonathan Eagles	Jonathan Eagles
YARN-2033	Merging generic-history into the Timeline Store	Major	.	Vinod Kumar Vavilapalli	Zhijie Shen
YARN-2013	The diagnostics is always the ExitCodeException stack when the container crashes	Major	nodemanager	Zhijie Shen	Tsuyoshi Ozawa
YARN-2008	CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure	Major	.	Chen He	Craig Welch
YARN-2001	Threshold for RM to accept requests from AM after failover	Major	resourcemanager	Jian He	Jian He
YARN-1972	Implement secure Windows Container Executor	Major	nodemanager	Remus Rusanu	Remus Rusanu
YARN-1915	ClientToAMTokenMasterKey should be provided to AM at launch time	Blocker	.	Hitesh Shah	Jason Lowe
YARN-1879	Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over	Critical	resourcemanager	Jian He	Tsuyoshi Ozawa
YARN-1857	CapacityScheduler headroom doesn‘t account for other AM’s running	Critical	capacityscheduler	Thomas Graves	Chen He
YARN-1779	Handle AMRMTokens across RM failover	Blocker	resourcemanager	Karthik Kambatla	Jian He
YARN-1712	Admission Control: plan follower	Major	capacityscheduler, resourcemanager	Carlo Curino	Carlo Curino
YARN-1711	CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709	Major	.	Carlo Curino	Carlo Curino
YARN-1710	Admission Control: agents to allocate reservation	Major	resourcemanager	Carlo Curino	Carlo Curino
YARN-1709	Admission Control: Reservation subsystem	Major	resourcemanager	Carlo Curino	Subru Krishnan
YARN-1708	Add a public API to reserve resources (part of YARN-1051)	Major	resourcemanager	Carlo Curino	Subru Krishnan
YARN-1707	Making the CapacityScheduler more dynamic	Major	capacityscheduler	Carlo Curino	Carlo Curino
YARN-1372	Ensure all completed containers are reported to the AMs across RM restart	Major	resourcemanager	Bikas Saha	Anubhav Dhoot
YARN-1370	Fair scheduler to re-populate container allocation state	Major	fairscheduler	Bikas Saha	Anubhav Dhoot
YARN-1367	After restart NM should resync with the RM without killing containers	Major	resourcemanager	Bikas Saha	Anubhav Dhoot
YARN-1354	Recover applications upon nodemanager restart	Major	nodemanager	Jason Lowe	Jason Lowe
YARN-1342	Recover container tokens upon nodemanager restart	Major	nodemanager	Jason Lowe	Jason Lowe
YARN-1341	Recover NMTokens upon nodemanager restart	Major	nodemanager	Jason Lowe	Jason Lowe
YARN-1337	Recover containers upon nodemanager restart	Major	nodemanager	Jason Lowe	Jason Lowe
YARN-1326	RM should log using RMStore at startup time	Major	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-1250	Generic history service should support application-acls	Major	.	Vinod Kumar Vavilapalli	Zhijie Shen
YARN-1063	Winutils needs ability to create task as domain user	Major	nodemanager	Kyle Leckie	Remus Rusanu
YARN-611	Add an AM retry count reset window to YARN RM	Major	resourcemanager	Chris Riccomini	Xuan Gong
YARN-90	NodeManager should identify failed disks becoming good again	Major	nodemanager	Ravi Gummadi	Varun Vasudev

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-10994	KeyProviderCryptoExtension should use CryptoCodec for generation/decryption of keys	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10992	Merge KMS to branch-2	Major	security	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10882	Move DirectBufferPool into common util	Minor	util	Todd Lipcon	Todd Lipcon
MAPREDUCE-5910	MRAppMaster should handle Resync from RM instead of shutting down.	Major	applicationmaster	Rohith Sharma K S	Rohith Sharma K S
YARN-2789	Re-instate the NodeReport.newInstance API modified in YARN-2698	Critical	.	Siddharth Seth	Wangda Tan
YARN-2207	Add ability to roll over AMRMToken	Major	resourcemanager	Xuan Gong	Xuan Gong