Apache Hadoop Changelog

Release 2.3.0 - 2014-02-20

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-4997	libhdfs doesn't return correct error codes in most cases	Major	libhdfs	Colin Patrick McCabe	Colin Patrick McCabe

IMPORTANT ISSUES:

JIRA	Summary	Priority	Component	Reporter	Contributor

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-10047	Add a directbuffer Decompressor API to hadoop	Major	io	Gopal V	Gopal V
HADOOP-9848	Create a MiniKDC for use with security testing	Major	security, test	Wei Yan	Wei Yan
HADOOP-9618	Add thread which detects JVM pauses	Major	util	Todd Lipcon	Todd Lipcon
HADOOP-9432	Add support for markdown .md files in site documentation	Minor	build, documentation	Steve Loughran	Steve Loughran
HADOOP-8545	Filesystem Implementation for OpenStack Swift	Major	fs	Tim Miller	Dmitry Mezhensky
HDFS-5703	Add support for HTTPS and swebhdfs to HttpFS	Major	webhdfs	Alejandro Abdelnur	Alejandro Abdelnur
HDFS-5260	Merge zero-copy memory-mapped HDFS client reads to trunk and branch-2.	Major	hdfs-client, libhdfs	Chris Nauroth	Chris Nauroth
HDFS-4949	Centralized cache management in HDFS	Major	datanode, namenode	Andrew Wang	Andrew Wang
HDFS-2832	Enable support for heterogeneous storages in HDFS - DN as a collection of storages	Major	datanode, namenode	Suresh Srinivas	Arpit Agarwal
MAPREDUCE-5332	Support token-preserving restart of history server	Major	jobhistoryserver	Jason Lowe	Jason Lowe
MAPREDUCE-5266	Ability to refresh retention settings on history server	Major	jobhistoryserver	Jason Lowe	Ashwin Shankar
MAPREDUCE-5265	History server admin service to refresh user and superuser group mappings	Major	jobhistoryserver	Jason Lowe	Ashwin Shankar
MAPREDUCE-1176	FixedLengthInputFormat and FixedLengthRecordReader	Major	.	BitsOfInfo	Mariappan Asokan
YARN-1392	Allow sophisticated app-to-queue placement policies in the Fair Scheduler	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1253	Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode	Blocker	nodemanager	Alejandro Abdelnur	Roman Shaposhnik
YARN-1021	Yarn Scheduler Load Simulator	Major	scheduler	Wei Yan	Wei Yan

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-10274	Lower the logging level from ERROR to WARN for UGI.doAs method	Minor	security	takeshi.miao	takeshi.miao
HADOOP-10248	Property name should be included in the exception where property value is null	Major	.	Ted Yu	Akira AJISAKA
HADOOP-10228	FsPermission#fromShort() should cache FsAction.values()	Minor	fs	Haohui Mai	Haohui Mai
HADOOP-10208	Remove duplicate initialization in StringUtils.getStringCollection	Trivial	.	Benoy Antony	Benoy Antony
HADOOP-10198	DomainSocket: add support for socketpair	Minor	native	Colin Patrick McCabe	Colin Patrick McCabe
HADOOP-10173	Remove UGI from DIGEST-MD5 SASL server creation	Critical	ipc	Daryn Sharp	Daryn Sharp
HADOOP-10172	Cache SASL server factories	Critical	ipc	Daryn Sharp	Daryn Sharp
HADOOP-10169	remove the unnecessary synchronized in JvmMetrics class	Minor	metrics	Liang Xie	Liang Xie
HADOOP-10167	Mark hadoop-common source as UTF-8 in Maven pom files / refactoring	Major	build	Mikhail Antonov	Mikhail Antonov
HADOOP-10164	Allow UGI to login with a known Subject	Major	.	Robert Joseph Evans	Robert Joseph Evans
HADOOP-10143	replace WritableFactories's hashmap with ConcurrentHashMap	Major	io	Liang Xie	Liang Xie
HADOOP-10132	RPC#stopProxy() should log the class of proxy when IllegalArgumentException is encountered	Minor	.	Ted Yu	Ted Yu
HADOOP-10111	Allow DU to be initialized with an initial value	Major	.	Kihwal Lee	Kihwal Lee
HADOOP-10095	Performance improvement in CodecPool	Minor	io	Nicolas Liochon	Nicolas Liochon
HADOOP-10086	User document for authentication in secure cluster	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HADOOP-10079	log a warning message if group resolution takes too long.	Major	.	Colin Patrick McCabe	Colin Patrick McCabe
HADOOP-10067	Missing POM dependency on jsr305	Minor	.	Robert Rati	Robert Rati
HADOOP-10064	Upgrade to maven antrun plugin version 1.7	Major	build	Arpit Agarwal	Arpit Agarwal
HADOOP-10046	Print a log message when SSL is enabled	Trivial	.	David S. Wang	David S. Wang
HADOOP-10005	No need to check INFO severity level is enabled or not	Trivial	.	Jackie Chang	Jackie Chang
HADOOP-9998	Provide methods to clear only part of the DNSToSwitchMapping	Major	net	Junping Du	Junping Du
HADOOP-9915	o.a.h.fs.Stat support on Macosx	Trivial	.	Binglin Chang	Binglin Chang
HADOOP-9909	org.apache.hadoop.fs.Stat should permit other LANG	Major	fs	Shinichi Yamashita
HADOOP-9897	Add method to get path start position without drive specifier in o.a.h.fs.Path	Trivial	fs	Binglin Chang	Binglin Chang
HADOOP-9860	Remove class HackedKeytab and HackedKeytabEncoder from hadoop-minikdc once jira DIRSERVER-1882 solved	Major	.	Wei Yan	Wei Yan
HADOOP-9784	Add a builder for HttpServer	Major	.	Junping Du	Junping Du
HADOOP-9693	Shell should add a probe for OSX	Trivial	.	Steve Loughran
HADOOP-9652	Allow RawLocalFs#getFileLinkStatus to fill in the link owner and mode if requested	Major	.	Colin Patrick McCabe	Andrew Wang
HADOOP-9623	Update jets3t dependency to 0.9.0	Major	fs/s3	Timothy St. Clair	Amandeep Khurana
HADOOP-9611	mvn-rpmbuild against google-guice > 3.0 yields missing cglib dependency	Major	build	Timothy St. Clair	Timothy St. Clair
HADOOP-9594	Update apache commons math dependency	Major	build	Timothy St. Clair	Timothy St. Clair
HADOOP-9494	Excluded auto-generated and examples code from clover reports	Major	.	Dennis Y	Andrey Klochkov
HADOOP-9487	Deprecation warnings in Configuration should go to their own log or otherwise be suppressible	Major	conf	Steve Loughran
HADOOP-9470	eliminate duplicate FQN tests in different Hadoop modules	Major	test	Ivan A. Veselovsky	Ivan A. Veselovsky
HADOOP-9319	Update bundled lz4 source to latest version	Major	.	Arpit Agarwal	Binglin Chang
HADOOP-9241	DU refresh interval is not configurable	Trivial	.	Harsh J	Harsh J
HADOOP-8704	add request logging to jetty/httpserver	Major	.	Thomas Graves	Jonathan Eagles
HDFS-5841	Update HDFS caching documentation with new changes	Major	.	Andrew Wang	Andrew Wang
HDFS-5833	SecondaryNameNode have an incorrect java doc	Trivial	namenode	Bangtao Zhou
HDFS-5825	Use FileUtils.copyFile() to implement DFSTestUtils.copyFile()	Minor	.	Haohui Mai	Haohui Mai
HDFS-5788	listLocatedStatus response can be very large	Major	namenode	Nathan Roberts	Nathan Roberts
HDFS-5748	Too much information shown in the dfs health page.	Major	.	Kihwal Lee	Haohui Mai
HDFS-5721	sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns	Minor	.	Ted Yu	Ted Yu
HDFS-5695	Clean up TestOfflineEditsViewer and OfflineEditsViewerHelper	Major	test	Haohui Mai	Haohui Mai
HDFS-5677	Need error checking for HA cluster configuration	Minor	datanode, ha	Vincent Sheffer	Vincent Sheffer
HDFS-5676	fix inconsistent synchronization of CachingStrategy	Minor	hdfs-client	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5674	Editlog code cleanup	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-5665	Remove the unnecessary writeLock while initializing CacheManager in FsNameSystem Ctor	Major	namenode	Uma Maheswara Rao G	Uma Maheswara Rao G
HDFS-5663	make the retry time and interval value configurable in openInfo()	Major	hdfs-client	Liang Xie	Liang Xie
HDFS-5662	Can‘t decommission a DataNode due to file’s replication factor larger than the rest of the cluster size	Major	namenode	Brandon Li	Brandon Li
HDFS-5652	refactoring/uniforming invalid block token exception handling in DFSInputStream	Minor	hdfs-client	Liang Xie	Liang Xie
HDFS-5637	try to refeatchToken while local read InvalidToken occurred	Major	hdfs-client, security	Liang Xie	Liang Xie
HDFS-5633	Improve OfflineImageViewer to use less memory	Minor	.	Jing Zhao	Jing Zhao
HDFS-5587	add debug information when NFS fails to start with duplicate user or group names	Minor	nfs	Brandon Li	Brandon Li
HDFS-5577	NFS user guide update	Trivial	documentation	Brandon Li	Brandon Li
HDFS-5568	Support inclusion of snapshot paths in Namenode fsck	Major	snapshots	Vinayakumar B	Vinayakumar B
HDFS-5563	NFS gateway should commit the buffered data when read request comes after write to the same file	Major	nfs	Brandon Li	Brandon Li
HDFS-5561	FSNameSystem#getNameJournalStatus() in JMX should return plain text instead of HTML	Minor	namenode	Fengdong Yu	Haohui Mai
HDFS-5548	Use ConcurrentHashMap in portmap	Major	nfs	Haohui Mai	Haohui Mai
HDFS-5532	Enable the webhdfs by default to support new HDFS web UI	Major	webhdfs	Vinayakumar B	Vinayakumar B
HDFS-5495	Remove further JUnit3 usages from HDFS	Major	.	Andrew Wang	Jarek Jarcec Cecho
HDFS-5467	Remove tab characters in hdfs-default.xml	Trivial	.	Andrew Wang	Shinichi Yamashita
HDFS-5399	Revisit SafeModeException and corresponding retry policies	Major	.	Jing Zhao	Jing Zhao
HDFS-5371	Let client retry the same NN when “dfs.client.test.drop.namenode.response.number” is enabled	Minor	ha, test	Jing Zhao	Jing Zhao
HDFS-5360	Improvement of usage message of renameSnapshot and deleteSnapshot	Minor	snapshots	Shinichi Yamashita	Shinichi Yamashita
HDFS-5350	Name Node should report fsimage transfer time as a metric	Minor	namenode	Rob Weltman	Jimmy Xiang
HDFS-5344	Make LsSnapshottableDir as Tool interface implementation	Minor	snapshots, tools	sathish	sathish
HDFS-5338	Add a conf to disable hostname check in DN registration	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-5333	Improvement of current HDFS Web UI	Major	.	Jing Zhao	Haohui Mai
HDFS-5331	make SnapshotDiff.java to a o.a.h.util.Tool interface implementation	Major	snapshots	Vinayakumar B	Vinayakumar B
HDFS-5323	Remove some deadcode in BlockManager	Minor	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5267	Remove volatile from LightWeightHashSet	Minor	.	Junping Du	Junping Du
HDFS-5220	Expose group resolution time as metric	Major	namenode	Rob Weltman	Jimmy Xiang
HDFS-5207	In BlockPlacementPolicy, update 2 parameters of chooseTarget()	Major	namenode	Junping Du	Junping Du
HDFS-5188	Clean up BlockPlacementPolicy and its implementations	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-5144	Document time unit to NameNodeMetrics.java	Minor	documentation	Akira AJISAKA	Akira AJISAKA
HDFS-5068	Convert NNThroughputBenchmark to a Tool to allow generic options.	Major	benchmarks	Konstantin Shvachko	Konstantin Shvachko
HDFS-5037	Active NN should trigger its own edit log rolls	Critical	ha, namenode	Todd Lipcon	Andrew Wang
HDFS-5034	Remove debug prints from getFileLinkInfo	Trivial	namenode	Andrew Wang	Andrew Wang
HDFS-5004	Add additional JMX bean for NameNode status data	Major	namenode	Trevor Lorimer	Trevor Lorimer
HDFS-4983	Numeric usernames do not work with WebHDFS FS	Major	webhdfs	Harsh J	Yongjun Zhang
HDFS-4879	Add “blocked ArrayList” collection to avoid CMS full GCs	Major	namenode	Todd Lipcon	Todd Lipcon
HDFS-4860	Add additional attributes to JMX beans	Major	namenode	Trevor Lorimer	Trevor Lorimer
HDFS-4278	Log an ERROR when DFS_BLOCK_ACCESS_TOKEN_ENABLE config is disabled but security is turned on.	Major	datanode, namenode	Harsh J	Kousuke Saruta
HDFS-2933	Improve DataNode Web UI Index Page	Major	datanode	Philip Zeyliger	Vivek Ganesan
MAPREDUCE-5692	Add explicit diagnostics when a task attempt is killed due to speculative execution	Major	mrv2	Gera Shegalov	Gera Shegalov
MAPREDUCE-5672	Provide optional RollingFileAppender for container log4j (syslog)	Major	mr-am, mrv2	Gera Shegalov	Gera Shegalov
MAPREDUCE-5640	Rename TestLineRecordReader in jobclient module	Trivial	test	Jason Lowe	Jason Lowe
MAPREDUCE-5601	ShuffleHandler fadvises file regions as DONTNEED even when fetch fails	Major	.	Sandy Ryza	Sandy Ryza
MAPREDUCE-5596	Allow configuring the number of threads used to serve shuffle connections	Major	.	Sandy Ryza	Sandy Ryza
MAPREDUCE-5487	In task processes, JobConf is unnecessarily loaded again in Limits	Major	performance, task	Sandy Ryza	Sandy Ryza
MAPREDUCE-5484	YarnChild unnecessarily loads job conf twice	Major	task	Sandy Ryza	Sandy Ryza
MAPREDUCE-5457	Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators	Major	.	Sandy Ryza	Sandy Ryza
MAPREDUCE-3310	Custom grouping comparator cannot be set for Combiners	Major	client	Mathias Herberts	Alejandro Abdelnur
MAPREDUCE-2734	DistCp with FairScheduler assign all map tasks in one TT	Trivial	jobtracker	Bochun Bai	Bochun Bai
MAPREDUCE-434	LocalJobRunner limited to single reducer	Minor	.	Yoram Arnon	Aaron Kimball
YARN-1623	Include queue name in RegisterApplicationMasterResponse	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1616	RMFatalEventDispatcher should log the cause of the event	Trivial	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1567	In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1423	Support queue placement by secondary group in the Fair Scheduler	Major	scheduler	Sandy Ryza	Ted Malaska
YARN-1403	Separate out configuration loading from QueueManager in the Fair Scheduler	Major	.	Sandy Ryza	Sandy Ryza
YARN-1387	RMWebServices should use ClientRMService for filtering applications	Major	api	Karthik Kambatla	Karthik Kambatla
YARN-1335	Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1333	Support blacklisting in the Fair Scheduler	Major	scheduler	Sandy Ryza	Tsuyoshi Ozawa
YARN-1332	In TestAMRMClient, replace assertTrue with assertEquals where possible	Minor	.	Sandy Ryza	Sebastian Wong
YARN-1303	Allow multiple commands separating with “;” in distributed-shell	Major	applications/distributed-shell	Tassapol Athiapinya	Xuan Gong
YARN-1290	Let continuous scheduling achieve more balanced task assignment	Major	.	Wei Yan	Wei Yan
YARN-1258	Allow configuring the Fair Scheduler root queue	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1199	Make NM/RM Versions Available	Major	.	Mit Desai	Mit Desai
YARN-1109	Demote NodeManager “Sending out status for container” logs to debug	Major	nodemanager	Sandy Ryza	haosdent
YARN-1010	FairScheduler: decouple container scheduling from nodemanager heartbeats	Critical	scheduler	Alejandro Abdelnur	Wei Yan
YARN-985	Nodemanager should log where a resource was localized	Major	nodemanager	Ravi Prakash	Ravi Prakash
YARN-905	Add state filters to nodes CLI	Major	.	Sandy Ryza	Wei Yan
YARN-807	When querying apps by queue, iterating over all apps is inefficient and limiting	Major	.	Sandy Ryza	Sandy Ryza
YARN-786	Expose application resource usage in RM REST API	Major	.	Sandy Ryza	Sandy Ryza

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-10317	Rename branch-2.3 release version from 2.4.0-SNAPSHOT to 2.3.0-SNAPSHOT	Major	.	Andrew Wang	Andrew Wang
HADOOP-10313	Script and jenkins job to produce Hadoop release artifacts	Major	build	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10311	Cleanup vendor names from the code base	Blocker	.	Suresh Srinivas	Alejandro Abdelnur
HADOOP-10310	SaslRpcServer should be initialized even when no secret manager present	Blocker	security	Aaron T. Myers	Aaron T. Myers
HADOOP-10305	Add “rpc.metrics.quantile.enable” and “rpc.metrics.percentiles.intervals” to core-default.xml	Major	metrics	Akira AJISAKA	Akira AJISAKA
HADOOP-10292	Restore HttpServer from branch-2.2 in branch-2	Major	.	Haohui Mai	Haohui Mai
HADOOP-10291	TestSecurityUtil#testSocketAddrWithIP fails	Major	.	Mit Desai	Mit Desai
HADOOP-10288	Explicit reference to Log4JLogger breaks non-log4j users	Major	util	Todd Lipcon	Todd Lipcon
HADOOP-10273	Fix ‘mvn site’	Major	build	Arpit Agarwal	Arpit Agarwal
HADOOP-10255	Rename HttpServer to HttpServer2 to retain older HttpServer in branch-2 for compatibility	Blocker	.	Haohui Mai	Haohui Mai
HADOOP-10252	HttpServer can't start if hostname is not specified	Major	.	Jimmy Xiang	Jimmy Xiang
HADOOP-10250	VersionUtil returns wrong value when comparing two versions	Major	.	Yongjun Zhang	Yongjun Zhang
HADOOP-10240	Windows build instructions incorrectly state requirement of protoc 2.4.1 instead of 2.5.0	Trivial	documentation	Chris Nauroth	Chris Nauroth
HADOOP-10236	Fix typo in o.a.h.ipc.Client#checkResponse	Trivial	.	Akira AJISAKA	Akira AJISAKA
HADOOP-10235	Hadoop tarball has 2 versions of stax-api JARs	Major	build	Alejandro Abdelnur	Alejandro Abdelnur
HADOOP-10234	“hadoop.cmd jar” does not propagate exit code.	Major	scripts	Chris Nauroth	Chris Nauroth
HADOOP-10223	MiniKdc#main() should close the FileReader it creates	Minor	.	Ted Yu	Ted Yu
HADOOP-10214	Fix multithreaded correctness warnings in ActiveStandbyElector	Major	ha	Liang Xie	Liang Xie
HADOOP-10212	Incorrect compile command in Native Library document	Major	documentation	Akira AJISAKA	Akira AJISAKA
HADOOP-10203	Connection leak in Jets3tNativeFileSystemStore#retrieveMetadata	Major	fs/s3	Andrei Savu	Andrei Savu
HADOOP-10193	hadoop-auth's PseudoAuthenticationHandler can consume getInputStream	Minor	security	Gregory Chanan	Gregory Chanan
HADOOP-10178	Configuration deprecation always emit “deprecated” warnings when a new key is used	Major	conf	shanyu zhao	shanyu zhao
HADOOP-10175	Har files system authority should preserve userinfo	Major	fs	Chuan Liu	Chuan Liu
HADOOP-10171	TestRPC fails intermittently on jkd7	Major	.	Mit Desai	Mit Desai
HADOOP-10168	fix javadoc of ReflectionUtils.copy	Major	.	Thejas M Nair	Thejas M Nair
HADOOP-10162	Fix symlink-related test failures in TestFileContextResolveAfs and TestStat in branch-2	Major	.	Mit Desai	Mit Desai
HADOOP-10147	Upgrade to commons-logging 1.1.3 to avoid potential deadlock in MiniDFSCluster	Minor	build	Eric Sirianni	Steve Loughran
HADOOP-10146	Workaround JDK7 Process fd close bug	Critical	util	Daryn Sharp	Daryn Sharp
HADOOP-10142	Avoid groups lookup for unprivileged users such as “dr.who”	Major	.	Vinayakumar B	Vinayakumar B
HADOOP-10135	writes to swift fs over partition size leave temp files and empty output file	Major	fs	David Dobbins	David Dobbins
HADOOP-10130	RawLocalFS::LocalFSFileInputStream.pread does not track FS::Statistics	Minor	.	Binglin Chang	Binglin Chang
HADOOP-10129	Distcp may succeed when it fails	Critical	tools/distcp	Daryn Sharp	Daryn Sharp
HADOOP-10127	Add ipc.client.connect.retry.interval to control the frequency of connection retries	Major	ipc	Karthik Kambatla	Karthik Kambatla
HADOOP-10126	LightWeightGSet log message is confusing : “2.0% max memory = 2.0 GB”	Minor	util	Vinayakumar B	Vinayakumar B
HADOOP-10125	no need to process RPC request if the client connection has been dropped	Major	ipc	Ming Ma	Ming Ma
HADOOP-10112	har file listing doesn't work with wild card	Major	tools	Brandon Li	Brandon Li
HADOOP-10110	hadoop-auth has a build break due to missing dependency	Blocker	build	Chuan Liu	Chuan Liu
HADOOP-10106	Incorrect thread name in RPC log messages	Minor	.	Ming Ma	Ming Ma
HADOOP-10100	MiniKDC shouldn't use apacheds-all artifact	Major	.	Robert Kanter	Robert Kanter
HADOOP-10094	NPE in GenericOptionsParser#preProcessForWindows()	Trivial	util	Enis Soztutar	Enis Soztutar
HADOOP-10093	hadoop-env.cmd sets HADOOP_CLIENT_OPTS with a max heap size that is too small.	Major	conf	shanyu zhao	shanyu zhao
HADOOP-10090	Jobtracker metrics not updated properly after execution of a mapreduce job	Major	metrics	Ivan Mitic	Ivan Mitic
HADOOP-10088	copy-nativedistlibs.sh needs to quote snappy lib dir	Major	build	Raja Aluri	Raja Aluri
HADOOP-10087	UserGroupInformation.getGroupNames() fails to return primary group first when JniBasedUnixGroupsMappingWithFallback is used	Major	security	Yu Gao	Colin Patrick McCabe
HADOOP-10081	Client.setupIOStreams can leak socket resources on exception or error	Critical	ipc	Jason Lowe	Tsuyoshi Ozawa
HADOOP-10078	KerberosAuthenticator always does SPNEGO	Minor	security	Robert Kanter	Robert Kanter
HADOOP-10072	TestNfsExports#testMultiMatchers fails due to non-deterministic timing around cache expiry check.	Trivial	nfs, test	Chris Nauroth	Chris Nauroth
HADOOP-10058	TestMetricsSystemImpl#testInitFirstVerifyStopInvokedImmediately fails on trunk	Minor	metrics	Akira AJISAKA	Chen He
HADOOP-10055	FileSystemShell.apt.vm doc has typo “numRepicas”	Trivial	documentation	Eli Collins	Akira AJISAKA
HADOOP-10040	hadoop.cmd in UNIX format and would not run by default on Windows	Major	.	Yingda Chen	Chris Nauroth
HADOOP-10039	Add Hive to the list of projects using AbstractDelegationTokenSecretManager	Major	security	Suresh Srinivas	Haohui Mai
HADOOP-10031	FsShell -get/copyToLocal/moveFromLocal should support Windows local path	Major	fs	Chuan Liu	Chuan Liu
HADOOP-10030	FsShell -put/copyFromLocal should support Windows local path	Major	.	Chuan Liu	Chuan Liu
HADOOP-10029	Specifying har file to MR job fails in secure cluster	Major	fs	Suresh Srinivas	Suresh Srinivas
HADOOP-10028	Malformed ssl-server.xml.example	Minor	.	Jing Zhao	Haohui Mai
HADOOP-10006	Compilation failure in trunk for o.a.h.fs.swift.util.JSONUtil	Blocker	fs, util	Junping Du	Junping Du
HADOOP-9982	Fix dead links in hadoop site docs	Major	documentation	Akira AJISAKA	Akira AJISAKA
HADOOP-9981	globStatus should minimize its listStatus and getFileStatus calls	Critical	.	Kihwal Lee	Colin Patrick McCabe
HADOOP-9964	O.A.H.U.ReflectionUtils.printThreadInfo() is not thread-safe which cause TestHttpServer pending 10 minutes or longer.	Major	util	Junping Du	Junping Du
HADOOP-9929	Insufficient permissions for a path reported as file not found	Major	fs	Jason Lowe	Colin Patrick McCabe
HADOOP-9908	Fix NPE when versioninfo properties file is missing	Major	util	Todd Lipcon	Todd Lipcon
HADOOP-9898	Set SO_KEEPALIVE on all our sockets	Minor	ipc, net	Todd Lipcon	Todd Lipcon
HADOOP-9889	Refresh the Krb5 configuration when creating a new kdc in Hadoop-MiniKDC	Major	.	Wei Yan	Wei Yan
HADOOP-9887	globStatus does not correctly handle paths starting with a drive spec on Windows	Major	fs	Chris Nauroth	Chuan Liu
HADOOP-9875	TestDoAsEffectiveUser can fail on JDK 7	Minor	test	Aaron T. Myers	Aaron T. Myers
HADOOP-9871	Fix intermittent findbug warnings in DefaultMetricsSystem	Minor	.	Luke Lu	Junping Du
HADOOP-9865	FileContext.globStatus() has a regression with respect to relative path	Major	.	Chuan Liu	Chuan Liu
HADOOP-9847	TestGlobPath symlink tests fail to cleanup properly	Minor	.	Andrew Wang	Colin Patrick McCabe
HADOOP-9830	Typo at http://hadoop.apache.org/docs/current/	Trivial	documentation	Dmitry Lysnichenko	Kousuke Saruta
HADOOP-9817	FileSystem#globStatus and FileContext#globStatus need to work with symlinks	Major	.	Colin Patrick McCabe	Colin Patrick McCabe
HADOOP-9791	Add a test case covering long paths for new FileUtil access check methods	Major	.	Ivan Mitic	Ivan Mitic
HADOOP-9787	ShutdownHelper util to shutdown threads and threadpools	Major	util	Karthik Kambatla	Karthik Kambatla
HADOOP-9703	org.apache.hadoop.ipc.Client leaks threads on stop.	Minor	.	Mark Miller	Tsuyoshi Ozawa
HADOOP-9660	[WINDOWS] Powershell / cmd parses -Dkey=value from command line as [-Dkey, value] which breaks GenericsOptionParser	Major	scripts, util	Enis Soztutar	Enis Soztutar
HADOOP-9635	Fix Potential Stack Overflow in DomainSocket.c	Major	native	V. Karthik Kumar
HADOOP-9582	Non-existent file to “hadoop fs -conf” doesn't throw error	Major	conf	Ashwin Shankar	Ashwin Shankar
HADOOP-9478	Fix race conditions during the initialization of Configuration related to deprecatedKeyMap	Major	conf	Dongyong Wang	Colin Patrick McCabe
HADOOP-9420	Add percentile or max metric for rpcQueueTime, processing time	Major	ipc, metrics	Todd Lipcon	Liang Xie
HADOOP-9350	Hadoop not building against Java7 on OSX	Minor	build	Steve Loughran	Robert Kanter
HADOOP-9114	After defined the dfs.checksum.type as the NULL, write file and hflush will through java.lang.ArrayIndexOutOfBoundsException	Minor	.	liuyang	sathish
HADOOP-9016	org.apache.hadoop.fs.HarFileSystem.HarFSDataInputStream.HarFsInputStream.skip(long) must never return negative value.	Minor	.	Ivan A. Veselovsky	Ivan A. Veselovsky
HADOOP-8753	LocalDirAllocator throws “ArithmeticException: / by zero” when there is no available space on configured local dir	Minor	.	Nishan Shetty	Benoy Antony
HADOOP-7344	globStatus doesn't grok groupings with a slash	Major	fs	Daryn Sharp	Colin Patrick McCabe
HDFS-5921	Cannot browse file system via NN web UI if any directory has the sticky bit set	Critical	namenode	Aaron T. Myers	Aaron T. Myers
HDFS-5876	SecureDataNodeStarter does not pick up configuration in hdfs-site.xml	Major	datanode	Haohui Mai	Haohui Mai
HDFS-5873	dfs.http.policy should have higher precedence over dfs.https.enable	Major	.	Yesha Vora	Haohui Mai
HDFS-5845	SecondaryNameNode dies when checkpointing with cache pools	Blocker	namenode	Andrew Wang	Andrew Wang
HDFS-5844	Fix broken link in WebHDFS.apt.vm	Minor	documentation	Akira AJISAKA	Akira AJISAKA
HDFS-5842	Cannot create hftp filesystem when using a proxy user ugi and a doAs on a secure cluster	Major	security	Arpit Gupta	Jing Zhao
HDFS-5837	dfs.namenode.replication.considerLoad does not consider decommissioned nodes	Major	namenode	Bryan Beaudreault	Tao Luo
HDFS-5830	WebHdfsFileSystem.getFileBlockLocations throws IllegalArgumentException when accessing another cluster.	Blocker	caching, hdfs-client	Yongjun Zhang	Yongjun Zhang
HDFS-5806	balancer should set SoTimeout to avoid indefinite hangs	Major	balancer & mover	Nathan Roberts	Nathan Roberts
HDFS-5800	Typo: soft-limit for hard-limit in DFSClient	Trivial	hdfs-client	Kousuke Saruta	Kousuke Saruta
HDFS-5789	Some of snapshot APIs missing checkOperation double check in fsn	Major	namenode	Uma Maheswara Rao G	Uma Maheswara Rao G
HDFS-5777	Update LayoutVersion for the new editlog op OP_ADD_BLOCK	Major	namenode	Jing Zhao	Jing Zhao
HDFS-5766	In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange	Major	hdfs-client	Liang Xie	Liang Xie
HDFS-5762	BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads	Major	.	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5756	hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs	Major	libhdfs	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5747	BlocksMap.getStoredBlock(..) and BlockInfoUnderConstruction.addReplicaIfNotPresent(..) may throw NullPointerException	Minor	namenode	Tsz Wo Nicholas Sze	Arpit Agarwal
HDFS-5728	[Diskfull] Block recovery will fail if the metafile does not have crc for all chunks of the block	Critical	datanode	Vinayakumar B	Vinayakumar B
HDFS-5719	FSImage#doRollback() should close prevState before return	Minor	namenode	Ted Yu	Ted Yu
HDFS-5710	FSDirectory#getFullPathName should check inodes against null	Major	.	Ted Yu	Uma Maheswara Rao G
HDFS-5704	Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK	Major	namenode	Suresh Srinivas	Jing Zhao
HDFS-5701	Fix the CacheAdmin -addPool -maxTtl option name	Minor	caching, tools	Stephen Chu	Stephen Chu
HDFS-5691	Fix typo in ShortCircuitLocalRead document	Minor	documentation	Akira AJISAKA	Akira AJISAKA
HDFS-5690	DataNode fails to start in secure mode when dfs.http.policy equals to HTTP_ONLY	Blocker	.	Haohui Mai	Haohui Mai
HDFS-5681	renewLease should not hold fsn write lock	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-5675	Add Mkdirs operation to NNThroughputBenchmark	Minor	benchmarks	Plamen Jeliazkov	Plamen Jeliazkov
HDFS-5671	Fix socket leak in DFSInputStream#getBlockReader	Critical	hdfs-client	JamesLi	JamesLi
HDFS-5666	Fix inconsistent synchronization in BPOfferService	Minor	namenode	Colin Patrick McCabe	Jimmy Xiang
HDFS-5661	Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address	Major	security	Benoy Antony	Benoy Antony
HDFS-5659	dfsadmin -report doesn't output cache information properly	Major	caching	Akira AJISAKA	Andrew Wang
HDFS-5657	race condition causes writeback state error in NFS gateway	Major	nfs	Brandon Li	Brandon Li
HDFS-5649	Unregister NFS and Mount service when NFS gateway is shutting down	Major	nfs	Brandon Li	Brandon Li
HDFS-5592	“DIR* completeFile: /file is closed by DFSClient_” should be logged only for successful closure of the file.	Major	.	Vinayakumar B	Vinayakumar B
HDFS-5590	Block ID and generation stamp may be reused when persistBlocks is set to false	Major	.	Jing Zhao	Jing Zhao
HDFS-5582	hdfs getconf -excludeFile or -includeFile always failed	Minor	.	Henry Hung	sathish
HDFS-5581	NameNodeFsck should use only one instance of BlockPlacementPolicy	Major	namenode	Vinayakumar B	Vinayakumar B
HDFS-5580	Infinite loop in Balancer.waitForMoveCompletion	Major	.	Binglin Chang	Binglin Chang
HDFS-5579	Under construction files make DataNode decommission take very long hours	Major	namenode	zhaoyunjiong	zhaoyunjiong
HDFS-5562	TestCacheDirectives and TestFsDatasetCache should stub out native mlock	Major	test	Akira AJISAKA	Colin Patrick McCabe
HDFS-5560	Trash configuration log statements prints incorrect units	Major	.	Josh Elser	Josh Elser
HDFS-5558	LeaseManager monitor thread can crash if the last block is complete but another block is not.	Major	.	Kihwal Lee	Kihwal Lee
HDFS-5557	Write pipeline recovery for the last packet in the block may cause rejection of valid replicas	Critical	.	Kihwal Lee	Kihwal Lee
HDFS-5555	CacheAdmin commands fail when first listed NameNode is in Standby	Major	caching	Stephen Chu	Jimmy Xiang
HDFS-5552	Fix wrong information of “Cluster summay” in dfshealth.html	Major	namenode	Shinichi Yamashita	Haohui Mai
HDFS-5544	Adding Test case For Checking dfs.checksum type as NULL value	Minor	hdfs-client	sathish	sathish
HDFS-5540	Fix intermittent failure in TestBlocksWithNotEnoughRacks	Minor	.	Binglin Chang	Binglin Chang
HDFS-5533	Symlink delete/create should be treated as DELETE/CREATE in snapshot diff report	Minor	snapshots	Binglin Chang	Binglin Chang
HDFS-5526	Datanode cannot roll back to previous layout version	Blocker	datanode	Tsz Wo Nicholas Sze	Kihwal Lee
HDFS-5513	CacheAdmin commands fail when using . as the path	Minor	caching, tools	Stephen Chu	Andrew Wang
HDFS-5512	CacheAdmin -listPools fails with NPE when user lacks permissions to view all pools	Major	caching, tools	Stephen Chu	Andrew Wang
HDFS-5504	In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode.	Major	snapshots	Vinayakumar B	Vinayakumar B
HDFS-5482	DistributedFileSystem#listPathBasedCacheDirectives must support relative paths	Major	tools	Stephen Chu	Colin Patrick McCabe
HDFS-5476	Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion	Major	.	Jing Zhao	Jing Zhao
HDFS-5474	Deletesnapshot can make Namenode in safemode on NN restarts.	Major	snapshots	Uma Maheswara Rao G	sathish
HDFS-5471	CacheAdmin -listPools fails when user lacks permissions to view all pools	Major	tools	Stephen Chu	Andrew Wang
HDFS-5468	CacheAdmin help command does not recognize commands	Minor	tools	Stephen Chu	Stephen Chu
HDFS-5458	Datanode failed volume threshold ignored if exception is thrown in getDataDirsFromURIs	Major	datanode	Andrew Wang	Mike Mellenthin
HDFS-5456	NameNode startup progress creates new steps if caller attempts to create a counter for a step that doesn't already exist.	Critical	namenode	Chris Nauroth	Chris Nauroth
HDFS-5449	WebHdfs compatibility broken between 2.2 and 1.x / 23.x	Blocker	.	Kihwal Lee	Kihwal Lee
HDFS-5443	Delete 0-sized block when deleting an under-construction file that is included in snapshot	Major	snapshots	Uma Maheswara Rao G	Jing Zhao
HDFS-5438	Flaws in block report processing can cause data loss	Critical	namenode	Kihwal Lee	Kihwal Lee
HDFS-5434	Write resiliency for replica count 1	Minor	namenode	Taylor, Buddy
HDFS-5433	When reloading fsimage during checkpointing, we should clear existing snapshottable directories	Critical	snapshots	Aaron T. Myers	Aaron T. Myers
HDFS-5432	TestDatanodeJsp fails on Windows due to assumption that loopback address resolves to host name localhost.	Trivial	datanode, test	Chris Nauroth	Chris Nauroth
HDFS-5428	under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode	Major	snapshots	Vinayakumar B	Jing Zhao
HDFS-5427	not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart	Major	snapshots	Vinayakumar B	Vinayakumar B
HDFS-5425	Renaming underconstruction file with snapshots can make NN failure on restart	Major	namenode, snapshots	sathish	Jing Zhao
HDFS-5413	hdfs.cmd does not support passthrough to any arbitrary class.	Major	scripts	Chris Nauroth	Chris Nauroth
HDFS-5407	Fix typos in DFSClientCache	Trivial	.	Haohui Mai	Haohui Mai
HDFS-5403	WebHdfs client cannot communicate with older WebHdfs servers post HDFS-5306	Major	webhdfs	Aaron T. Myers	Aaron T. Myers
HDFS-5400	DFS_CLIENT_MMAP_CACHE_THREAD_RUNS_PER_TIMEOUT constant is set to the wrong value	Major	.	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5375	hdfs.cmd does not expose several snapshot commands.	Minor	tools	Chris Nauroth	Chris Nauroth
HDFS-5374	Remove deadcode in DFSOutputStream	Trivial	.	Suresh Srinivas	Suresh Srinivas
HDFS-5372	In FSNamesystem, hasReadLock() returns false if the current thread holds the write lock	Major	namenode	Tsz Wo Nicholas Sze	Vinayakumar B
HDFS-5370	Typo in Error Message: different between range in condition and range in error message	Trivial	hdfs-client	Kousuke Saruta	Kousuke Saruta
HDFS-5365	Fix libhdfs compile error on FreeBSD9	Major	build, libhdfs	Radim Kolar	Radim Kolar
HDFS-5353	Short circuit reads fail when dfs.encrypt.data.transfer is enabled	Blocker	.	Haohui Mai	Colin Patrick McCabe
HDFS-5352	Server#initLog() doesn't close InputStream in httpfs	Minor	.	Ted Yu	Ted Yu
HDFS-5346	Avoid unnecessary call to getNumLiveDataNodes() for each block during IBR processing	Major	namenode, performance	Kihwal Lee	Ravi Prakash
HDFS-5343	When cat command is issued on snapshot files getting unexpected result	Major	hdfs-client	sathish	sathish
HDFS-5341	Reduce fsdataset lock duration during directory scanning.	Major	datanode	qus-jiawei	qus-jiawei
HDFS-5336	DataNode should not output ‘StartupProgress’ metrics	Minor	namenode	Akira AJISAKA	Akira AJISAKA
HDFS-5335	DFSOutputStream#close() keeps throwing exceptions when it is called multiple times	Major	.	Arpit Gupta	Haohui Mai
HDFS-5329	Update FSNamesystem#getListing() to handle inode path in startAfter token	Major	namenode, nfs	Brandon Li	Brandon Li
HDFS-5322	HDFS delegation token not found in cache errors seen on secure HA clusters	Major	ha	Arpit Gupta	Jing Zhao
HDFS-5305	Add https support in HDFS	Major	.	Suresh Srinivas	Suresh Srinivas
HDFS-5297	Fix dead links in HDFS site documents	Major	documentation	Akira AJISAKA	Akira AJISAKA
HDFS-5291	Clients need to retry when Active NN is in SafeMode	Critical	ha	Arpit Gupta	Jing Zhao
HDFS-5283	NN not coming out of startup safemode due to under construction blocks only inside snapshots also counted in safemode threshhold	Critical	snapshots	Vinayakumar B	Vinayakumar B
HDFS-5276	FileSystem.Statistics got performance issue on multi-thread read/write.	Major	.	Chengxiang Li	Colin Patrick McCabe
HDFS-5257	addBlock() retry should return LocatedBlock with locations else client will get AIOBE	Major	hdfs-client, namenode	Vinayakumar B	Vinayakumar B
HDFS-5170	BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging	Trivial	.	Andrew Wang	Andrew Wang
HDFS-5164	deleteSnapshot should check if OperationCategory.WRITE is possible before taking write lock	Minor	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5122	Support failover and retry in WebHdfsFileSystem for NN HA	Major	ha, webhdfs	Arpit Gupta	Haohui Mai
HDFS-5093	TestGlobPaths should re-use the MiniDFSCluster to avoid failure on Windows	Minor	test	Chuan Liu	Chuan Liu
HDFS-5075	httpfs-config.sh calls out incorrect env script name	Major	.	Timothy St. Clair	Timothy St. Clair
HDFS-5074	Allow starting up from an fsimage checkpoint in the middle of a segment	Major	ha, namenode	Todd Lipcon	Todd Lipcon
HDFS-5073	TestListCorruptFileBlocks fails intermittently	Minor	test	Kihwal Lee	Arpit Agarwal
HDFS-5065	TestSymlinkHdfsDisable fails on Windows	Major	hdfs-client, test	Ivan Mitic	Ivan Mitic
HDFS-5035	getFileLinkStatus and rename do not correctly check permissions of symlinks	Major	namenode	Andrew Wang	Andrew Wang
HDFS-5023	TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7	Major	snapshots, test	Ravi Prakash	Mit Desai
HDFS-5014	BPOfferService#processCommandFromActor() synchronization on namenode RPC call delays IBR to Active NN, if Stanby NN is unstable	Major	datanode, ha	Vinayakumar B	Vinayakumar B
HDFS-4995	Make getContentSummary() less expensive	Major	namenode	Kihwal Lee	Kihwal Lee
HDFS-4994	Audit log getContentSummary() calls	Minor	namenode	Kihwal Lee	Robert Parker
HDFS-4816	transitionToActive blocks if the SBN is doing checkpoint image transfer	Major	namenode	Andrew Wang	Andrew Wang
HDFS-4657	Limit the number of blocks logged by the NN after a block report to a configurable value.	Major	namenode	Aaron T. Myers	Aaron T. Myers
HDFS-4633	TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly	Major	hdfs-client, test	Chris Nauroth	Chris Nauroth
HDFS-4516	Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever	Critical	namenode	Uma Maheswara Rao G	Vinayakumar B
HDFS-4376	Fix several race conditions in Balancer and resolve intermittent timeout of TestBalancerWithNodeGroup	Major	balancer & mover	Aaron T. Myers	Junping Du
HDFS-4329	DFSShell issues with directories with spaces in name	Major	hdfs-client	Andy Isaacson	Cristina L. Abad
HDFS-4201	NPE in BPServiceActor#sendHeartBeat	Critical	namenode	Eli Collins	Jimmy Xiang
HDFS-3981	access time is set without holding FSNamesystem write lock	Major	namenode	Xiaobo Peng	Xiaobo Peng
MAPREDUCE-5744	Job hangs because RMContainerAllocator$AssignedRequests.preemptReduce() violates the comparator contract	Blocker	.	Sangjin Lee	Gera Shegalov
MAPREDUCE-5743	TestRMContainerAllocator is failing	Major	.	Ted Yu	Ted Yu
MAPREDUCE-5729	mapred job -list throws NPE	Critical	mrv2	Karthik Kambatla	Karthik Kambatla
MAPREDUCE-5725	TestNetworkedJob relies on the Capacity Scheduler	Major	.	Sandy Ryza	Sandy Ryza
MAPREDUCE-5724	JobHistoryServer does not start if HDFS is not running	Critical	jobhistoryserver	Alejandro Abdelnur	Alejandro Abdelnur
MAPREDUCE-5723	MR AM container log can be truncated or empty	Blocker	applicationmaster	Mohammad Kamrul Islam	Mohammad Kamrul Islam
MAPREDUCE-5694	MR AM container syslog is empty	Major	.	Mohammad Kamrul Islam	Mohammad Kamrul Islam
MAPREDUCE-5693	Restore MRv1 behavior for log flush	Major	mrv2	Gera Shegalov	Gera Shegalov
MAPREDUCE-5689	MRAppMaster does not preempt reducers when scheduled maps cannot be fulfilled	Critical	.	Lohit Vijayarenu	Lohit Vijayarenu
MAPREDUCE-5685	getCacheFiles() api doesn't work in WrappedReducer.java due to typo	Blocker	client	Yi Song	Yi Song
MAPREDUCE-5679	TestJobHistoryParsing has race condition	Major	.	Liyin Liang	Liyin Liang
MAPREDUCE-5674	Missing start and finish time in mapred.JobStatus	Major	client	Chuan Liu	Chuan Liu
MAPREDUCE-5656	bzip2 codec can drop records when reading data in splits	Critical	.	Jason Lowe	Jason Lowe
MAPREDUCE-5650	Job fails when hprof mapreduce.task.profile.map/reduce.params is specified	Major	mrv2	Gera Shegalov	Gera Shegalov
MAPREDUCE-5645	TestFixedLengthInputFormat fails with native libs	Major	.	Jonathan Eagles	Mit Desai
MAPREDUCE-5631	TestJobEndNotifier.testNotifyRetries fails with Should have taken more than 5 seconds in jdk7	Major	.	Jonathan Eagles	Jonathan Eagles
MAPREDUCE-5623	TestJobCleanup fails because of RejectedExecutionException and NPE.	Major	.	Tsuyoshi Ozawa	Jason Lowe
MAPREDUCE-5616	MR Client-AppMaster RPC max retries on socket timeout is too high.	Major	client	Chris Nauroth	Chris Nauroth
MAPREDUCE-5613	DefaultSpeculator holds and checks hashmap that is always empty	Major	applicationmaster	Gera Shegalov	Gera Shegalov
MAPREDUCE-5604	TestMRAMWithNonNormalizedCapabilities fails on Windows due to exceeding max path length	Minor	test	Chris Nauroth	Chris Nauroth
MAPREDUCE-5598	TestUserDefinedCounters.testMapReduceJob is flakey	Major	test	Robert Kanter	Robert Kanter
MAPREDUCE-5587	TestTextOutputFormat fails on JDK7	Major	.	Jonathan Eagles	Jonathan Eagles
MAPREDUCE-5586	TestCopyMapper#testCopyFailOnBlockSizeDifference fails when run from hadoop-tools/hadoop-distcp directory	Major	.	Jonathan Eagles	Jonathan Eagles
MAPREDUCE-5585	TestCopyCommitter#testNoCommitAction Fails on JDK7	Major	.	Jonathan Eagles	Jonathan Eagles
MAPREDUCE-5569	FloatSplitter is not generating correct splits	Major	.	Nathan Roberts	Nathan Roberts
MAPREDUCE-5561	org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk	Critical	.	Cindy Li	Karthik Kambatla
MAPREDUCE-5550	Task Status message (reporter.setStatus) not shown in UI with Hadoop 2.0	Major	.	Vrushali C	Gera Shegalov
MAPREDUCE-5546	mapred.cmd on Windows set HADOOP_OPTS incorrectly	Major	.	Chuan Liu	Chuan Liu
MAPREDUCE-5522	Incorrectly expect the array of JobQueueInfo returned by o.a.h.mapred.QueueManager#getJobQueueInfos to have a specific order.	Minor	test	Jinghui Wang	Jinghui Wang
MAPREDUCE-5518	Fix typo “can't read paritions file”	Trivial	examples	Albert Chu	Albert Chu
MAPREDUCE-5514	TestRMContainerAllocator fails on trunk	Blocker	.	Zhijie Shen	Zhijie Shen
MAPREDUCE-5504	mapred queue -info inconsistent with types	Major	client	Thomas Graves	Kousuke Saruta
MAPREDUCE-5481	Enable uber jobs to have multiple reducers	Blocker	mrv2, test	Jason Lowe	Sandy Ryza
MAPREDUCE-5451	MR uses LD_LIBRARY_PATH which doesn't mean anything in Windows	Major	.	Mostafa Elhemali	Yingda Chen
MAPREDUCE-5431	Missing pom dependency in MR-client	Major	build	Timothy St. Clair	Timothy St. Clair
MAPREDUCE-5404	HSAdminServer does not use ephemeral ports in minicluster mode	Major	jobhistoryserver	Ted Yu	Ted Yu
MAPREDUCE-5380	Invalid mapred command should return non-zero exit code	Major	.	Stephen Chu	Stephen Chu
MAPREDUCE-5373	TestFetchFailure.testFetchFailureMultipleReduces could fail intermittently	Major	.	Chuan Liu	Jonathan Eagles
MAPREDUCE-5329	APPLICATION_INIT is never sent to AuxServices other than the builtin ShuffleHandler	Major	mr-am	Avner BenHanoch	Avner BenHanoch
MAPREDUCE-5316	job -list-attempt-ids command does not handle illegal task-state	Major	client	Ashwin Shankar	Ashwin Shankar
MAPREDUCE-5186	mapreduce.job.max.split.locations causes some splits created by CombineFileInputFormat to fail	Critical	job submission	Sangjin Lee	Robert Parker
MAPREDUCE-5052	Job History UI and web services confusing job start time and job submit time	Critical	jobhistoryserver, webapps	Kendall Thrapp	Chen He
MAPREDUCE-4680	Job history cleaner should only check timestamps of files in old enough directories	Major	jobhistoryserver	Sandy Ryza	Robert Kanter
YARN-1630	Introduce timeout for async polling operations in YarnClientImpl	Major	client	Aditya Acharya	Aditya Acharya
YARN-1629	IndexOutOfBoundsException in Fair Scheduler MaxRunningAppsEnforcer	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1628	TestContainerManagerSecurity fails on trunk	Major	.	Mit Desai	Vinod Kumar Vavilapalli
YARN-1624	QueuePlacementPolicy format is not easily readable via a JAXB parser	Major	scheduler	Aditya Acharya	Aditya Acharya
YARN-1608	LinuxContainerExecutor has a few DEBUG messages at INFO level	Trivial	nodemanager	Karthik Kambatla	Karthik Kambatla
YARN-1607	TestRM expects the capacity scheduler	Major	.	Sandy Ryza	Sandy Ryza
YARN-1603	Remove two *.orig files which were unexpectedly committed	Trivial	.	Zhijie Shen	Zhijie Shen
YARN-1601	3rd party JARs are missing from hadoop-dist output	Major	.	Alejandro Abdelnur	Alejandro Abdelnur
YARN-1600	RM does not startup when security is enabled without spnego configured	Blocker	resourcemanager	Jason Lowe	Haohui Mai
YARN-1541	Invalidate AM Host/Port when app attempt is done so that in the mean-while client doesn’t get wrong information.	Major	.	Jian He	Jian He
YARN-1527	yarn rmadmin command prints wrong usage info:	Trivial	.	Jian He	Akira AJISAKA
YARN-1522	TestApplicationCleanup.testAppCleanup occasionally fails	Major	.	Liyin Liang	Liyin Liang
YARN-1505	WebAppProxyServer should not set localhost as YarnConfiguration.PROXY_ADDRESS by itself	Blocker	.	Xuan Gong	Xuan Gong
YARN-1491	Upgrade JUnit3 TestCase to JUnit 4	Trivial	.	Jonathan Eagles	Chen He
YARN-1454	TestRMRestart.testRMDelegationTokenRestoredOnRMRestart is failing intermittently	Critical	.	Jian He	Karthik Kambatla
YARN-1451	TestResourceManager relies on the scheduler assigning multiple containers in a single node update	Minor	.	Sandy Ryza	Sandy Ryza
YARN-1450	TestUnmanagedAMLauncher#testDSShell fails on trunk	Major	applications/distributed-shell	Akira AJISAKA	Binglin Chang
YARN-1438	When a container fails, the text of the exception isn't included in the diagnostics	Major	nodemanager	Steve Loughran	Steve Loughran
YARN-1435	Distributed Shell should not run other commands except “sh”, and run the custom script at the same time.	Major	applications/distributed-shell	Tassapol Athiapinya	Xuan Gong
YARN-1425	TestRMRestart fails because MockRM.waitForState(AttemptId) uses current attempt instead of the attempt passed as argument	Major	.	Omkar Vinit Joshi	Omkar Vinit Joshi
YARN-1419	TestFifoScheduler.testAppAttemptMetrics fails intermittently under jdk7	Minor	scheduler	Jonathan Eagles	Jonathan Eagles
YARN-1416	InvalidStateTransitions getting reported in multiple test cases even though they pass	Major	.	Omkar Vinit Joshi	Jian He
YARN-1409	NonAggregatingLogHandler can throw RejectedExecutionException	Major	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-1407	RM Web UI and REST APIs should uniformly use YarnApplicationState	Major	.	Sandy Ryza	Sandy Ryza
YARN-1401	With zero sleep-delay-before-sigkill.ms, no signal is ever sent	Major	nodemanager	Gera Shegalov	Gera Shegalov
YARN-1400	yarn.cmd uses HADOOP_RESOURCEMANAGER_OPTS. Should be YARN_RESOURCEMANAGER_OPTS.	Trivial	resourcemanager	Raja Aluri	Raja Aluri
YARN-1395	Distributed shell application master launched with debug flag can hang waiting for external ls process.	Major	applications/distributed-shell	Chris Nauroth	Chris Nauroth
YARN-1388	Fair Scheduler page always displays blank fair share	Trivial	resourcemanager	Liyin Liang	Liyin Liang
YARN-1386	NodeManager mistakenly loses resources and relocalizes them	Critical	nodemanager	Jason Lowe	Jason Lowe
YARN-1381	Same relaxLocality appears twice in exception message of AMRMClientImpl#checkLocalityRelaxationConflict()	Minor	.	Ted Yu	Ted Yu
YARN-1374	Resource Manager fails to start due to ConcurrentModificationException	Blocker	resourcemanager	Devaraj K	Karthik Kambatla
YARN-1351	Invalid string format in Fair Scheduler log warn message	Trivial	resourcemanager	Konstantin Weitz	Konstantin Weitz
YARN-1349	yarn.cmd does not support passthrough to any arbitrary class.	Major	client	Chris Nauroth	Chris Nauroth
YARN-1343	NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs	Critical	resourcemanager	Alejandro Abdelnur	Alejandro Abdelnur
YARN-1331	yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs	Trivial	client	Chris Nauroth	Chris Nauroth
YARN-1330	Fair Scheduler: defaultQueueSchedulingPolicy does not take effect	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1321	NMTokenCache is a singleton, prevents multiple AMs running in a single JVM to work correctly	Blocker	client	Alejandro Abdelnur	Alejandro Abdelnur
YARN-1320	Custom log4j properties in Distributed shell does not work properly.	Major	applications/distributed-shell	Tassapol Athiapinya	Xuan Gong
YARN-1315	TestQueueACLs should also test FairScheduler	Major	resourcemanager, scheduler	Sandy Ryza	Sandy Ryza
YARN-1314	Cannot pass more than 1 argument to shell command	Major	applications/distributed-shell	Tassapol Athiapinya	Xuan Gong
YARN-1306	Clean up hadoop-sls sample-conf according to YARN-1228	Major	.	Wei Yan	Wei Yan
YARN-1300	SLS tests fail because conf puts yarn properties in fair-scheduler.xml	Major	.	Ted Yu	Ted Yu
YARN-1295	In UnixLocalWrapperScriptBuilder, using bash -c can cause “Text file busy” errors	Major	nodemanager	Sandy Ryza	Sandy Ryza
YARN-1293	TestContainerLaunch.testInvalidEnvSyntaxDiagnostics fails on trunk	Major	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-1288	Make Fair Scheduler ACLs more user friendly	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1284	LCE: Race condition leaves dangling cgroups entries for killed containers	Blocker	nodemanager	Alejandro Abdelnur	Alejandro Abdelnur
YARN-1268	TestFairScheduler.testContinuousScheduling is flaky	Major	scheduler	Sandy Ryza	Sandy Ryza
YARN-1265	Fair Scheduler chokes on unhealthy node reconnect	Major	resourcemanager, scheduler	Sandy Ryza	Sandy Ryza
YARN-1259	In Fair Scheduler web UI, queue num pending and num active apps switched	Trivial	scheduler	Sandy Ryza	Robert Kanter
YARN-1241	In Fair Scheduler, maxRunningApps does not work for non-leaf queues	Major	.	Sandy Ryza	Sandy Ryza
YARN-1188	The context of QueueMetrics becomes ‘default’ when using FairScheduler	Trivial	.	Akira AJISAKA	Tsuyoshi Ozawa
YARN-1183	MiniYARNCluster shutdown takes several minutes intermittently	Major	.	Andrey Klochkov	Andrey Klochkov
YARN-1182	MiniYARNCluster creates and inits the RM/NM only on start()	Major	.	Karthik Kambatla	Karthik Kambatla
YARN-1180	Update capacity scheduler docs to include types on the configs	Trivial	capacityscheduler	Thomas Graves	Chen He
YARN-1145	Potential file handle leak in aggregated logs web ui	Major	.	Rohith Sharma K S	Rohith Sharma K S
YARN-1138	yarn.application.classpath is set to point to $HADOOP_CONF_DIR etc., which does not work on Windows	Major	api	Yingda Chen	Chuan Liu
YARN-1060	Two tests in TestFairScheduler are missing @Test annotation	Major	scheduler	Sandy Ryza	Niranjan Singh
YARN-1053	Diagnostic message from ContainerExitEvent is ignored in ContainerImpl	Blocker	.	Omkar Vinit Joshi	Omkar Vinit Joshi
YARN-1044	used/min/max resources do not display info in the scheduler page	Critical	resourcemanager, scheduler	Sangjin Lee	Sangjin Lee
YARN-1022	Unnecessary INFO logs in AMRMClientAsync	Trivial	.	Bikas Saha	haosdent
YARN-888	clean up POM dependencies	Major	.	Alejandro Abdelnur	Alejandro Abdelnur
YARN-879	Fix tests w.r.t o.a.h.y.server.resourcemanager.Application	Major	.	Junping Du	Junping Du
YARN-584	In scheduler web UIs, queues unexpand on refresh	Major	scheduler	Sandy Ryza	Harshit Daga
YARN-546	Allow disabling the Fair Scheduler event log	Major	scheduler	Lohit Vijayarenu	Sandy Ryza
YARN-461	Fair scheduler should not accept apps with empty string queue name	Major	resourcemanager	Sandy Ryza	Wei Yan
YARN-408	Capacity Scheduler delay scheduling should not be disabled by default	Minor	scheduler	Mayank Bansal	Mayank Bansal
YARN-305	Fair scheduler logs too many “Node offered to app:...” messages	Critical	resourcemanager	Lohit Vijayarenu	Lohit Vijayarenu

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-10207	TestUserGroupInformation#testLogin is flaky	Minor	.	Jimmy Xiang	Jimmy Xiang
HADOOP-9866	convert hadoop-auth testcases requiring kerberos to use minikdc	Major	test	Alejandro Abdelnur	Wei Yan
HADOOP-9598	Improve code coverage of RMAdminCLI	Major	.	Aleksey Gorshkov	Andrey Klochkov
HADOOP-9291	enhance unit-test coverage of package o.a.h.metrics2	Major	.	Ivan A. Veselovsky	Ivan A. Veselovsky
HADOOP-9254	Cover packages org.apache.hadoop.util.bloom, org.apache.hadoop.util.hash	Major	.	Vadim Bondarev	Vadim Bondarev
HADOOP-9225	Cover package org.apache.hadoop.compress.Snappy	Major	.	Vadim Bondarev	Andrey Klochkov
HADOOP-9199	Cover package org.apache.hadoop.io with unit tests	Major	.	Vadim Bondarev	Andrey Klochkov
HADOOP-9078	enhance unit-test coverage of class org.apache.hadoop.fs.FileContext	Major	.	Ivan A. Veselovsky	Ivan A. Veselovsky
HADOOP-9063	enhance unit-test coverage of class org.apache.hadoop.fs.FileUtil	Minor	.	Ivan A. Veselovsky	Ivan A. Veselovsky
HDFS-5679	TestCacheDirectives should handle the case where native code is not available	Major	.	Ted Yu	Andrew Wang
HDFS-5130	Add test for snapshot related FsShell and DFSAdmin commands	Minor	test	Binglin Chang	Binglin Chang
HDFS-4517	Cover class RemoteBlockReader with unit tests	Major	.	Vadim Bondarev	Ivan A. Veselovsky
HDFS-4512	Cover package org.apache.hadoop.hdfs.server.common with tests	Major	.	Vadim Bondarev	Vadim Bondarev
HDFS-4511	Cover package org.apache.hadoop.hdfs.tools with unit test	Major	.	Vadim Bondarev	Andrey Klochkov
HDFS-4510	Cover classes ClusterJspHelper/NamenodeJspHelper with unit tests	Major	.	Vadim Bondarev	Andrey Klochkov
HDFS-4491	Parallel testing HDFS	Major	test	Tsuyoshi Ozawa	Andrey Klochkov
MAPREDUCE-5687	TestYARNRunner#testResourceMgrDelegate fails with NPE after YARN-1446	Major	.	Ted Yu	Jian He
MAPREDUCE-5632	TestRMContainerAllocator#testUpdatedNodes fails	Major	.	Ted Yu	Jonathan Eagles
MAPREDUCE-5625	TestFixedLengthInputFormat fails in jdk7 environment	Major	.	Jonathan Eagles	Mariappan Asokan
MAPREDUCE-5610	TestSleepJob fails in jdk7	Major	.	Jonathan Eagles	Jonathan Eagles
MAPREDUCE-5102	fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db	Major	.	Aleksey Gorshkov	Andrey Klochkov
MAPREDUCE-5084	fix coverage org.apache.hadoop.mapreduce.v2.app.webapp and org.apache.hadoop.mapreduce.v2.hs.webapp	Major	.	Aleksey Gorshkov	Aleksey Gorshkov
YARN-1560	TestYarnClient#testAMMRTokens fails with null AMRM token	Major	.	Ted Yu	Ted Yu
YARN-1549	TestUnmanagedAMLauncher#testDSShell fails in trunk	Major	.	Ted Yu	haosdent
YARN-1463	Tests should avoid starting http-server where possible or creates spnego keytab/principals	Major	.	Ted Yu	Vinod Kumar Vavilapalli
YARN-1358	TestYarnCLI fails on Windows due to line endings	Minor	client	Chuan Liu	Chuan Liu
YARN-1357	TestContainerLaunch.testContainerEnvVariables fails on Windows	Minor	nodemanager	Chuan Liu	Chuan Liu
YARN-1119	Add ClusterMetrics checks to tho TestRMNodeTransitions tests	Major	resourcemanager	Robert Parker	Mit Desai

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-10109	Fix test failure in TestOfflineEditsViewer introduced by HADOOP-10052	Major	test	Colin Patrick McCabe	Colin Patrick McCabe
HADOOP-10107	Server.getNumOpenConnections may throw NPE	Major	ipc	Tsz Wo Nicholas Sze	Kihwal Lee
HADOOP-10103	update commons-lang to 2.6	Minor	build	Steve Loughran	Akira AJISAKA
HADOOP-10102	update commons IO from 2.1 to 2.4	Minor	build	Steve Loughran	Akira AJISAKA
HADOOP-10052	Temporarily disable client-side symlink resolution	Major	fs	Andrew Wang	Andrew Wang
HADOOP-9956	RPC listener inefficiently assigns connections to readers	Major	ipc	Daryn Sharp	Daryn Sharp
HADOOP-9955	RPC idle connection closing is extremely inefficient	Major	ipc	Daryn Sharp	Daryn Sharp
HADOOP-9748	Reduce blocking on UGI.ensureInitialized	Critical	security	Daryn Sharp	Daryn Sharp
HADOOP-9417	Support for symlink resolution in LocalFileSystem / RawLocalFileSystem	Major	fs	Andrew Wang	Andrew Wang
HDFS-5784	reserve space in edit log header and fsimage header for feature flag section	Major	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5708	The CacheManager throws a NPE in the DataNode logs when processing cache reports that refer to a block not known to the BlockManager	Major	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5667	Include DatanodeStorage in StorageReport	Major	datanode	Eric Sirianni	Arpit Agarwal
HDFS-5651	Remove dfs.namenode.caching.enabled and improve CRM locking	Major	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5636	Enforce a max TTL per cache pool	Major	caching, namenode	Andrew Wang	Andrew Wang
HDFS-5634	allow BlockReaderLocal to switch between checksumming and not	Major	hdfs-client	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5630	Hook up cache directive and pool usage statistics	Major	caching, namenode	Andrew Wang	Andrew Wang
HDFS-5629	Support HTTPS in JournalNode and SecondaryNameNode	Major	.	Haohui Mai	Haohui Mai
HDFS-5589	Namenode loops caching and uncaching when data should be uncached	Major	caching, namenode	Andrew Wang	Andrew Wang
HDFS-5565	CacheAdmin help should match against non-dashed commands	Minor	caching	Andrew Wang	Andrew Wang
HDFS-5556	add some more NameNode cache statistics, cache pool stats	Major	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5545	Allow specifying endpoints for listeners in HttpServer	Major	.	Haohui Mai	Haohui Mai
HDFS-5543	fix narrow race condition in TestPathBasedCacheRequests	Major	test	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5538	URLConnectionFactory should pick up the SSL related configuration by default	Major	.	Haohui Mai	Haohui Mai
HDFS-5536	Implement HTTP policy for Namenode and DataNode	Major	.	Haohui Mai	Haohui Mai
HDFS-5525	Inline dust templates	Major	.	Haohui Mai	Haohui Mai
HDFS-5520	loading cache path directives from edit log doesn't update nextEntryId	Major	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5519	COMMIT handler should update the commit status after sync	Minor	nfs	Brandon Li	Brandon Li
HDFS-5514	FSNamesystem's fsLock should allow custom implementation	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-5511	improve CacheManipulator interface to allow better unit testing	Major	datanode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5509	TestPathBasedCacheRequests#testReplicationFactor is flaky	Major	datanode, namenode	Andrew Wang	Andrew Wang
HDFS-5506	Use URLConnectionFactory in DelegationTokenFetcher	Major	.	Haohui Mai	Haohui Mai
HDFS-5502	Fix HTTPS support in HsftpFileSystem	Major	.	Haohui Mai	Haohui Mai
HDFS-5489	Use TokenAspect in WebHDFSFileSystem	Major	.	Haohui Mai	Haohui Mai
HDFS-5488	Clean up TestHftpURLTimeout	Major	.	Haohui Mai	Haohui Mai
HDFS-5487	Introduce unit test for TokenAspect	Major	.	Haohui Mai	Haohui Mai
HDFS-5473	Consistent naming of user-visible caching classes and methods	Major	datanode, namenode	Andrew Wang	Colin Patrick McCabe
HDFS-5469	Add configuration property for the sub-directroy export path	Major	nfs	Brandon Li	Brandon Li
HDFS-5454	DataNode UUID should be assigned prior to FsDataset initialization	Minor	datanode	Eric Sirianni	Arpit Agarwal
HDFS-5451	Add byte and file statistics to PathBasedCacheEntry	Major	datanode, namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5450	better API for getting the cached blocks locations	Minor	hdfs-client	Colin Patrick McCabe	Andrew Wang
HDFS-5444	Choose default web UI based on browser capabilities	Major	.	Haohui Mai	Haohui Mai
HDFS-5440	Extract the logic of handling delegation tokens in HftpFileSystem to the TokenAspect class	Major	.	Haohui Mai	Haohui Mai
HDFS-5436	Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web	Major	.	Haohui Mai	Haohui Mai
HDFS-5431	support cachepool-based limit management in path-based caching	Major	datanode, namenode	Colin Patrick McCabe	Andrew Wang
HDFS-5430	Support TTL on CacheDirectives	Minor	datanode, namenode	Colin Patrick McCabe	Andrew Wang
HDFS-5406	Send incremental block reports for all storages in a single call	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-5394	fix race conditions in DN caching and uncaching	Major	datanode, namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5393	Serve bootstrap and jQuery locally	Minor	.	Haohui Mai	Haohui Mai
HDFS-5386	Add feature documentation for datanode caching.	Major	documentation	Chris Nauroth	Colin Patrick McCabe
HDFS-5382	Implement the UI of browsing filesystems in HTML 5 page	Major	.	Haohui Mai	Haohui Mai
HDFS-5379	Update links to datanode information in dfshealth.html	Major	.	Haohui Mai	Haohui Mai
HDFS-5366	recaching improvements	Major	namenode	Colin Patrick McCabe	Colin Patrick McCabe
HDFS-5364	Add OpenFileCtx cache	Major	nfs	Brandon Li	Brandon Li
HDFS-5363	Refactor WebHdfsFileSystem: move SPENGO-authenticated connection creation to URLConnectionFactory	Major	.	Haohui Mai	Haohui Mai
HDFS-5347	add HDFS NFS user guide	Major	documentation	Brandon Li	Brandon Li
HDFS-5342	Provide more information in the FSNamesystem JMX interfaces	Major	.	Haohui Mai	Haohui Mai
HDFS-5337	should do hsync for a commit request even there is no pending writes	Major	nfs	Brandon Li	Brandon Li
HDFS-5334	Implement dfshealth.jsp in HTML pages	Major	.	Haohui Mai	Haohui Mai
HDFS-5330	fix readdir and readdirplus for large directories	Major	nfs	Brandon Li	Brandon Li
HDFS-5325	Remove WebHdfsFileSystem#ConnRunner	Major	.	Haohui Mai	Haohui Mai
HDFS-5320	Add datanode caching metrics	Minor	datanode	Andrew Wang	Andrew Wang
HDFS-5317	Go back to DFS Home link does not work on datanode webUI	Critical	.	Suresh Srinivas	Haohui Mai
HDFS-5316	Namenode ignores the default https port	Critical	.	Suresh Srinivas	Haohui Mai
HDFS-5312	Generate HTTP / HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy	Major	.	Haohui Mai	Haohui Mai
HDFS-5307	Support both HTTP and HTTPS in jsp pages	Major	.	Haohui Mai	Haohui Mai
HDFS-5288	Close idle connections in portmap	Major	nfs	Haohui Mai	Haohui Mai
HDFS-5281	COMMIT request should not block	Major	nfs	Brandon Li	Brandon Li
HDFS-5252	Stable write is not handled correctly in someplace	Major	nfs	Brandon Li	Brandon Li
HDFS-5241	Provide alternate queuing audit logger to reduce logging contention	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-5240	Separate formatting from logging in the audit logger API	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-5239	Allow FSNamesystem lock fairness to be configurable	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-5171	NFS should create input stream for a file and try to share it with multiple read requests	Major	nfs	Brandon Li	Haohui Mai
HDFS-4885	Update verifyBlockPlacement() API in BlockPlacementPolicy	Major	.	Junping Du	Junping Du
HDFS-4096	Add snapshot information to namenode WebUI	Major	datanode, namenode	Jing Zhao	Haohui Mai
HDFS-3987	Support webhdfs over HTTPS	Major	.	Alejandro Abdelnur	Haohui Mai
MAPREDUCE-5411	Refresh size of loaded job cache on history server	Major	jobhistoryserver	Ashwin Shankar	Ashwin Shankar
MAPREDUCE-5409	MRAppMaster throws InvalidStateTransitonException: Invalid event: TA_TOO_MANY_FETCH_FAILURE at KILLED for TaskAttemptImpl	Major	.	Devaraj K	Gera Shegalov
MAPREDUCE-5386	Ability to refresh history server job retention and job cleaner settings	Major	jobhistoryserver	Ashwin Shankar	Ashwin Shankar
MAPREDUCE-5356	Ability to refresh aggregated log retention period and check interval	Major	jobhistoryserver	Ashwin Shankar	Ashwin Shankar
MAPREDUCE-4421	Run MapReduce framework via the distributed cache	Major	.	Arun C Murthy	Jason Lowe
YARN-1642	RMDTRenewer#getRMClient should use ClientRMProxy	Blocker	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1618	Fix invalid RMApp transition from NEW to FINAL_SAVING	Blocker	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1598	HA-related rmadmin commands don't work on a secure cluster	Critical	client, resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1579	ActiveRMInfoProto fields should be optional	Trivial	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1575	Public localizer crashes with “Localized unkown resource”	Critical	nodemanager	Jason Lowe	Jason Lowe
YARN-1574	RMDispatcher should be reset on transition to standby	Blocker	.	Xuan Gong	Xuan Gong
YARN-1573	ZK store should use a private password for root-node-acls	Major	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1559	Race between ServerRMProxy and ClientRMProxy setting RMProxy#INSTANCE	Blocker	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1523	Use StandbyException instead of RMNotYetReadyException	Major	.	Bikas Saha	Karthik Kambatla
YARN-1485	Enabling HA should verify the RM service addresses configurations have been set for every RM Ids defined in RM_HA_IDs	Major	.	Xuan Gong	Xuan Gong
YARN-1482	WebApplicationProxy should be always-on w.r.t HA even if it is embedded in the RM	Major	.	Vinod Kumar Vavilapalli	Xuan Gong
YARN-1481	Move internal services logic from AdminService to ResourceManager	Major	.	Vinod Kumar Vavilapalli	Vinod Kumar Vavilapalli
YARN-1448	AM-RM protocol changes to support container resizing	Major	api, resourcemanager	Wangda Tan (No longer used)	Wangda Tan
YARN-1447	Common PB type definitions for container resizing	Major	api	Wangda Tan (No longer used)	Wangda Tan
YARN-1446	Change killing application to wait until state store is done	Major	resourcemanager	Jian He	Jian He
YARN-1411	HA config shouldn't affect NodeManager RPC addresses	Critical	.	Karthik Kambatla	Karthik Kambatla
YARN-1405	RM hangs on shutdown if calling system.exit in serviceInit or serviceStart	Major	.	Yesha Vora	Jian He
YARN-1378	Implement a RMStateStore cleaner for deleting application/attempt info	Major	resourcemanager	Jian He	Jian He
YARN-1325	Enabling HA should check Configuration contains multiple RMs	Major	resourcemanager	Tsuyoshi Ozawa	Xuan Gong
YARN-1323	Set HTTPS webapp address along with other RPC addresses in HAUtil	Major	.	Karthik Kambatla	Karthik Kambatla
YARN-1318	Promote AdminService to an Always-On service and merge in RMHAProtocolService	Blocker	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1311	Fix app specific scheduler-events' names to be app-attempt based	Trivial	.	Vinod Kumar Vavilapalli	Vinod Kumar Vavilapalli
YARN-1307	Rethink znode structure for RM HA	Major	resourcemanager	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-1305	RMHAProtocolService#serviceInit should handle HAUtil's IllegalArgumentException	Major	resourcemanager	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-1283	Invalid ‘url of job’ mentioned in Job output with yarn.http.policy=HTTPS_ONLY	Major	.	Yesha Vora	Omkar Vinit Joshi
YARN-1239	Save version information in the state store	Major	resourcemanager	Bikas Saha	Jian He
YARN-1232	Configuration to support multiple RMs	Major	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1222	Make improvements in ZKRMStateStore for fencing	Major	.	Bikas Saha	Karthik Kambatla
YARN-1210	During RM restart, RM should start a new attempt only when previous attempt exits for real	Major	.	Vinod Kumar Vavilapalli	Omkar Vinit Joshi
YARN-1185	FileSystemRMStateStore can leave partial files that prevent subsequent recovery	Major	resourcemanager	Jason Lowe	Omkar Vinit Joshi
YARN-1181	Augment MiniYARNCluster to support HA mode	Major	.	Karthik Kambatla	Karthik Kambatla
YARN-1172	Convert *SecretManagers in the RM to services	Major	resourcemanager	Karthik Kambatla	Tsuyoshi Ozawa
YARN-1121	RMStateStore should flush all pending store events before closing	Major	resourcemanager	Bikas Saha	Jian He
YARN-1098	Separate out RM services into “Always On” and “Active”	Major	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1068	Add admin support for HA operations	Major	resourcemanager	Karthik Kambatla	Karthik Kambatla
YARN-1033	Expose RM active/standby state to Web UI and REST API	Major	.	Nemon Lou	Karthik Kambatla
YARN-1029	Allow embedding leader election into the RM	Major	.	Bikas Saha	Karthik Kambatla
YARN-1028	Add FailoverProxyProvider like capability to RMProxy	Major	.	Bikas Saha	Karthik Kambatla
YARN-1027	Implement RMHAProtocolService	Major	.	Bikas Saha	Karthik Kambatla
YARN-976	Document the meaning of a virtual core	Major	documentation	Sandy Ryza	Sandy Ryza
YARN-895	RM crashes if it restarts while the state-store is down	Major	resourcemanager	Jian He	Jian He
YARN-891	Store completed application information in RM state store	Major	resourcemanager	Bikas Saha	Jian He
YARN-819	ResourceManager and NodeManager should check for a minimum allowed version	Major	nodemanager, resourcemanager	Robert Parker	Robert Parker
YARN-709	verify that new jobs submitted with old RM delegation tokens after RM restart are accepted	Major	resourcemanager	Jian He	Jian He
YARN-674	Slow or failing DelegationToken renewals on submission itself make RM unavailable	Major	resourcemanager	Vinod Kumar Vavilapalli	Omkar Vinit Joshi
YARN-649	Make container logs available over HTTP in plain text	Major	nodemanager	Sandy Ryza	Sandy Ryza
YARN-478	fix coverage org.apache.hadoop.yarn.webapp.log	Major	.	Aleksey Gorshkov	Aleksey Gorshkov
YARN-465	fix coverage org.apache.hadoop.yarn.server.webproxy	Major	.	Aleksey Gorshkov	Andrey Klochkov
YARN-427	Coverage fix for org.apache.hadoop.yarn.server.api.*	Major	.	Aleksey Gorshkov	Aleksey Gorshkov
YARN-425	coverage fix for yarn api	Major	.	Aleksey Gorshkov	Aleksey Gorshkov
YARN-353	Add Zookeeper-based store implementation for RMStateStore	Major	resourcemanager	Hitesh Shah	Karthik Kambatla
YARN-312	Add updateNodeResource in ResourceManagerAdministrationProtocol	Major	api, graceful	Junping Du	Junping Du
YARN-311	Dynamic node resource configuration: core scheduler changes	Major	graceful, resourcemanager, scheduler	Junping Du	Junping Du
YARN-7	Add support for DistributedShell to ask for CPUs along with memory	Major	.	Arun C Murthy	Junping Du

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-5464	Add analogs of the SLOTS_MILLIS counters that jive with the YARN resource model	Major	.	Sandy Ryza	Sandy Ryza
MAPREDUCE-5463	Deprecate SLOTS_MILLIS counters	Major	.	Sandy Ryza	Tsuyoshi Ozawa
YARN-1568	Rename clusterid to clusterId in ActiveRMInfoProto	Trivial	resourcemanager	Karthik Kambatla	Karthik Kambatla