Apache Hadoop Changelog

Release 1.0.0 - 2011-12-27

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-617	Support for non-recursive create() in HDFS	Major	hdfs-client, namenode	Kan Zhang	Kan Zhang

IMPORTANT ISSUES:

JIRA	Summary	Priority	Component	Reporter	Contributor

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-2316	[umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTP	Major	webhdfs	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-2137	Datanode Disk Fail Inplace	Major	datanode	Bharath Mundlapudi

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-7804	enable hadoop config generator to set dfs.block.local-path-access.user to enable short circuit read	Major	conf	Arpit Gupta	Arpit Gupta
HADOOP-7710	create a script to setup application in order to create root directories for application such hbase, hcat, hive etc	Major	.	Arpit Gupta	Arpit Gupta
HADOOP-7664	o.a.h.conf.Configuration complains of overriding final parameter even if the value with which its attempting to override is the same.	Minor	conf	Ravi Prakash	Ravi Prakash
HADOOP-6886	LocalFileSystem Needs createNonRecursive API	Minor	fs	Nicolas Spiegelberg	Nicolas Spiegelberg
HADOOP-6840	Support non-recursive create() in FileSystem & SequenceFile.Writer	Minor	fs, io	Nicolas Spiegelberg	Nicolas Spiegelberg
HADOOP-5124	A few optimizations to FsNamesystem#RecentInvalidateSets	Major	.	Hairong Kuang	Hairong Kuang
HDFS-2604	Add a log message to show if WebHDFS is enabled	Minor	webhdfs	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-2246	Shortcut a local client reads to a Datanodes files directly	Major	.	Sanjay Radia	Jitendra Nath Pandey
MAPREDUCE-3169	Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2	Major	mrv1, mrv2, test	Todd Lipcon	Ahmed Radwan

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-9128	MetricsDynamicMBeanBase can cause high cpu load	Major	metrics	Nate Putnam
HADOOP-8389	MetricsDynamicMBeanBase throws IllegalArgumentException for empty attribute list	Major	metrics	Elias Ross
HADOOP-8067	Errors building hadoop-gpl-compression with Hadoop 1.0.0 and HBase 0.92.0	Major	build	John Lewis
HADOOP-7903	hadoop artifacts do not contain 64 bit libhdfs native lib	Major	build	Arpit Gupta	Matt Foley
HADOOP-7869	HADOOP_HOME warning happens all of the time	Critical	scripts	Owen O'Malley	Owen O'Malley
HADOOP-7865	Test Failures in 1.0.0 hdfs/common	Major	.	Jitendra Nath Pandey	Jitendra Nath Pandey
HADOOP-7854	UGI getCurrentUser is not synchronized	Critical	security	Daryn Sharp	Daryn Sharp
HADOOP-7816	Allow HADOOP_HOME deprecated warning suppression based on config specified in hadoop-env.sh	Major	.	Dave Thompson	Dave Thompson
HADOOP-7815	Map memory mb is being incorrectly set by hadoop-setup-conf.sh	Minor	conf	Ramya Sunil	Ramya Sunil
HADOOP-7784	secure datanodes fail to come up stating jsvc not found	Major	.	Arpit Gupta	Eric Yang
HADOOP-7765	Debian package contain both system and tar ball layout	Major	build	Eric Yang	Eric Yang
HADOOP-7740	security audit logger is not on by default, fix the log4j properties to enable the logger	Minor	conf	Arpit Gupta	Arpit Gupta
HADOOP-7728	hadoop-setup-conf.sh should be modified to enable task memory manager	Major	conf	Ramya Sunil	Ramya Sunil
HADOOP-7461	Jackson Dependency Not Declared in Hadoop POM	Major	build	Ron Bodkin	Giridharan Kesavan
HADOOP-7116	raise contrib junit test jvm memory size to 512mb	Major	test	Owen O'Malley	Owen O'Malley
HDFS-2673	While Namenode processing the blocksBeingWrittenReport, it will log incorrect number blocks count	Trivial	namenode	Uma Maheswara Rao G	Uma Maheswara Rao G
HDFS-2590	Some links in WebHDFS forrest doc do not work	Major	webhdfs	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-2589	unnecessary hftp token fetch and renewal thread	Major	security	Daryn Sharp	Daryn Sharp
HDFS-2450	Only complete hostname is supported to access data via hdfs://	Major	.	Rajit Saha	Daryn Sharp
HDFS-2346	TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods	Blocker	test	Uma Maheswara Rao G	Laxman
HDFS-2065	Fix NPE in DFSClient.getFileChecksum	Major	.	Bharath Mundlapudi	Uma Maheswara Rao G
HDFS-1943	fail to start datanode while start-dfs.sh is executed by root user	Blocker	scripts	Wei Yongjun	Matt Foley
HDFS-1257	Race condition on FSNamesystem#recentInvalidateSets introduced by HADOOP-5124	Major	namenode	Ramkumar Vadali	Eric Payne
HDFS-838	libhdfs causes a segfault due to race condition	Major	libhdfs	Brian Bockelman
HDFS-611	Heartbeats times from Datanodes increase when there are plenty of blocks to delete	Major	datanode	dhruba borthakur	Zheng Shao
MAPREDUCE-4935	Support timeout limitation to MRv1 job end notifications	Major	jobtracker, mrv1	Olga Shen	Brad Liu
MAPREDUCE-3480	TestJvmReuse fails in 1.0	Major	.	Jitendra Nath Pandey	Jitendra Nath Pandey
MAPREDUCE-3475	JT can't renew its own tokens	Major	jobtracker	Daryn Sharp	Daryn Sharp
MAPREDUCE-3374	src/c++/task-controller/configure is not set executable in the tarball and that prevents task-controller from rebuilding	Major	task-controller	Roman Shaposhnik
MAPREDUCE-3319	multifilewc from hadoop examples seems to be broken in 0.20.205.0	Blocker	examples	Roman Shaposhnik	Subroto Sanyal
MAPREDUCE-1744	DistributedCache creates its own FileSytem instance when adding a file/archive to the path	Major	.	Dick King	Dick King

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-2540	Change WebHdfsFileSystem to two-step create/append	Major	.	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-2539	Support doAs and GETHOMEDIRECTORY in webhdfs	Major	webhdfs	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-2528	webhdfs rest call to a secure dn fails when a token is sent	Major	webhdfs	Arpit Gupta	Tsz Wo Nicholas Sze
HDFS-2527	Remove the use of Range header from webhdfs	Major	webhdfs	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-2501	add version prefix and root methods to webhdfs	Major	webhdfs	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-2494	[webhdfs] When Getting the file using OP=OPEN with DN http address, ESTABLISHED sockets are growing.	Major	webhdfs	Uma Maheswara Rao G	Uma Maheswara Rao G
HDFS-2453	tail using a webhdfs uri throws an error	Major	webhdfs	Arpit Gupta	Tsz Wo Nicholas Sze
HDFS-2441	webhdfs returns two content-type headers	Major	webhdfs	Arpit Gupta	Tsz Wo Nicholas Sze
HDFS-2439	webhdfs open an invalid path leads to a 500 which states a npe, we should return a 404 with appropriate error message	Major	webhdfs	Arpit Gupta	Tsz Wo Nicholas Sze
HDFS-2432	webhdfs setreplication api should return a 403 when called on a directory	Major	webhdfs	Arpit Gupta	Tsz Wo Nicholas Sze
HDFS-2428	webhdfs api parameter validation should be better	Major	webhdfs	Arpit Gupta	Tsz Wo Nicholas Sze
HDFS-2427	webhdfs mkdirs api call creates path with 777 permission, we should default it to 755	Major	webhdfs	Arpit Gupta	Tsz Wo Nicholas Sze
HDFS-2424	webhdfs liststatus json does not convert to a valid xml document	Major	webhdfs	Arpit Gupta	Tsz Wo Nicholas Sze
HDFS-2416	distcp with a webhdfs uri on a secure cluster fails	Major	webhdfs	Arpit Gupta	Jitendra Nath Pandey

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-7923	Automatically update doc versions	Major	build, documentation	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-2552	Add WebHdfs Forrest doc	Major	webhdfs	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze