Apache Hadoop Changelog

Release 0.18.3 - 2009-01-29

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-4997workaround for tmp file handling on DataNodes in 0.18 (HADOOP-4663)Blocker.Raghu AngadiRaghu Angadi
HADOOP-4659Root cause of connection failure is being lost to code that uses it for delaying startupBlockeripcSteve LoughranSteve Loughran
HADOOP-4061Large number of decommission freezes the NamenodeMajor.Koji NoguchiTsz Wo Nicholas Sze

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-3780JobTracker should synchronously resolve the tasktracker's network location when the tracker registersMajor.Amar KamatAmar Kamat

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-5077JavaDoc errors in 0.18.3BlockerutilRaghu AngadiRaghu Angadi
HADOOP-4983Job counters sometimes go down as tasks run without task failuresCritical.Owen O'MalleyAmareshwari Sriramadasu
HADOOP-4971Block report times from datanodes could converge to same time.Blocker.Raghu AngadiRaghu Angadi
HADOOP-4961ConcurrentModificationException in lease recovery of empty files.Blocker.Konstantin ShvachkoKonstantin Shvachko
HADOOP-4951Lease monitor does not own the LeaseManager lock in changing leases.Blocker.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4935Manual leaving of safe mode may lead to data lostMajor.Hairong KuangKonstantin Shvachko
HADOOP-4924Race condition in re-init of TaskTrackerBlocker.Devaraj DasDevaraj Das
HADOOP-4919[HOD] Provide execute access to JT history directory path for groupMajorcontrib/hodHemanth YamijalaPeeyush Bishnoi
HADOOP-4910NameNode should exclude corrupt replicas when choosing excessive replicas to deleteBlocker.Hairong KuangHairong Kuang
HADOOP-4904Deadlock while leaving safe mode.Blocker.Konstantin ShvachkoKonstantin Shvachko
HADOOP-4840TestNodeCount sometimes fails with NullPointerExceptionMajor.Hairong KuangHairong Kuang
HADOOP-48220.18 cannot be compiled in Java 5.BlockerutilTsz Wo Nicholas Sze
HADOOP-4810Data lost at cluster startup timeBlocker.Hairong KuangHairong Kuang
HADOOP-4806HDFS rename does not work correctly if src contains Java regular expression special charactersBlocker.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4797RPC Server can leave a lot of direct buffersBlockeripcRaghu AngadiRaghu Angadi
HADOOP-4795Lease monitor may get into an infinite loopBlocker.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4778Check for zero size block meta file when updating a block.Blocker.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4746Job output directory should be normalizedBlocker.Hairong KuangHairong Kuang
HADOOP-4742Mistake delete replica in hadoop 0.18.1Blocker.Wang XuWang Xu
HADOOP-4734Some lease recovery codes in 0.19 or trunk should also be committed in 0.18.Blocker.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4726documentation typos: “the the”MinordocumentationTsz Wo Nicholas SzeEdward J. Yoon
HADOOP-4717Removal of default port# in NameNode.getUri() cause a map/reduce job failed to prompt temporay outputBlocker.Hairong KuangHairong Kuang
HADOOP-4714map tasks timing out during merge phaseMajor.Christian KunzJothi Padmanabhan
HADOOP-4713librecordio does not scale to large recordsBlockerrecordChristian KunzChristian Kunz
HADOOP-4703DataNode.createInterDataNodeProtocolProxy should not wait for proxy forever while recovering leaseMajor.Hairong KuangTsz Wo Nicholas Sze
HADOOP-4702Failed block replication leaves an incomplete block in receiver's tmp data directoryBlocker.Hairong KuangHairong Kuang
HADOOP-4679Datanode prints tons of log messages: Waiting for threadgroup to exit, active theads is XXMajor.Hairong KuangHairong Kuang
HADOOP-4654remove temporary output directory of failed tasksMajor.Christian KunzAmareshwari Sriramadasu
HADOOP-4647NamenodeFsck creates a new DFSClient but never closes itMajor.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4643NameNode should exclude excessive replicas when counting live replicas for a blockMajor.Hairong KuangHairong Kuang
HADOOP-4635Memory leak ?Blocker.Marc-Olivier FleuryPete Wyckoff
HADOOP-4620Streaming mapper never completes if the mapper does not write to stdoutMajor.Runping QiRavi Gummadi
HADOOP-4616assertion makes fuse-dfs exit when reading incomplete dataBlocker.Marc-Olivier FleuryPete Wyckoff
HADOOP-4614“Too many open files” error while processing a large gzip fileBlocker.Abdul QadeerYuri Pradkin
HADOOP-4613browseBlock.jsp does not generate “genstamp” property.Major.Konstantin ShvachkoJohan Oskarsson
HADOOP-4610Always calculate mis-replicated blocks when safe-mode is turned off.Major.Konstantin ShvachkoKonstantin Shvachko
HADOOP-4597Under-replicated blocks are not calculated if the name-node is forced out of safe-mode.Blocker.Konstantin ShvachkoKonstantin Shvachko
HADOOP-4556Block went missingMajor.Robert ChanslerHairong Kuang
HADOOP-4542Fault in TestDistributedUpgradeMinortestRobert ChanslerRaghu Angadi
HADOOP-4499DFSClient should invoke checksumOk only once.Blocker.Raghu AngadiRaghu Angadi
HADOOP-4257TestLeaseRecovery2.testBlockSynchronization failing.BlockertestVinod Kumar VavilapalliTsz Wo Nicholas Sze
HADOOP-3883TestFileCreation fails once in a whileBlockertestLohit VijayarenuTsz Wo Nicholas Sze
HADOOP-3121dfs -lsr fail with "Could not get listing "MinorfsKoji NoguchiTsz Wo Nicholas Sze
HADOOP-1980‘dfsadmin -safemode enter’ should prevent the namenode from leaving safemode automatically after startupMinor.Koji NoguchiKonstantin Shvachko

TESTS:

JIRASummaryPriorityComponentReporterContributor

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-4824Should not use File.setWritable(..) in 0.18Major.Tsz Wo Nicholas SzeHairong Kuang
HADOOP-4823Should not use java.util.NavigableMap in 0.18MajorutilTsz Wo Nicholas SzeTsz Wo Nicholas Sze

OTHER:

JIRASummaryPriorityComponentReporterContributor
HADOOP-4150Include librecordio as part of the releaseBlockerbuildKoji NoguchiGiridharan Kesavan