Apache Hadoop Changelog

Release 0.20.204.0 - 2011-09-02

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-6255Create an rpm integration projectMajor.Owen O'MalleyEric Yang

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7398create a mechanism to suppress the HADOOP_HOME deprecated warningMajor.Owen O'MalleyOwen O'Malley
HADOOP-7144Expose JMX with something like JMXProxyServletMajor.Luke LuRobert Joseph Evans
MAPREDUCE-2558Add queue-level metrics 0.20-security branchMajorjobtrackerJeffrey NaisbittJeffrey Naisbitt
MAPREDUCE-1938Ability for having user‘s classes take precedence over the system classes for tasks’ classpathBlockerjob submission, task, tasktrackerDevaraj DasKrishna Ramachandran

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7277Add Eclipse launch tasks for the 0.20-security branchMinorbuildJeffrey NaisbittJeffrey Naisbitt
HADOOP-7248Have a way to automatically update Eclipse .classpath file when new libs are added to the classpath through Ivy for 0.20-* based sourcesMinorbuildKonstantin BoudnikThomas Graves
HDFS-1773Remove a datanode from cluster if include list is not empty and this datanode is removed from both include and exclude listsMinornamenodeTanping WangTanping Wang
MAPREDUCE-2524Backport trunk heuristics for failing maps when we get fetch failures retrieving map output during shuffleMinortasktrackerThomas GravesThomas Graves
MAPREDUCE-2495The distributed cache cleanup thread has no monitoring to check to see if it has died for some reasonMinordistributed-cacheRobert Joseph EvansRobert Joseph Evans
MAPREDUCE-2490Log blacklist debug countTrivialjobtrackerJonathan EaglesJonathan Eagles
MAPREDUCE-2479Backport MAPREDUCE-1568 to hadoop security branchMajortasktrackerRobert Joseph EvansRobert Joseph Evans
MAPREDUCE-2456Show the reducer taskid and map/reduce tasktrackers for “Failed fetch notification #_ for task attempt...” log messagesTrivialjobtrackerJeffrey NaisbittJeffrey Naisbitt

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7475hadoop-setup-single-node.sh is brokenBlocker.Eric YangEric Yang
HADOOP-7373Tarball deployment doesn't work with {start,stop}-{dfs,mapred}Major.Owen O'MalleyOwen O'Malley
HADOOP-7364TestMiniMRDFSCaching fails if test.build.dir is set to something other than build/testMajortestThomas GravesThomas Graves
HADOOP-7356RPM packages broke bin/hadoop script for hadoop 0.20.205Blocker.Eric YangEric Yang
HADOOP-7330The metrics source mbean implementation should return the attribute value instead of the objectMajormetricsLuke LuLuke Lu
HADOOP-7324Ganglia plugins for metrics v2BlockermetricsLuke LuPriyo Mustafi
HADOOP-7274CLONE - IOUtils.readFully and IOUtils.skipFully have typo in exception creation's messageMinorutilJonathan EaglesJonathan Eagles
HADOOP-7232Fix javadoc warningsBlockerdocumentationOwen O'MalleyOwen O'Malley
HDFS-2057Wait time to terminate the threads causing unit tests to take longer timeMajordatanodeBharath MundlapudiBharath Mundlapudi
HDFS-2023Backport of NPE for File.list and File.listFilesMajordatanodeBharath MundlapudiBharath Mundlapudi
HDFS-1878TestHDFSServerPorts unit test failure - race condition in FSNamesystem.close() causes NullPointerException without serious consequenceMinornamenodeMatt FoleyMatt Foley
HDFS-1822Editlog opcodes overlap between 20 security and later releasesBlockernamenodeSuresh SrinivasSuresh Srinivas
HDFS-1758Web UI JSP pages thread safety issueMinortoolsTanping WangTanping Wang
HDFS-1750fs -ls hftp://file not workingMajor.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1692In secure mode, Datanode process doesn't exit when disks fail.MajordatanodeBharath MundlapudiBharath Mundlapudi
HDFS-1592Datanode startup doesn't honor volumes.toleratedMajor.Bharath MundlapudiBharath Mundlapudi
HDFS-1377Quota bug for partial blocks allows quotas to be violatedBlockernamenodeEli CollinsEli Collins
HDFS-1258Clearing namespace quota on “/” corrupts FS imageBlockernamenodeAaron T. MyersAaron T. Myers
HDFS-1189Quota counts missed between clear quota and set quotaMajornamenodeKang XiaoJohn George
MAPREDUCE-2846a small % of all tasks fail with DefaultTaskControllerBlockertask, task-controller, tasktrackerAllen WittenauerOwen O'Malley
MAPREDUCE-2804“Creation of symlink to attempt log dir failed.” message is not usefulBlocker.Allen WittenauerOwen O'Malley
MAPREDUCE-2651Race condition in Linux Task Controller for job log directory creationMajortask-controllerBharath MundlapudiBharath Mundlapudi
MAPREDUCE-2621TestCapacityScheduler fails with “Queue “q1” does not exist”Minor.Sherry ChenSherry Chen
MAPREDUCE-2555JvmInvalidate errors in the gridmix TT logsMinortasktrackerThomas GravesThomas Graves
MAPREDUCE-2529Recognize Jetty bug 1342 and handle itMajortasktrackerThomas GravesThomas Graves
MAPREDUCE-2514ReinitTrackerAction class name misspelled RenitTrackerAction in task tracker logTrivialtasktrackerJonathan EaglesJonathan Eagles
MAPREDUCE-2451Log the reason string of healthcheck scriptTrivialjobtrackerThomas GravesThomas Graves
MAPREDUCE-2447Set JvmContext sooner for a task - MR2429Minor.Siddharth SethSiddharth Seth
MAPREDUCE-2443Fix FI build - broken after MR-2429MinortestSiddharth SethSiddharth Seth
MAPREDUCE-2429Check jvmid during task status reportMajortasktrackerArun C MurthySiddharth Seth
MAPREDUCE-2418Errors not shown in the JobHistory servlet (specifically Counter Limit Exceeded)Minor.Siddharth SethSiddharth Seth
MAPREDUCE-2411When you submit a job to a queue with no ACLs you get an inscrutible NPEMinor.Dick KingDick King
MAPREDUCE-2409Distributed Cache does not differentiate between file /archive for files with the same pathMajordistributed-cacheSiddharth SethSiddharth Seth
MAPREDUCE-2366TaskTracker can't retrieve stdout and stderr from web UIMajortasktrackerOwen O'MalleyDick King
MAPREDUCE-2364Shouldn't hold lock on rjob while localizing resources.MajortasktrackerOwen O'MalleyDevaraj Das
MAPREDUCE-2362Unit test failures: TestBadRecords and TestTaskTrackerMemoryManagerMajortestOwen O'MalleyGreg Roelofs
MAPREDUCE-2360Pig fails when using non-default FileSystemMajorclientOwen O'Malley
MAPREDUCE-2359Distributed cache doesn't use non-default FileSystems correctlyMajor.Owen O'MalleyKrishna Ramachandran
MAPREDUCE-2358MapReduce assumes HDFS as the default filesystemMajor.Owen O'MalleyKrishna Ramachandran
MAPREDUCE-2357When extending inputsplit (non-FileSplit), all exceptions are ignoredMajortaskOwen O'MalleyLuke Lu
MAPREDUCE-2356A task succeeded even though there were errors on all attempts.Major.Owen O'MalleyLuke Lu
MAPREDUCE-517The capacity-scheduler should assign multiple tasks per heartbeatCritical.Arun C MurthyArun C Murthy
MAPREDUCE-118Job.getJobID() will always return nullBlockerclientAmar KamatAmareshwari Sriramadasu

TESTS:

JIRASummaryPriorityComponentReporterContributor
HDFS-2218Disable TestHdfsProxy.testHdfsProxyInterface in 0.20-security and branch-1 until HDFS-2217 is fixedBlockercontrib/hdfsproxy, testMatt FoleyMatt Foley
HDFS-2044TestQueueProcessingStatistics failing automatic test due to timing issuesMajortestMatt FoleyMatt Foley

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
HDFS-1767Namenode should ignore non-initial block reports from datanodes when in safemode during startupMajordatanodeMatt FoleyMatt Foley
HDFS-1541Not marking datanodes dead When namenode in safemodeMajornamenodeHairong KuangHairong Kuang
HDFS-1445Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per fileMajordatanodeMatt FoleyMatt Foley
MAPREDUCE-2415Distribute TaskTracker userlogs onto multiple disksMajortask-controller, tasktrackerBharath MundlapudiBharath Mundlapudi
MAPREDUCE-2413TaskTracker should handle disk failures at both startup and runtimeMajortask-controller, tasktrackerBharath MundlapudiRavi Gummadi

OTHER:

JIRASummaryPriorityComponentReporterContributor