Apache Hadoop Changelog

Release 0.10.0 - 2007-01-05

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-811Patch to support multi-threaded MapRunnableMajor.Alejandro AbdelnurDoug Cutting
HADOOP-681Adminstrative hook to pull live nodes out of a HDFS clusterMajor.dhruba borthakurdhruba borthakur
HADOOP-574want FileSystem implementation for Amazon S3MajorfsDoug Cutting
HADOOP-454hadoop du optionally behave like unix's du -sTrivial.Marco NicosiaHairong Kuang

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-853Move site directories to docs directoriesMinordocumentationNigel DaleyDoug Cutting
HADOOP-850Add Writable implementations for variable-length integer types.MinorioAndrzej BialeckiAndrzej Bialecki
HADOOP-837RunJar should unpack jar files into hadoop.tmp.dirMajorutilHairong KuangHairong Kuang
HADOOP-806NameNode WebUI : Include link to each of datanodesMinor.Raghu AngadiRaghu Angadi
HADOOP-804Cut down on the “mumbling” in the Task process' stdout/stderrMajor.Owen O'MalleySanjay Dahiya
HADOOP-796Node failing tasks and failed tasks should be more easily accessible through jobtracker history.Minor.Sanjay DahiyaSanjay Dahiya
HADOOP-783Hadoop dfs -put and -get accept ‘-’ to indicate stdin/stdoutMinor.Marco NicosiaWendy Chien
HADOOP-763NameNode benchmark using mapred is insufficientMinortestNigel DaleyNigel Daley
HADOOP-756new dfsadmin command to wait until safe mode is exitedMinor.Owen O'Malleydhruba borthakur
HADOOP-720Write a white paper on Hadoop File System Architecture, Design and FeaturesMajordocumentationdhruba borthakurdhruba borthakur
HADOOP-717When there are few reducers, sorting should be done by mappersMajor.arkady borkovskyOwen O'Malley
HADOOP-676JobClient should print user friendly messages for standard errorsMajor.Owen O'MalleySanjay Dahiya
HADOOP-621When a dfs -cat command is killed by the user, the correspondig hadoop process does not get abortedMinor.dhruba borthakurdhruba borthakur
HADOOP-619Unify Map-Reduce and Streaming to take the same globbed input specificationMajor.eric baldeschwielerSanjay Dahiya
HADOOP-618JobProfile and JobSubmissionProtocol should be publicMajor.Runping QiArun C Murthy
HADOOP-571Path should use URI syntaxMajorfsDoug CuttingDoug Cutting
HADOOP-525Need raw comparators for hadoop record typesMajorrecordSameer ParanjpyeMilind Bhandarkar
HADOOP-470Some improvements in the DFS content browsing UIMinor.Devaraj DasHairong Kuang
HADOOP-451Add a Split interfaceMajor.Doug CuttingOwen O'Malley
HADOOP-371ant tar should package contrib jarsMajorbuildMichel TournNigel Daley
HADOOP-331map outputs should be written to a single output file with an indexMajor.eric baldeschwielerDevaraj Das

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-849randomwriter fails with ‘java.lang.OutOfMemoryError: Java heap space’ in the ‘reduce’ taskMajor.Arun C MurthyDevaraj Das
HADOOP-846Progress report is not sent during the intermediate sorts in the map phaseMajor.Devaraj DasDevaraj Das
HADOOP-844Metrics messages are sent on a fixed-delay schedule instead of a fixed-rate scheduleMinormetricsDavid Bowen
HADOOP-841native hadoop libraries don't build properly with 64-bit OS and a 32-bit jvmMajorbuildArun C MurthyArun C Murthy
HADOOP-840the task tracker is getting blocked by long deletes of local filesMajor.Owen O'MalleyMahadev konar
HADOOP-838TaskRunner.run() doesn't pass along the ‘java.library.path’ to the child (task) jvmMajor.Arun C MurthyArun C Murthy
HADOOP-836unit tests fail on windows (/C:/cygwin/... is invalid)Major.Owen O'MalleyOwen O'Malley
HADOOP-835conf not set for the default Codec when initializing a Reader for a record-compressed sequence fileMajorioHairong KuangHairong Kuang
HADOOP-829Separate the datanode contents that is written to the fsimage vs the contents used in over-the-wire communicationMajor.dhruba borthakurdhruba borthakur
HADOOP-825If the default file system is set using the new uri syntax, the namenode will not startMajor.Owen O'MalleyOwen O'Malley
HADOOP-824DFSShell should become FSShellMajor.Doug Cutting
HADOOP-823DataNode will not start up if any directories from dfs.data.dir are missingMajor.Bryan PendletonSameer Paranjpye
HADOOP-818ant clean test-contrib doesn't workMajor.Owen O'MalleyOwen O'Malley
HADOOP-814Increase dfs scalability by optimizing locking on namenode.Major.dhruba borthakurdhruba borthakur
HADOOP-813map tasks lost during sortMajor.Owen O'MalleyDevaraj Das
HADOOP-802mapred.speculative.execution description in hadoop-defauls.xml is not completeTrivialconfNigel DaleyNigel Daley
HADOOP-794JobTracker crashes with ArithmeticExceptionMajor.Nigel DaleyOwen O'Malley
HADOOP-792Invalid dfs -mv can trash your entire dfsMajor.Chris Schneider
HADOOP-786PhasedFileSystem should use debug level log for ignored exception.Trivial.Sanjay DahiyaSanjay Dahiya
HADOOP-782TaskTracker.java:killOverflowingTasks & TaskTracker.java:markUnresponsiveTasks only put the tip in tasksToCleanup queue, they don't update the runningJobsMajor.Arun C MurthyArun C Murthy
HADOOP-777the tasktracker hostname is not fully qualifiedMinor.Mahadev konarMahadev konar
HADOOP-774Datanodes fails to heartbeat when a directory with a large number of blocks is deletedMajor.dhruba borthakurdhruba borthakur
HADOOP-770When JobTracker gets restarted, Job Tracker History doesn't show the jobs that were running. (incomplete jobs)Minor.Koji NoguchiSanjay Dahiya
HADOOP-764The memory consumption of processReport() in the namenode can be reducedMajor.dhruba borthakurdhruba borthakur
HADOOP-752Possible locking issues in HDFS NamenodeMajor.dhruba borthakurdhruba borthakur
HADOOP-745NameNode throws FileNotFoundException: Parent path does not exist on startupMajor.Nigel Daleydhruba borthakur
HADOOP-738dfs get or copyToLocal should not copy crc fileMajor.Milind BhandarkarMilind Bhandarkar
HADOOP-737TaskTracker's job cleanup loop should check for finished job before deleting local directoriesCritical.Sanjay DahiyaArun C Murthy
HADOOP-700bin/hadoop includes in classpath all jar files in HADOOP_HOMEMajorscriptsNigel DaleyDoug Cutting
HADOOP-673the task execution environment should have a current working directory that is task specificMajor.Owen O'MalleyMahadev konar
HADOOP-629none of the rpc servers check the protcol name for validityMajoripcOwen O'MalleyOwen O'Malley
HADOOP-628hadoop hdfs -cat replaces some characters with question marks.Major.arkady borkovskyWendy Chien
HADOOP-596TaskTracker taskstatus's phase doesnt get updated on phase transition causing wrong values displayed in WIMajor.Sanjay DahiyaSanjay Dahiya
HADOOP-546Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks)Critical.Sanjay DahiyaArun C Murthy

TESTS:

JIRASummaryPriorityComponentReporterContributor

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor

OTHER:

JIRASummaryPriorityComponentReporterContributor