Apache Hadoop Changelog

Release 0.20.0 - 2009-04-22

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-5531Remove Chukwa on branch-0.20Blocker.Nigel DaleyNigel Daley
HADOOP-4970Use the full path when move files to .Trash/CurrentMajor.Prasad ChakkaPrasad Chakka
HADOOP-4826Admin command saveNamespace.Major.Konstantin ShvachkoKonstantin Shvachko
HADOOP-4789Change fair scheduler to share between pools by default, not between invidual jobsMinor.Matei ZahariaMatei Zaharia
HADOOP-4783History files are given world readable permissions.Blocker.Hemanth YamijalaAmareshwari Sriramadasu
HADOOP-4631Split the default configurations into 3 partsMajorconfOwen O'MalleySharad Agarwal
HADOOP-4618Move http server from FSNamesystem into NameNode.Major.Konstantin ShvachkoKonstantin Shvachko
HADOOP-4576Modify pending tasks count in the UI to pending jobs count in the UIMajor.Hemanth YamijalaSreekanth Ramakrishnan
HADOOP-4572INode and its sub-classes should be package privateMajor.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4567GetFileBlockLocations should return the NetworkTopology information of the machines that hosts those blocksMajor.dhruba borthakurdhruba borthakur
HADOOP-4445Wrong number of running map/reduce tasks are displayed in queue information.Major.Karam SinghSreekanth Ramakrishnan
HADOOP-4435The JobTracker should display the amount of heap memory usedMinor.dhruba borthakurdhruba borthakur
HADOOP-4422S3 file systems should not create bucketMajorfs/s3David PhillipsDavid Phillips
HADOOP-4253Fix warnings generated by FindBugsMajorconf, fs, recordSuresh SrinivasSuresh Srinivas
HADOOP-4210Findbugs warnings are printed related to equals implementation of several classesMajor.Suresh SrinivasSuresh Srinivas
HADOOP-4188Remove Task's dependency on concrete file systemsMajor.Tom WhiteSharad Agarwal
HADOOP-4103Alert for missing blocksMajor.Christian KunzRaghu Angadi
HADOOP-4035Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memoryBlocker.Hemanth YamijalaVinod Kumar Vavilapalli
HADOOP-4029NameNode should report status and performance for each replica of image and logMajor.Robert ChanslerBoris Shkolnik
HADOOP-3986JobClient should not have a static configurationMajor.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-3923Deprecate org.apache.hadoop.mapred.StatusHttpServerMinor.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-3750Fix and enforce module dependenciesMajor.Tom WhiteSharad Agarwal
HADOOP-3497File globbing with a PathFilter is too restrictiveMajorfsTom WhiteTom White
HADOOP-3422Ganglia counter metrics are all reported with the metric name “value”, so the counter values can not be seenMajormetricsJasonstack
HADOOP-3344libhdfs: always builds 32bit, even when x86_64 Java usedMajorbuildCraig MacdonaldGiridharan Kesavan
HADOOP-1650Upgrade Jetty to 6.xMajor.Devaraj DasChris Douglas

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-4937[HOD] Include ringmaster RPC port information in the notes attributeMajorcontrib/hodHemanth YamijalaPeeyush Bishnoi
HADOOP-4804Create Forrest documentation for the fair schedulerMinor.Matei ZahariaSreekanth Ramakrishnan
HADOOP-4661distch: a tool for distributed ch{mod,own}Major.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4622Explicitly specify interpretor for non-native binariesMinor.Fredrik HedbergFredrik Hedberg
HADOOP-4575An independent HTTPS proxy for HDFSMajorsecurityKan ZhangKan Zhang
HADOOP-4348Adding service-level authorization to HadoopMajorsecurityKan ZhangArun C Murthy
HADOOP-4284Support for user configurable global filters on HttpServerMajorsecurityKan ZhangKan Zhang
HADOOP-4179Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobsMajor.Suhas GogateSuhas Gogate

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-6150Need to be able to instantiate a comparator instance from a comparator string without creating a TFile.Reader objectMinorioHong TangHong Tang
HADOOP-5521Remove dependency of testcases on RESTART_COUNTMajortestAmar KamatRavi Gummadi
HADOOP-5520Typo in diskQuota help documentationTrivialdocumentationRavi PhulariRavi Phulari
HADOOP-5519Remove claims from mapred-default.xml that prime numbers of tasks are helpful.Major.Owen O'MalleyOwen O'Malley
HADOOP-5514Add waiting/failed tasks to JobTracker metricsMajormetricsChris DouglasChris Douglas
HADOOP-5468Change Hadoop doc menu to sub-menusMajordocumentationCorinne ChandelCorinne Chandel
HADOOP-5466CSS Style Changes for Hadoop Doc Headers and CodeMajordocumentationCorinne ChandelCorinne Chandel
HADOOP-5395When queue ACLs are enabled, the error message shown when a job is submitted to a non-existent queue is misleadingMajor.Hemanth Yamijalarahul k singh
HADOOP-5379Throw exception instead of writing to System.err when there is a CRC error on CBZip2InputStreamMinorioRodrigo SchmidtRodrigo Schmidt
HADOOP-5275ivy directory should be there in hadoop tar ballMajorbuildSuman SehgalGiridharan Kesavan
HADOOP-5122libhdfs test conf uses deprecated fs.default.name valueTrivialtestCraig MacdonaldCraig Macdonald
HADOOP-5030Chukwa RPM build improvementsMajor.Eric YangEric Yang
HADOOP-4980Cleanup the Capacity Scheduler codeMajor.Vivek RatanVivek Ratan
HADOOP-4950CompressorStream and BlockCompressorStream should be publicMajorioOwen O'MalleyOwen O'Malley
HADOOP-4944Allow Xinclude in hadoop config fileMinorconfRama, RamasamyRama, Ramasamy
HADOOP-4920do not keep forrest output in subversionMajordocumentationDoug CuttingDoug Cutting
HADOOP-4916adjust build.xml to reference external properties when building the “init.d” for the rpmMajor.Eric YangEric Yang
HADOOP-4909Clean up map/reduce api to take JobContext in the static methodsMajor.Owen O'MalleyOwen O'Malley
HADOOP-4880Improvements to TestJobTrackerRestartMajortestArun C MurthyAmar Kamat
HADOOP-4843Collect Job History log file and Job Conf file into ChukwaMajor.Eric YangEric Yang
HADOOP-4838Cleanup Metrics and the MBeansMajor.Sanjay RadiaSanjay Radia
HADOOP-4837Move HADOOP_CONF_DIR to chukwa-env.shMajor.Jerome BoulonJerome Boulon
HADOOP-4828Update documentation for default configurationMajordocumentationSharad AgarwalSharad Agarwal
HADOOP-4827Improve data aggregation in databaseMajor.Eric YangEric Yang
HADOOP-4758Add a splitter for metrics contextsMinormetricsChris DouglasChris Douglas
HADOOP-4753gridmix2 code can be condensedMinorbenchmarksChris DouglasChris Douglas
HADOOP-4749reducer should output input data size when shuffling is doneMajor.Zheng ShaoHe Yongqiang
HADOOP-4747Reuse FileStatus in FsShell where possibleMinorfsDavid PhillipsDavid Phillips
HADOOP-4708Add support for dfsadmin commands for test TestCLI unit testMajortestBoris ShkolnikBoris Shkolnik
HADOOP-4705[HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clustersMajorcontrib/hodHemanth YamijalaPeeyush Bishnoi
HADOOP-4699Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in ReduceMajor.Chris DouglasChris Douglas
HADOOP-4690fuse-dfs - create source file/function + utils + config + main source filesMinor.Pete WyckoffPete Wyckoff
HADOOP-4668Improve JavaDoc on JobConf.setCombinerClass to better document restrictions on combinersMajordocumentationOwen O'MalleyOwen O'Malley
HADOOP-4666Launch reduces only after a few maps have run in the Fair SchedulerMajor.Matei ZahariaMatei Zaharia
HADOOP-4664Parallelize job initializationBlocker.Matei ZahariaJothi Padmanabhan
HADOOP-4649Improve abstraction for spill indicesMinor.Chris DouglasChris Douglas
HADOOP-4640Add ability to split text files compressed with lzoTrivialioJohan OskarssonJohan Oskarsson
HADOOP-4628Move Hive out of CoreMajor.Owen O'Malley
HADOOP-4599BlocksMap and BlockInfo should be package private.Major.Konstantin ShvachkoKonstantin Shvachko
HADOOP-4565MultiFileInputSplit can use data locality information to create splitsMajor.dhruba borthakurdhruba borthakur
HADOOP-4545Add an example of a secondary sortMajor.Owen O'MalleyOwen O'Malley
HADOOP-4523Enhance how memory-intensive user tasks are handledMajor.Vivek RatanVinod Kumar Vavilapalli
HADOOP-4485ant compile-native shorthandTrivialbuildEnis SoztutarEnis Soztutar
HADOOP-4454Support comments in ‘slaves’ fileMinorconf, scriptsRama, RamasamyRama, Ramasamy
HADOOP-4453Improve ssl handling for distcpMajor.Chris DouglasKan Zhang
HADOOP-4440TestJobInProgressListener should also test for jobs killed in queued stateMinortestAmar KamatAmar Kamat
HADOOP-4437Use qMC sequence to improve the accuracy of PiEstimatorMinor.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4339Improve FsShell -du/-dus and FileSystem.getContentSummary efficiencyMajorfsDavid PhillipsDavid Phillips
HADOOP-4305repeatedly blacklisted tasktrackers should get declared deadMajor.Christian KunzAmareshwari Sriramadasu
HADOOP-4276The mapred.*ID classes are inefficient for hashCode and serializationMajor.Owen O'MalleyOwen O'Malley
HADOOP-4244In “ant test-patch”, runContribTestOnEclipseFiles should not be run on Hudson onlyMajorbuild, testTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4234KFS: Allow KFS layer to interface with multiple KFS namenodesMinorfsSriram RaoSriram Rao
HADOOP-4226LineReader::readLine cleanupMinor.Yuri PradkinYuri Pradkin
HADOOP-4178The capacity scheduler's defaults for queues should be configurable.Blocker.Owen O'MalleySreekanth Ramakrishnan
HADOOP-4126Allow access to HDFS web UI on EC2Majorcontrib/cloudTom WhiteTom White
HADOOP-3770improve composition, submission and result collection of gridmixMajorbenchmarksLingyun YangRunping Qi
HADOOP-3461Remove dfs.StringBytesWritbaleMajor.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-3180add name of faulty class to WritableName.getClass IOException upon ClassNotFoundExceptionTrivialioPete WyckoffPete Wyckoff
HADOOP-3136Assign multiple tasks per TaskTracker heartbeatMajor.Devaraj DasArun C Murthy
HADOOP-3063BloomMapFile - fail-fast version of MapFile for sparsely populated key spaceMajorioAndrzej BialeckiAndrzej Bialecki
HADOOP-2774Add counters to show number of key/values that have been sorted and merged in the maps and reducesMajor.Owen O'MalleyRavi Gummadi
HADOOP-1230Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classesMajor.Owen O'MalleyOwen O'Malley
HADOOP-466Startup scripts will not start instances of Hadoop daemons w/different configs w/o setting separate PID directoriesMajorconfVetle Roeim

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-5645After HADOOP-4920 we need a place to checkin releasenotes.htmlMajorbuildNigel DaleyNigel Daley
HADOOP-5644Namnode is stuck in safe modeMajor.Suresh SrinivasSuresh Srinivas
HADOOP-5607TestCapacityScheduler fails with NPEMajortestChris DouglasChris Douglas
HADOOP-5605All the replicas incorrectly got marked as corrupt.Blocker.Raghu AngadiHairong Kuang
HADOOP-5588hadoop commands seem extremely slow in 0.20 branchBlockerfsKoji NoguchiHairong Kuang
HADOOP-5585FileSystem statistic counters are too high when JVM reuse is enabled.Blocker.Owen O'MalleyOwen O'Malley
HADOOP-5577The Job.waitForCompletion doesn't print status as the job runsBlocker.Owen O'MalleyOwen O'Malley
HADOOP-5576LocalJobRunner does not run jobs using new MapReduce APIBlocker.Tom WhiteTom White
HADOOP-5571TupleWritable can return incorrect results if it contains more than 32 valuesMajor.Jingkei LyJingkei Ly
HADOOP-5565The job instrumentation API needs to have a method for finalizeJob,Major.Jerome BoulonJerome Boulon
HADOOP-5564hadoop command uses large JVM heap sizeBlockerbuildSuresh SrinivasSuresh Srinivas
HADOOP-5557Two minor problems in TestOverReplicatedBlocksMinortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-5554DataNodeCluster should create blocks with the same generation stamp as the blocks created in CreateEditsLogMajortestHairong KuangHairong Kuang
HADOOP-5551Namenode permits directory destruction on overwriteCritical.Brian BockelmanBrian Bockelman
HADOOP-5549ReplicationMonitor should schedule both replication and deletion work in one iterationMajor.Hairong KuangHairong Kuang
HADOOP-5548Observed negative running maps on the job trackerBlocker.Owen O'MalleyAmareshwari Sriramadasu
HADOOP-5534Deadlock triggered by FairScheduler scheduler's servlet due to changes from HADOOP-5214.Blocker.Vinod Kumar Vavilapallirahul k singh
HADOOP-5522Document job setup/cleaup tasks and task cleanup tasks in mapred tutorialBlocker.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-5516TaskMemoryManagerThread crashes in a corner caseBlocker.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
HADOOP-5505TestMissingBlocksAlert fails on 0.20.Major.Raghu AngadiRaghu Angadi
HADOOP-5499JobTracker metrics do not match job countersMajormetricsChris Douglas
HADOOP-5493Shuffle copiers do not return Codecs back to the pool at the end of shufflingBlocker.Devaraj DasJothi Padmanabhan
HADOOP-5490TestParallelInitialization failed on NoSuchElementExceptionBlocker.Hairong KuangJothi Padmanabhan
HADOOP-5484TestRecoveryManager fails wtih FileAlreadyExistsExceptionMajortestHairong KuangAmar Kamat
HADOOP-5483Directory/file cleanup thread throws IllegalStateExceptionMajor.Hairong Kuang
HADOOP-5479NameNode should not send empty block replication request to DataNodeCritical.Hairong KuangHairong Kuang
HADOOP-5473Race condition in command-line kill for a taskMajor.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-5471SyncLogs thread in Child.java would update wrong file for a cleanup attempt, in some cases.Major.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-5465Blocks remain under-replicatedBlocker.Hairong KuangHairong Kuang
HADOOP-5463Balancer throws “Not a host:port pair” unless port is specified in fs.default.nameMinor.Stuart WhiteStuart White
HADOOP-5459CRC errors not detected reading intermediate output into memory with problematic lengthMajor.Chris DouglasChris Douglas
HADOOP-5440Successful taskid are not removed from TaskMemoryManagerBlocker.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-5437Unit test for jvm -reuseBlocker.Amareshwari SriramadasuOwen O'Malley
HADOOP-5432TestHdfsProxy fails on 0.20Major.Chris DouglasChris Douglas
HADOOP-5417IPC client drops interrupted exceptionsBlockeripcOwen O'MalleyOwen O'Malley
HADOOP-5416Wrong description of " hadoop fs -test " in FS Shell guide .TrivialdocumentationRavi PhulariRavi Phulari
HADOOP-5414IO exception while executing hadoop fs -touchz fileNameMajorfsRavi PhulariHairong Kuang
HADOOP-5394JobTracker might schedule 2 attempts of the same task with the same attempt id across restartsCritical.Amar KamatAmar Kamat
HADOOP-5390hdfsproxy includes duplicate jars in tarball, source in binary tarballMajorbuildChris Douglaszhiyong zhang
HADOOP-5384DataNodeCluster should not create blocks with generationStamp == 1BlockertestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-5382The new map/reduce api doesn't support combinersBlocker.Owen O'MalleyOwen O'Malley
HADOOP-5376JobInProgress.obtainTaskCleanupTask() throws an ArrayIndexOutOfBoundsExceptionBlocker.Vinod Kumar VavilapalliAmareshwari Sriramadasu
HADOOP-5338Reduce tasks are stuck waiting for map outputs when none are in progressBlocker.Ramya SunilAmar Kamat
HADOOP-5337JobTracker greedily schedules tasks without running tasks to joinMajor.Karam SinghAmar Kamat
HADOOP-5328Renaming of Job histroy file is incorrect if Jobtracker is restarted multimple timesMajor.Karam SinghAmar Kamat
HADOOP-5327Job files for a job failing because of ACLs are not clean from the system directoryBlocker.Karam SinghAmar Kamat
HADOOP-5326bzip2 codec (CBZip2OutputStream) creates corrupted output file for some inputsMajorioRodrigo SchmidtRodrigo Schmidt
HADOOP-5320TestMapReduceLocal is missing a close() that is causing it to fail while running the test on NFSMinortestJothi PadmanabhanJothi Padmanabhan
HADOOP-5306Job History file can have empty string as http port after JobTracker Restart in case of lost TT, which can result in NumberFormatException when JT is restarted 2nd timeBlocker.Ravi GummadiAmar Kamat
HADOOP-5305Unit test org.apache.hadoop.fs.TestCopyFiles.testMapCount fails on trunkMinortestRamya SunilTsz Wo Nicholas Sze
HADOOP-5298Unit test fails out on trunk org.apache.hadoop.http.TestServletFilter.testServletFilterMajortestLee TuckerTsz Wo Nicholas Sze
HADOOP-5292KFS: calling getFileBlockLocations() on 0-length file causes a NPEMajor.Sriram RaoSriram Rao
HADOOP-5285JobTracker hangs for long periods of timeBlocker.Vinod Kumar VavilapalliDevaraj Das
HADOOP-5282Running tasks on lost trackers are incorrectly logging the attempt and task failuresBlocker.Amar KamatAmar Kamat
HADOOP-5281GzipCodec fails second time it is used in a processBlocker.Ben MaurerChris Douglas
HADOOP-5280When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap.Blocker.Vinod Kumar VavilapalliDevaraj Das
HADOOP-5274gridmix2 is not getting compiled to generate gridmix.jarCriticalbenchmarksSuman SehgalChris Douglas
HADOOP-5272JobTracker does not log TIP start information after restartCritical.Amar KamatAmar Kamat
HADOOP-5269TaskTracker.runningTasks holding FAILED_UNCLEAN and KILLED_UNCLEAN taskStatuses forever in some cases.Blocker.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-5259Job with output hdfs:/user/<username>/outputpath (no authority) fails with Wrong FSMajorfsKoji NoguchiDoug Cutting
HADOOP-5255Fix for HADOOP-5079 HashFunction inadvertently destroys some randomnessMinoriostackJonathan Ellis
HADOOP-5248Job directories could remain undeleted in some scenarios after job completes.Blocker.Hemanth YamijalaDevaraj Das
HADOOP-5247NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero.Blocker.Vinod Kumar VavilapalliAmar Kamat
HADOOP-5241Reduce tasks get stuck because of over-estimated task size (regression from 0.18)Blocker.Andy PavloSharad Agarwal
HADOOP-5233Reducer not Succeded after 100%Blocker.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-5227distcp -delete option deletes all files from the destination directoryMajor.Suhas GogateTsz Wo Nicholas Sze
HADOOP-5214ConcurrentModificationException in FairScheduler.getTotalSlotsBlocker.Vinod Kumar Vavilapallirahul k singh
HADOOP-5211TestSetupAndCleanupFailure fails with timeoutMajor.Enis SoztutarEnis Soztutar
HADOOP-51544-way deadlock in FairShare schedulerBlocker.Vinod Kumar VavilapalliMatei Zaharia
HADOOP-5146LocalDirAllocator misses files on the local filesystemBlocker.Arun C MurthyDevaraj Das
HADOOP-5145Balancer sometimes runs out of memory after days or weeks runningMajor.Hairong KuangHairong Kuang
HADOOP-5142MapWritable#putAll does not store classesMinorioDoğacan Güney
HADOOP-5139RPC call throws IllegalArgumentException complaining duplicate metrics registrationMajoripcHairong KuangHairong Kuang
HADOOP-5111Generic mapreduce classes cannot be used with Job::set* methodsMajor.Chris DouglasChris Douglas
HADOOP-5085Copying a file to local with Crc throws an exceptionMajorfsHairong KuangHairong Kuang
HADOOP-5079HashFunction inadvertently destroys some randomnessMajorutilJonathan EllisJonathan Ellis
HADOOP-5075Potential infinite loop in updateMinSlotsBlocker.Matei ZahariaMatei Zaharia
HADOOP-5068testClusterBlockingForLackOfMemory in TestCapacityScheduler fails randomlyMajor.Sreekanth RamakrishnanVinod Kumar Vavilapalli
HADOOP-5066ant binary should not compile docsMajorbuildAmareshwari SriramadasuGiridharan Kesavan
HADOOP-5065setOutputFormatClass in mapreduce.Job fails for SequenceFileOutputFormatMajor.Chris DouglasChris Douglas
HADOOP-5048Sometimes job is still displayed in jobqueue_details page for long time after job was killed.Major.Karam SinghSreekanth Ramakrishnan
HADOOP-5026Startup scripts should be svn-executableMinor.Andy KonwinskiAndy Konwinski
HADOOP-4999IndexOutOfBoundsException in FSEditLogMajor.Boris ShkolnikBoris Shkolnik
HADOOP-4993chukwa agent startup should be more modularMajor.Ari RabkinAri Rabkin
HADOOP-4988An earlier fix, for HADOOP-4373, results in a problem with reclaiming capacity when one or more queues have a capacity equal to zeroBlocker.Vivek RatanVivek Ratan
HADOOP-4979Capacity Scheduler does not always return no task to a TT if a job's memry requirements are not metMajor.Vivek RatanVivek Ratan
HADOOP-4977Deadlock between reclaimCapacity and assignTasksBlocker.Matei ZahariaVivek Ratan
HADOOP-4963Logs saying org.apache.hadoop.util.DiskChecker$DiskErrorException in TaskTracker are not relevantMinor.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-4956NPE when jobdetails.jspBlocker.Devaraj DasDevaraj Das
HADOOP-4949Native compilation is brokenBlocker.Chris DouglasChris Douglas
HADOOP-4947use regex to parse chukwa commandsMinor.Ari RabkinAri Rabkin
HADOOP-4925Chukwa HTTP connection policies are too hard to configureMajor.Ari RabkinAri Rabkin
HADOOP-4914Support chkconfig for chukwa start up scriptsTrivial.Eric YangEric Yang
HADOOP-4896hdfs fsck does not load hdfs configuration.Blocker.Raghu AngadiRaghu Angadi
HADOOP-4894fix Chukwa's jettyCollector.shMinor.Ari RabkinAri Rabkin
HADOOP-4892File descriptor leak in Chukwa's ExecPluginMajor.Ari RabkinAri Rabkin
HADOOP-4889Chukwa RPM needs to chown user/group in build stage instead of post install stage.Trivial.Eric YangEric Yang
HADOOP-4884Change Date format pattern for Time Series graphTrivial.Eric YangEric Yang
HADOOP-4879TestJobTrackerRestart fails on trunkBlockertestArun C MurthyOwen O'Malley
HADOOP-4878After introduction of ivy ant test-patch always returns -1 scoreBlockerbuildSreekanth RamakrishnanGiridharan Kesavan
HADOOP-4876Capacity reclaimation for queue would not work as intendedBlocker.Sreekanth RamakrishnanSreekanth Ramakrishnan
HADOOP-4874Remove bindings to lzoBlockerioOwen O'MalleyOwen O'Malley
HADOOP-4873display minMaps/Reduces on advanced scheduler pageMajor.Joydeep Sen SarmaJoydeep Sen Sarma
HADOOP-4869Lost Trackers may not be able to join backBlocker.Devaraj DasAmareshwari Sriramadasu
HADOOP-4860File Tailing Adaptor test cases causes random failureMajor.Eric YangEric Yang
HADOOP-4855Fix help message in MRAdminMinorfs, securityArun C MurthyArun C Murthy
HADOOP-4854Capacity Scheduler should read the reclaim-capacity-interval config value from its own config fileMinor.Vivek RatanSreekanth Ramakrishnan
HADOOP-4849Document service level authorization - HADOOP-4348Majordocumentation, scriptsArun C MurthyArun C Murthy
HADOOP-4845Shuffle counter issuesMajor.Chris DouglasHe Yongqiang
HADOOP-4844Document deprecation of o.a.h.fs.permission.AccessControlException betterMinordocumentation, fsArun C MurthyArun C Murthy
HADOOP-4830Have end to end tests based on MiniMRCluster to verify that queue capacities are honoured.Major.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
HADOOP-4825Chukwa - change jps to ps for process status detectionMajor.Eric YangEric Yang
HADOOP-4820Remove unused method FSNamesystem.deleteInSafeModeMinor.Suresh SrinivasSuresh Srinivas
HADOOP-4818Enable JobTracker Instrumentation API with user job configurationMajor.Eric YangEric Yang
HADOOP-4811Import style sheet images for ChukwaTrivial.Eric YangEric Yang
HADOOP-4805Remove black list feature from Chukwa Agent to Chukwa Collector communicationMajor.Eric YangEric Yang
HADOOP-4796Test target for chukwa build.xml needs to comply to hadoop build.xml test suitesMajorbuildEric YangEric Yang
HADOOP-4792Chukwa build process generates files not tracked by svnMajorbuildChris DouglasChris Douglas
HADOOP-4791Improve rpm build process for ChukwaMajor.Eric YangEric Yang
HADOOP-4787TestTrackerBlacklistAcrossJobs fails randomlyBlockertestHemanth YamijalaAmareshwari Sriramadasu
HADOOP-4786TestTrackerBlacklistAcrossJobs compilation is brokenBlocker.Hemanth YamijalaHemanth Yamijala
HADOOP-4785avoid two calls to System.currentTimeMillis() in heartbeatBlocker.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-4782[HOD] HOD opens up directory permissions more than requiredBlockercontrib/hodHemanth YamijalaPeeyush Bishnoi
HADOOP-4774CapacityScheduler should work even if capacity-scheduler.xml is not in the classpath i.e with the code defaultsMajor.Amar KamatSreekanth Ramakrishnan
HADOOP-4771FSImage saveFSImage() will have problem.Major.Ruyue MaRuyue Ma
HADOOP-4770gridmix2 run script doesn't work on trunkTrivialbenchmarksChris DouglasChris Douglas
HADOOP-4744Wrong resolution of hostname and portBlocker.Amareshwari SriramadasuJothi Padmanabhan
HADOOP-4738saveVersion.sh could write a package-info.java that cannot be compiled when used with gitTrivialbuildHemanth YamijalaChris Douglas
HADOOP-4737Job end notification should give status as “KILLED” when job gets killed.Major.Ruchir ShahAmareshwari Sriramadasu
HADOOP-4732connectionTimeout and readTimeout are passed in wrong order in ReduceTask.javaMinor.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-4716testRestartWithLostTracker frequently times outBlocker.Johan OskarssonAmar Kamat
HADOOP-4706IFileOutputStream.close should call close of the underlying streamMinor.Jothi PadmanabhanJothi Padmanabhan
HADOOP-4704javadoc: “the the” => “the”TrivialdocumentationTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4698TestMapRed fails with 64bit JDKMajortestNigel DaleyNigel Daley
HADOOP-4695TestGlobalFilter.testServletFilter failsBlockertestTsz Wo Nicholas SzeKan Zhang
HADOOP-4692Namenode in infinite loop for replicating/deleting corrupted blockMajor.Hairong KuangHairong Kuang
HADOOP-4691In the javadoc of IndexedSortable.compare(...), the link is wrong.Minordocumentation, utilTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4683Move the call to getMapCompletionEvents in ReduceTask.ReduceCopier.fetchOutputs to a separate threadMajor.Devaraj DasJothi Padmanabhan
HADOOP-4677FileSystem.getFileBlockLocations() (aka default implementation for Local FileSystem) incorrect.MajorfsHong TangHong Tang
HADOOP-4676Go back to Job has a wrong URL on blacklisted trackers pageMinor.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-4671Make some “flag” booleans volatile because they are set/read in different threadsMinor.Owen O'MalleyChris Douglas
HADOOP-4669A file-open sometimes may not set the access time of a fileMajor.dhruba borthakurdhruba borthakur
HADOOP-4650local.cache.size is set to 10 GB, while DEFAULT_CACHE_SIZE is set to 1 MBTrivialfilecacheJeff HammerbacherJeff Hammerbacher
HADOOP-4645hdfs proxy doesn't package itself right.Major.Owen O'MalleyKan Zhang
HADOOP-4638Exception thrown in/from RecoveryManager.recover() should be caught and handledBlocker.Amar KamatAmar Kamat
HADOOP-4623Running tasks are not maintained by JobInProgress if speculation is offMajor.Amar KamatAmar Kamat
HADOOP-4621javadoc: warning - Multiple sources of package comments found for some packagesMajordocumentationTsz Wo Nicholas SzeKan Zhang
HADOOP-4608Examples -Driver does not check first argument.Major.Edward J. YoonEdward J. Yoon
HADOOP-4606There is a cygpath error if log directory does not existMinorscriptsTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4598‘-setrep’ command skips under-replicated blocksMinor.Koji NoguchiHairong Kuang
HADOOP-4589Fix the PiEstimator output messages and code commentsMinordocumentationTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-4587typo in javadoc for map.input.fileTrivialdocumentationKoji NoguchiKoji Noguchi
HADOOP-4583Code optimization/cleanup in HDFSMajor.Suresh SrinivasSuresh Srinivas
HADOOP-4579StorageDirectory is not removed from the storage directories list when writing to an edits failsMajor.Boris ShkolnikBoris Shkolnik
HADOOP-4571chukwa conf files are not cleaned upMinor.Tsz Wo Nicholas SzeEric Yang
HADOOP-4558Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the otherMajor.Karam SinghAmar Kamat
HADOOP-4530In fsck, HttpServletResponse sendError fails with IllegalStateExceptionMajor.Koji NoguchiHairong Kuang
HADOOP-4513Capacity scheduler should initialize tasks asynchronouslyMajor.Hemanth YamijalaSreekanth Ramakrishnan
HADOOP-4429Misconfigured UNIX Groups Break HadoopMinor.Alex LoddengaardAlex Loddengaard
HADOOP-4408FsAction operations shouldn't create new ObjectsMinorfsChris DouglasChris Douglas
HADOOP-4388Bug in Datanode transferBlocks codeMajor.Suresh SrinivasSuresh Srinivas
HADOOP-4377Race condition creating S3 buffer directory for NativeS3FileSystemMajorfs/s3David PhillipsDavid Phillips
HADOOP-4374JVM should not be killed but given an opportunity to exit gracefullyMajor.Devaraj DasRavi Gummadi
HADOOP-4346Hadoop triggers a “soft” fd leak.MajorioRaghu AngadiRaghu Angadi
HADOOP-4325Hadoop SocketInputStream.read() should return -1 in case of EOF.MinorioRaghu AngadiRaghu Angadi
HADOOP-4262message generated when the client exception has a null message is not usefulMinoripcSteve Loughran
HADOOP-4245KFS: Update the kfs jar fileMajorfsSriram RaoSriram Rao
HADOOP-4238[mapred] Unavailable schedulingInfo in “hadoop list [all]” output should be marked “N/A”Major.Vinod Kumar VavilapalliSreekanth Ramakrishnan
HADOOP-4207update derby.jar to eliminate the one time wait of 2-3 minutes while running junit testsMinor.Prasad ChakkaPrasad Chakka
HADOOP-4204Fix warnings generated by FindBugsBlocker.Suresh SrinivasSuresh Srinivas
HADOOP-4141ScriptBasedMapping has infinite loop with invalid jobconf parameterMinor.Aaron KimballAaron Kimball
HADOOP-3921Clover breaks nightly buildsMajorbuildTom WhiteTom White
HADOOP-3842There is a window where the JobTracker is in the RUNNING state (i.e ready to accept jobs) and never executes them.Major.Amar KamatHemanth Yamijala
HADOOP-3810NameNode seems unstable on a cluster with little space leftMajor.Raghu AngadiHairong Kuang
HADOOP-3293When an input split spans cross block boundary, the split location should be the host having most of bytes on it.Major.Runping QiJothi Padmanabhan
HADOOP-2771changing the number of reduces dramatically changes the time of the map timeMajor.Owen O'Malley

TESTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-4857TestUlimit is failing after Hadoop-4620BlockertestSharad AgarwalRavi Gummadi
HADOOP-4728Tests for NameNode -checkpoint option with different configurationsMinor.Boris ShkolnikBoris Shkolnik
HADOOP-4722adding tests for quotas command line error messagesMinortestBoris ShkolnikBoris Shkolnik
HADOOP-4688multiple spills/reducers test case for mergeParts() neededMajor.Yuri PradkinChris Douglas
HADOOP-4505Add a unit test to test faulty setup task and cleanup task killing the jobMajor.Amareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-4458Add a unit test for applications creating symlinks in wokring directoryMajortestAmareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-3192Test behavior of very large (32GB) name nodesMajor.Robert Chansler

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-4612Remove RunJar's dependency on JobClientMajor.Sharad AgarwalSharad Agarwal
HADOOP-4187Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurableMajor.Tom WhiteSharad Agarwal
HADOOP-4185Add setVerifyChecksum() method to FileSystemMajorfsTom WhiteSharad Agarwal

OTHER:

JIRASummaryPriorityComponentReporterContributor