Apache Hadoop Changelog

Release 0.22.0 - 2011-12-10

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7229Absolute path to kinit in auto-renewal threadMajorsecurityAaron T. MyersAaron T. Myers
HADOOP-7137Remove hod contribMajor.Nigel DaleyNigel Daley
HADOOP-7013Add boolean field isCorrupt to BlockLocationMajor.Patrick KlingPatrick Kling
HADOOP-6949Reduces RPC packet size for primitive arrays, especially long[], which is used at block reportingMajorioNavisMatt Foley
HADOOP-6905Better logging messages when a delegation token is invalidMajorsecurityKan ZhangKan Zhang
HADOOP-6835Support concatenated gzip filesMajorioTom WhiteGreg Roelofs
HADOOP-6787Factor out glob pattern code from FileContext and FilesystemMajorfsLuke LuLuke Lu
HADOOP-6730Bug in FileContext#copy and provide base class for FileContext testsMajorfs, testEli CollinsRavi Phulari
HDFS-1825Remove thriftfs contribMajor.Nigel DaleyNigel Daley
HDFS-1560dfs.data.dir permissions should default to 700MinordatanodeTodd LipconTodd Lipcon
HDFS-1435Provide an option to store fsimage compressedMajornamenodeHairong KuangHairong Kuang
HDFS-1315Add fsck event to audit log and remove other audit log events corresponding to FSCK listStatus and open callsMajornamenode, toolsSuresh SrinivasSuresh Srinivas
HDFS-1109HFTP and URL EncodingMajorcontrib/hdfsproxy, datanodeDmytro MolkovDmytro Molkov
HDFS-1080SecondaryNameNode image transfer should use the defined http address rather than local ip addressMajornamenodeJakob HomanJakob Homan
HDFS-1061Memory footprint optimization for INodeFile object.MinornamenodeBharath MundlapudiBharath Mundlapudi
HDFS-903NN should verify images and edit logs on startupCriticalnamenodeEli CollinsHairong Kuang
HDFS-330Datanode Web UIs should provide robots.txtTrivialdatanodeAllen WittenauerAllen Wittenauer
HDFS-202Add a bulk FIleSystem.getFileBlockLocationsMajorhdfs-client, namenodeArun C MurthyHairong Kuang
MAPREDUCE-1905Context.setStatus() and progress() api are ignoredBlockertaskAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1866Remove deprecated class org.apache.hadoop.streaming.UTF8ByteArrayUtilsMinorcontrib/streamingAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1733Authentication between pipes processes and java counterparts.Major.Jitendra Nath PandeyJitendra Nath Pandey
MAPREDUCE-1683Remove JNI calls from ClusterStatus cstrMajorjobtrackerChris DouglasLuke Lu
MAPREDUCE-1664Job Acls affect Queue AclsMajorsecurityRavi GummadiRavi Gummadi

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-6996Allow CodecFactory to return a codec object given a codec' class nameMajorioHairong KuangHairong Kuang
HADOOP-6978Add JNI support for secure IO operationsBlockerio, native, securityTodd LipconTodd Lipcon
HADOOP-6892Common component of HDFS-1150 (Verify datanodes' identities to clients in secure clusters)MajorsecurityJakob HomanJakob Homan
HADOOP-6889Make RPC to have an option to timeoutMajoripcHairong KuangJohn George
HADOOP-6870Add FileSystem#listLocatedStatus to list a directory‘s content together with each file’s block locationsMajorfsHairong KuangHairong Kuang
HADOOP-6832Provide a web server plugin that uses a static user for the web UIMajorsecurityOwen O'MalleyOwen O'Malley
HADOOP-6600mechanism for authorization check for inter-server protocolsMajor.Boris ShkolnikBoris Shkolnik
HADOOP-6586Log authentication and authorization failures and successesMajorsecurityBoris ShkolnikBoris Shkolnik
HADOOP-6472add tokenCache option to GenericOptionsParser for passing file with secret keys to a map reduce jobMajor.Boris ShkolnikBoris Shkolnik
HADOOP-4487Security features for HadoopMajorsecurityKan ZhangKan Zhang
HDFS-1330Make RPCs to DataNodes timeoutMajordatanodeHairong KuangJohn George
HDFS-1318HDFS Namenode and Datanode WebUI information needs to be accessible programmatically for scriptsMajor.Suresh SrinivasTanping Wang
HDFS-1150Verify datanodes' identities to clients in secure clustersMajordatanodeJakob HomanJakob Homan
HDFS-1111getCorruptFiles() should give some hint that the list is not completeMajor.Rodrigo SchmidtSriram Rao
HDFS-1096allow dfsadmin/mradmin refresh of superuser proxy group mappingsMajorsecurityBoris ShkolnikBoris Shkolnik
HDFS-1079HDFS implementation should throw exceptions defined in AbstractFileSystemMajornamenodeSuresh SrinivasSuresh Srinivas
HDFS-1005Fsck securityMajor.Jitendra Nath PandeyBoris Shkolnik
HDFS-1004Update NN to support Kerberized SSL from HADOOP-6584MajornamenodeJakob HomanJakob Homan
HDFS-1003authorization checks for inter-server protocol (based on HADOOP-6600)Major.Boris ShkolnikBoris Shkolnik
HDFS-992Re-factor block access token implementation to conform to the generic Token interface in CommonMajorsecurityKan ZhangKan Zhang
HDFS-811Add metrics, failure reporting and additional tests for HDFS-457MinortestRavi PhulariEli Collins
HDFS-752Add interface classification stable & scope to HDFSMajor.Suresh SrinivasSuresh Srinivas
HDFS-708A stress-test tool for HDFS.Majortest, toolsKonstantin ShvachkoJoshua Harlow
HDFS-528Add ability for safemode to wait for a minimum number of live datanodesMajorscriptsTodd LipconTodd Lipcon
MAPREDUCE-1804Stress-test tool for HDFS introduced in HDFS-708Majorbenchmarks, testKonstantin ShvachkoKonstantin Shvachko
MAPREDUCE-1680Add a metrics to track the number of heartbeats processedMajorjobtrackerHong TangDick King
MAPREDUCE-1594Support for Sleep Jobs in gridmixMajorcontrib/gridmixrahul k singhrahul k singh
MAPREDUCE-1517streaming should support running on backgroundMajorcontrib/streamingBochun BaiBochun Bai
MAPREDUCE-1516JobTracker should issue a delegation token only for kerberos authenticated clientMajor.Jitendra Nath PandeyJitendra Nath Pandey
MAPREDUCE-220Collecting cpu and memory usage for MapReduce tasksMajortask, tasktrackerHong TangScott Chen

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7861changes2html.pl should generate links to HADOOP, HDFS, and MAPREDUCE jirasMajordocumentationKonstantin ShvachkoKonstantin Shvachko
HADOOP-7786Remove HDFS-specific configuration keys defined in FsConfigMajor.Eli CollinsEli Collins
HADOOP-7457Remove out-of-date Chinese language documentationBlockerdocumentationJakob HomanJakob Homan
HADOOP-7358Improve log levels when exceptions caught in RPC handlerMinoripcTodd LipconTodd Lipcon
HADOOP-7355Add audience and stability annotations to HttpServer classMajor.stackstack
HADOOP-7346Send back nicer error to clients using outdated IPC versionMajoripcTodd LipconTodd Lipcon
HADOOP-7335Force entropy to come from non-true random for testsMinorbuild, testTodd LipconTodd Lipcon
HADOOP-7325hadoop command - do not accept class names starting with a hyphenMinorscriptsBrock NolandBrock Noland
HADOOP-7244Documentation change for updated configuration keysBlockerdocumentationTom WhiteTom White
HADOOP-7241fix typo of command ‘hadoop fs -help tail’Minorfs, testWei YongjunWei Yongjun
HADOOP-7193Help message is wrong for touchz command.MinorfsUma Maheswara Rao GUma Maheswara Rao G
HADOOP-7192fs -stat docs aren't updated to reflect the format featuresTrivialdocumentationHarsh JHarsh J
HADOOP-7189Add ability to enable ‘debug’ property in JAAS configurationMinorsecurityTodd LipconTed Yu
HADOOP-7177CodecPool should report which compressor it is usingTrivialnativeAllen WittenauerAllen Wittenauer
HADOOP-7154Should set MALLOC_ARENA_MAX in hadoop-config.shMinorscriptsTodd LipconTodd Lipcon
HADOOP-7134configure files that are generated as part of the released tarball need to have executable bit setMajorbuildRoman ShaposhnikRoman Shaposhnik
HADOOP-7117Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xmlMajorconfPatrick AngelesHarsh J
HADOOP-7110Implement chmod with JNIMajorio, nativeTodd LipconTodd Lipcon
HADOOP-7106Re-organize hadoop subversion layoutBlockerbuildNigel DaleyTodd Lipcon
HADOOP-7054Change NN LoadGenerator to use the new FileContext apiMajor.Sanjay RadiaSanjay Radia
HADOOP-7032Assert type constraints in the FileStatus constructorMajorfsEli CollinsEli Collins
HADOOP-7010Typo in FileSystem.javaMinorfsJingguo YaoJingguo Yao
HADOOP-7009MD5Hash provides a public factory method that creates an instance of MessageDigestMajorioHairong KuangHairong Kuang
HADOOP-7008Enable test-patch.sh to have a configured number of acceptable findbugs and javadoc warningsMajortestNigel DaleyGiridharan Kesavan
HADOOP-7007update the hudson-test-patch target to work with the latest test-patch script.MajorbuildGiridharan KesavanGiridharan Kesavan
HADOOP-7005Update test-patch.sh to remove callback to Hudson masterMajortestNigel DaleyNigel Daley
HADOOP-6987Use JUnit Rule to optionally fail test cases that run more than 10 secondsMajortestJakob HomanJakob Homan
HADOOP-6985Suggest that HADOOP_OPTS be preserved in hadoop-env.sh.templateMinor.Ramkumar VadaliRamkumar Vadali
HADOOP-6977Herriot daemon clients should vend statisticsMajortestKonstantin BoudnikKonstantin Boudnik
HADOOP-6950Suggest that HADOOP_CLASSPATH should be preserved in hadoop-env.sh.templateTrivialscriptsPhilip ZeyligerPhilip Zeyliger
HADOOP-6943The GroupMappingServiceProvider interface should be publicMajorsecurityAaron T. MyersAaron T. Myers
HADOOP-6911doc update for DelegationTokenFetcher (part of HDFS-1036)Minor.Boris Shkolnik
HADOOP-6903Make AbstractFileSystem's methods public to allow filter-Fs like implementions in a differnt package than fsMajor.Sanjay RadiaSanjay Radia
HADOOP-6890Improve listFiles API introduced by HADOOP-6870MajorfsHairong KuangHairong Kuang
HADOOP-6884Add LOG.isDebugEnabled() guard for each LOG.debug(“...”)Major.Erik StefflErik Steffl
HADOOP-6879Provide SSH based (Jsch) remote execution API for system testsMajorbuild, testIyappan SrinivasanKonstantin Boudnik
HADOOP-6877Common part of HDFS-1178MajoripcKan ZhangKan Zhang
HADOOP-6862Add api to add user/group to AccessControlListMajorsecurityAmareshwari SriramadasuAmareshwari Sriramadasu
HADOOP-6861Method in Credentials to read and write a token storage file.Major.Jitendra Nath PandeyJitendra Nath Pandey
HADOOP-6859Introduce additional statistics to FileSystemMajor.Suresh SrinivasSuresh Srinivas
HADOOP-6856SequenceFile and MapFile need cleanup to remove redundant constructorsMajorioOwen O'MalleyOwen O'Malley
HADOOP-6845TokenStorage renamed to Credentials.Major.Jitendra Nath PandeyJitendra Nath Pandey
HADOOP-6825FileStatus needs unit testsMajor.Rodrigo SchmidtRodrigo Schmidt
HADOOP-6818Provide a JNI-based implementation of GroupMappingServiceProviderMajorsecurityDevaraj DasDevaraj Das
HADOOP-6814Method in UGI to get the authentication method of the real user.Major.Jitendra Nath PandeyJitendra Nath Pandey
HADOOP-6811Remove EC2 bash scriptsBlocker.Tom WhiteTom White
HADOOP-6805add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718)Major.Boris ShkolnikBoris Shkolnik
HADOOP-6791Refresh for proxy superuser config (common part for HDFS-1096)Major.Boris ShkolnikBoris Shkolnik
HADOOP-6761Improve Trash EmptierMajor.Dmytro MolkovDmytro Molkov
HADOOP-6745adding some java doc to Server.RpcMetrics, UGIMinoripcBoris ShkolnikBoris Shkolnik
HADOOP-6714FsShell ‘hadoop fs -text’ does not support compression codecsMajor.Patrick AngelesPatrick Angeles
HADOOP-6693Add metrics to track kerberos login activityMajor.Suresh SrinivasSuresh Srinivas
HADOOP-6674Performance Improvement in Secure RPCMajor.Jitendra Nath PandeyJitendra Nath Pandey
HADOOP-6632Support for using different Kerberos keys for different instances of Hadoop servicesMajor.Kan ZhangKan Zhang
HADOOP-6623Add StringUtils.split for non-escaped single-character separatorMinorutilTodd LipconTodd Lipcon
HADOOP-6605Add JAVA_HOME detection to hadoop-configMinor.Chad MetcalfEli Collins
HADOOP-6599Split RPC metrics into summary and detailed metricsMajor.Suresh SrinivasSuresh Srinivas
HADOOP-6584Provide Kerberized SSL encryption for webservicesMajor.Jakob HomanJakob Homan
HADOOP-6578Configuration should trim whitespace around a lot of value typesMinorconfTodd LipconMichele Catasta
HADOOP-6562FileContextSymlinkBaseTest should use FileContextTestHelperMinortestEli CollinsEli Collins
HADOOP-6436Remove auto-generated native build filesMajor.Eli CollinsRoman Shaposhnik
HADOOP-6298BytesWritable#getBytes is a bad name that leads to programming mistakesMajor.Nathan MarzOwen O'Malley
HADOOP-6056Use java.net.preferIPv4Stack to force IPv4MajorscriptsSteve LoughranMichele Catasta
HADOOP-4675Current Ganglia metrics implementation is incompatible with Ganglia 3.1MajormetricsBrian BockelmanBrian Bockelman
HDFS-2286DataXceiverServer logs AsynchronousCloseException at shutdownTrivialdatanodeTodd LipconTodd Lipcon
HDFS-2054BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully()MinordatanodeKihwal LeeKihwal Lee
HDFS-2039TestNameNodeMetrics uses a bad test root pathMajor.Todd LipconTodd Lipcon
HDFS-1980Move build/webapps deeper in directory heirarchy to aid eclipse usersMajorbuildTodd LipconTodd Lipcon
HDFS-1957Documentation for HFTPMinordocumentationAri RabkinAri Rabkin
HDFS-1954Improve corrupt files warning message on NameNode web UIMajornamenodephilo viveroPatrick Hunt
HDFS-1947DFSClient should use mapreduce.task.attempt.idTrivialhdfs-clientEli CollinsEli Collins
HDFS-1935Build should not redownload ivy on every invocationMinorbuildTodd LipconJoep Rottinghuis
HDFS-1866Document dfs.datanode.max.transfer.threads in hdfs-default.xmlMinordatanode, documentationEli CollinsHarsh J
HDFS-1861Rename dfs.datanode.max.xcievers and bump its default valueMajordatanodeEli CollinsEli Collins
HDFS-1736Break dependency between DatanodeJspHelper and FsShellMinordatanodeDaryn SharpDaryn Sharp
HDFS-1619Remove AC_TYPE* from the libhdfsMajorlibhdfsRoman ShaposhnikRoman Shaposhnik
HDFS-1618configure files that are generated as part of the released tarball need to have executable bit setMajorbuildRoman ShaposhnikRoman Shaposhnik
HDFS-1596Move secondary namenode checkpoint configs from core-default.xml to hdfs-default.xmlMajordocumentation, namenodePatrick AngelesHarsh J
HDFS-1582Remove auto-generated native build filesMajorlibhdfsRoman ShaposhnikRoman Shaposhnik
HDFS-1513Fix a number of warningsMinor.Eli CollinsEli Collins
HDFS-1491Update Hdfs to match the change of methods from protected to public in AbstractFileSystem (Hadoop-6903)Major.Sanjay RadiaSanjay Radia
HDFS-1485Typo in BlockPlacementPolicy.javaMinor.Jingguo YaoJingguo Yao
HDFS-1472Refactor DFSck to allow programmatic access to outputMajortoolsRamkumar VadaliRamkumar Vadali
HDFS-1457Limit transmission rate when transfering image between primary and secondary NNsMajornamenodeHairong KuangHairong Kuang
HDFS-1456Provide builder for constructing instances of MiniDFSClusterMajortestJakob HomanJakob Homan
HDFS-1454Update the documentation to reflect true client caching strategyMajordocumentation, hdfs-clientJeff HammerbacherHarsh J
HDFS-1434Refactor Datanode#startDataNode methodMajordatanodeSuresh SrinivasSuresh Srinivas
HDFS-1426Remove unused method BlockInfo#listCountMajornamenodeHairong KuangHairong Kuang
HDFS-1417Add @Override annotation to SimulatedFSDataset methods that implement FSDatasetInterfaceMajor.Suresh SrinivasSuresh Srinivas
HDFS-1408Herriot NN and DN clients should vend statisticsMajortestAl ThompsonKonstantin Boudnik
HDFS-1407Use Block in DataTransferProtocolMajor.Suresh SrinivasSuresh Srinivas
HDFS-1395Add @Override annotation to FSDataset methods that implement FSDatasetInterfaceMajordatanodeSuresh SrinivasSuresh Srinivas
HDFS-1387Update HDFS permissions guide for securityMajordocumentation, securityTodd LipconTodd Lipcon
HDFS-1383Better error messages on hftpMajor.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1369Invalid javadoc reference in FSDatasetMBean.javaTrivialdatanodeEli CollinsEli Collins
HDFS-1368Add a block counter to DatanodeDescriptorMajornamenodeHairong KuangHairong Kuang
HDFS-1356Provide information as to whether or not security is enabled on web interface for NameNode (part of HADOOP-6822)Major.Boris ShkolnikBoris Shkolnik
HDFS-1353Remove most of getBlockLocation optimizationMajornamenodeJakob HomanJakob Homan
HDFS-1320Add LOG.isDebugEnabled() guard for each LOG.debug(“...”)Major.Erik StefflErik Steffl
HDFS-1307Add start time, end time and total time taken for FSCK to FSCK reportMajornamenode, toolsSuresh SrinivasSuresh Srinivas
HDFS-1304There is no unit test for HftpFileSystem.open(..)MajortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1302Use writeTokenStorageToStream method in Credentials to store credentials to a file.Major.Jitendra Nath PandeyJitendra Nath Pandey
HDFS-1298Add support in HDFS to update statistics that tracks number of file system operations in FileSystemMajor.Suresh SrinivasSuresh Srinivas
HDFS-1297Fix some commentsTrivialdocumentationJeff AmesJeff Ames
HDFS-1272HDFS changes corresponding to rename of TokenStorage to CredentialsMajor.Jitendra Nath PandeyJitendra Nath Pandey
HDFS-1205FSDatasetAsyncDiskService should name its threadsMajordatanodeTodd LipconTodd Lipcon
HDFS-1203DataNode should sleep before reentering service loop after an exceptionMajordatanodeTodd LipconTodd Lipcon
HDFS-1201Support for using different Kerberos keys for Namenode and datanode.Major.Jitendra Nath PandeyKan Zhang
HDFS-1190Remove unused getNamenode() method from DataNode.MinordatanodeJeff AmesJeff Ames
HDFS-1187Modify fetchdt to allow renewing and canceling tokenMajorsecurityOwen O'MalleyOwen O'Malley
HDFS-1185Remove duplicate now() functions in DataNode, FSNamesystemMinordatanode, namenodeJeff AmesJeff Ames
HDFS-1184Replace tabs in code with spacesMinor.Jeff AmesJeff Ames
HDFS-1183Remove some duplicate code in NamenodeJspHelper.javaMinornamenodeJeff AmesJeff Ames
HDFS-1178The NameNode servlets should not use RPC to connect to the NameNodeMajornamenodeOwen O'MalleyOwen O'Malley
HDFS-1160Improve some FSDataset warnings and commentsMajordatanodeEli CollinsEli Collins
HDFS-1140Speedup INode.getPathComponentsMinornamenodeDmytro MolkovDmytro Molkov
HDFS-1114Reducing NameNode memory usage by an alternate hash tableMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1110Namenode heap optimization - reuse objects for commonly used file namesMajor.Suresh SrinivasSuresh Srinivas
HDFS-1093Improve namenode scalability by splitting the FSNamesystem synchronized section in a read/write lockMajornamenodedhruba borthakurdhruba borthakur
HDFS-1081Performance regression in DistributedFileSystem::getFileBlockLocations in secure systemsMajorsecurityJakob HomanJakob Homan
HDFS-1055Improve thread naming for DataXceiversMajordatanodeTodd LipconTodd Lipcon
HDFS-1035Generate Eclipse's .classpath file from Ivy configMajorbuildTom WhiteNigel Daley
HDFS-1033In secure clusters, NN and SNN should verify that the remote principal during image and edits transferMajornamenode, securityJakob HomanJakob Homan
HDFS-1028INode.getPathNames could split more efficientlyMinornamenodeTodd LipconDmytro Molkov
HDFS-1023Allow http server to start as regular principal if https principal not defined.MajornamenodeJakob HomanJakob Homan
HDFS-947The namenode should redirect a hftp request to read a file to the datanode that has the maximum number of local replicasMajor.dhruba borthakurDmytro Molkov
HDFS-941Datanode xceiver protocol should allow reuse of a connectionMajordatanode, hdfs-client, performanceTodd Lipconbc Wong
HDFS-895Allow hflush/sync to occur in parallel with new writes to the fileMajorhdfs-clientdhruba borthakurTodd Lipcon
HDFS-884DataNode makeInstance should report the directory list when failing to start upMinordatanodeSteve LoughranSteve Loughran
HDFS-882Datanode could log what hostname and ports its listening on on startupMinordatanodeSteve LoughranSteve Loughran
HDFS-881Refactor DataNode Packet header into DataTransferProtocolMajor.Todd LipconTodd Lipcon
HDFS-853The HDFS webUI should show a metric that summarizes whether the cluster is balanced regarding disk space usageMajornamenodedhruba borthakurDmytro Molkov
HDFS-718configuration parameter to prevent accidental formatting of HDFS filesystemMinornamenodeAndrew RyanAndrew Ryan
HDFS-599Improve Namenode robustness by prioritizing datanode heartbeats over client requestsMajornamenodedhruba borthakurDmytro Molkov
HDFS-556Provide info on failed volumes in the web uiMajornamenodeJakob HomanEli Collins
HDFS-455Make NN and DN handle in a intuitive way comma-separated configuration stringsMinordatanode, namenodeMichele CatastaMichele Catasta
MAPREDUCE-2505Explain how to use ACLs in the fair schedulerMinorcontrib/fair-share, documentationMatei ZahariaMatei Zaharia
MAPREDUCE-2502JobSubmitter should use mapreduce.job.mapsTrivialjob submissionEli CollinsEli Collins
MAPREDUCE-2410document multiple keys per reducer oddity in hadoop streaming FAQMinorcontrib/streaming, documentationDieter PlaetinckHarsh J
MAPREDUCE-2372TaskLogAppender mechanism shouldn't be set in log4j.propertiesMajortaskTodd LipconTodd Lipcon
MAPREDUCE-2337Remove dependence of public MapReduce API on classes in server packageMajor.Tom WhiteTom White
MAPREDUCE-2314configure files that are generated as part of the released tarball need to have executable bit setMajorbuildRoman ShaposhnikRoman Shaposhnik
MAPREDUCE-2260Remove auto-generated native build filesMajorbuildRoman ShaposhnikRoman Shaposhnik
MAPREDUCE-2184Port DistRaid.java to new mapreduce APIMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-2167Faster directory traversal for raid nodeMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-2150RaidNode should periodically fix corrupt blocksMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-2147JobInProgress has some redundant lines in its ctorTrivialjobtrackerHarsh JHarsh J
MAPREDUCE-2145upgrade clover on the builds servers to v 3.0.2Major.Giridharan KesavanGiridharan Kesavan
MAPREDUCE-2141Add an “extra data” field to Task for use by MesosMinor.Matei ZahariaMatei Zaharia
MAPREDUCE-2140Re-generate fair scheduler design doc PDFTrivial.Matei ZahariaMatei Zaharia
MAPREDUCE-2132Need a command line option in RaidShell to fix blocks using raidMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-2126JobQueueJobInProgressListener's javadoc is inconsistent with source codeMinorjobtrackerJingguo YaoJingguo Yao
MAPREDUCE-2103task-controller shouldn't require o-r permissionsTrivialtask-controllerTodd LipconTodd Lipcon
MAPREDUCE-2093Herriot JT and TT clients should vend statisticsMajortestKonstantin BoudnikKonstantin Boudnik
MAPREDUCE-2046A CombineFileInputSplit cannot be less than a dfs blockMajor.Namit Jaindhruba borthakur
MAPREDUCE-2026JobTracker.getJobCounters() should not hold JobTracker lock while calling JobInProgress.getCounters()Major.Scott ChenJoydeep Sen Sarma
MAPREDUCE-1945Support for using different Kerberos keys for Jobtracker and TaskTrackersMajor.Kan ZhangKan Zhang
MAPREDUCE-1936[gridmix3] Make Gridmix3 more customizable.Majorcontrib/gridmixHong TangHong Tang
MAPREDUCE-1935HFTP needs to be updated to use delegation tokens (from HDFS-1007)Major.Boris ShkolnikBoris Shkolnik
MAPREDUCE-1931Gridmix forrest documentationMajorcontrib/gridmixrahul k singhRanjit Mathew
MAPREDUCE-1918Add documentation to RumenMajortools/rumenAmar KamatAmar Kamat
MAPREDUCE-1893Multiple reducers for SliveMajorbenchmarks, testKonstantin ShvachkoKonstantin Shvachko
MAPREDUCE-1892RaidNode can allow layered policies more efficientlyMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-1878Add MRUnit documentationMajorcontrib/mrunitAaron KimballAaron Kimball
MAPREDUCE-1868Add read timeout on userlog pullMajorclientKrishna RamachandranKrishna Ramachandran
MAPREDUCE-1851Document configuration parameters in streamingMajorcontrib/streaming, documentationAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1850Include job submit host information (name and ip) in jobconf and jobdetails displayMajor.Krishna RamachandranKrishna Ramachandran
MAPREDUCE-1848Put number of speculative, data local, rack local tasks in JobTracker metricsMajorjobtrackerScott ChenScott Chen
MAPREDUCE-1840[Gridmix] Exploit/Add security features in GridMixMajorcontrib/gridmixAmar KamatAmar Kamat
MAPREDUCE-1838DistRaid map tasks have large variance in running timesMinorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-1832Support for file sizes less than 1MB in DFSIO benchmark.MajorbenchmarksKonstantin ShvachkoKonstantin Shvachko
MAPREDUCE-1829JobInProgress.findSpeculativeTask should use min() to find the candidate instead of sort()MajorjobtrackerScott ChenScott Chen
MAPREDUCE-1819RaidNode should be smarter in submitting Raid jobsMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-1818RaidNode should specify a pool name incase the cluster is using FairSchedulerMinorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-1816HAR files used for RAID parity need to have configurable partfile sizeMinorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-1798normalize property names for JT kerberos principal names in configuration (from HADOOP 6633)Major.Boris ShkolnikBoris Shkolnik
MAPREDUCE-1785Add streaming config option for not emitting the keyMinorcontrib/streamingEli CollinsEli Collins
MAPREDUCE-1783Task Initialization should be delayed till when a job can be runMajorcontrib/fair-shareRamkumar VadaliRamkumar Vadali
MAPREDUCE-1778CompletedJobStatusStore initialization should fail if {mapred.job.tracker.persist.jobstatus.dir} is unwritableMajorjobtrackerAmar KamatKrishna Ramachandran
MAPREDUCE-1762Add a setValue() method in CounterMajor.Scott ChenScott Chen
MAPREDUCE-1761FairScheduler should allow separate configuration of node and rack locality wait timeMajor.Scott ChenScott Chen
MAPREDUCE-1711Gridmix should provide an option to submit jobs to the same queues as specified in the trace.Majorcontrib/gridmixHong Tangrahul k singh
MAPREDUCE-1626Publish Javadoc for all contrib packages with user-facing APIsMajordocumentationTom WhiteJolly Chen
MAPREDUCE-1592Generate Eclipse's .classpath file from Ivy configMajorbuildTom WhiteTom White
MAPREDUCE-1548Hadoop archives should be able to preserve times and other properties from original filesMajorharchiveRodrigo SchmidtRodrigo Schmidt
MAPREDUCE-1546Jobtracker JSP pages should automatically redirect to the corresponding history page if not in memoryMinor.Scott ChenScott Chen
MAPREDUCE-1545Add ‘first-task-launched’ to job-summaryMajorjobtrackerArun C MurthyLuke Lu
MAPREDUCE-1526Cache the job related information while submitting the job , this would avoid many RPC calls to JobTracker.Majorcontrib/gridmixrahul k singhrahul k singh
MAPREDUCE-1492Delete or recreate obsolete har files used on hdfs raidMajorcontrib/raidRodrigo SchmidtRodrigo Schmidt
MAPREDUCE-1382MRAsyncDiscService should tolerate missing local.dirMajor.Scott ChenZheng Shao
MAPREDUCE-1376Support for varied user submission in GridmixMajorcontrib/gridmixChris DouglasChris Douglas
MAPREDUCE-1354Incremental enhancements to the JobTracker for better scalabilityCriticaljobtrackerDevaraj DasDick King
MAPREDUCE-1253Making Mumak work with Capacity-SchedulerMajorcontrib/mumakAnirban DasguptaAnirban Dasgupta
MAPREDUCE-1248Redundant memory copying in StreamKeyValUtilMinorcontrib/streamingRuibang HeRuibang He
MAPREDUCE-1159Limit Job name on jobtracker.jsp to be 80 char longTrivial.Zheng ShaoHarsh J
MAPREDUCE-478separate jvm param for mapper and reducerMinor.Koji NoguchiArun C Murthy

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7697Remove dependency on different version of slf4j in avroMajorbuildKonstantin ShvachkoKonstantin Shvachko
HADOOP-7663TestHDFSTrash failing on 22MajortestMayank BansalMayank Bansal
HADOOP-7646Make hadoop-common use same version of avro as HBaseMajorio, ipcJoep RottinghuisJoep Rottinghuis
HADOOP-7577TT does not start due to backwards compatibility wrt. EventCounterMinormetricsJoep RottinghuisJoep Rottinghuis
HADOOP-7568SequenceFile should not print into stdoutMajorioKonstantin ShvachkoPlamen Jeliazkov
HADOOP-7514Build fails with ClassCastException when running both mvn-install and mvn-deploy targetsMinorbuildJoep RottinghuisJoep Rottinghuis
HADOOP-7513mvn-deploy target failsMajorbuildJoep RottinghuisJoep Rottinghuis
HADOOP-7450Bump jetty to 6.1.26BlockerbuildJitendra Nath PandeyKonstantin Boudnik
HADOOP-7390VersionInfo not generated properly in git after unsplitMinorbuildThomas GravesTodd Lipcon
HADOOP-7351Regression: HttpServer#getWebAppsPath used to be protected so subclasses could supply alternate webapps path but it was made private by HADOOP-6461Major.stackstack
HADOOP-7349HADOOP-7121 accidentally disabled some testsMajoripc, testTodd LipconTodd Lipcon
HADOOP-7318MD5Hash factory should reset the digester it returnsCriticalioTodd LipconTodd Lipcon
HADOOP-7312core-default.xml lists configuration version as 0.21MinorconfTodd LipconHarsh J
HADOOP-7302webinterface.private.actions should not be in commonMajordocumentationAri RabkinAri Rabkin
HADOOP-7300Configuration methods that return collections are inconsistent about mutabilityMajorconfTodd LipconTodd Lipcon
HADOOP-7296The FsPermission(FsPermission) constructor does not use the sticky bitMinorfsSiddharth SethSiddharth Seth
HADOOP-7287Configuration deprecation mechanism doesn't work properly for GenericOptionsParser/ToolsBlockerconfTodd LipconAaron T. Myers
HADOOP-7252JUnit shows up as a compile time dependencyMinorbuild, conf, testPonyHarsh J
HADOOP-7245FsConfig should use constants in CommonConfigurationKeysMajor.Tom WhiteTom White
HADOOP-7194Potential Resource leak in IOUtils.javaMajorioDevaraj KDevaraj K
HADOOP-7187Socket Leak in org.apache.hadoop.metrics.ganglia.GangliaContextMajormetricsUma Maheswara Rao GUma Maheswara Rao G
HADOOP-7184Remove deprecated local.cache.size from core-default.xmlMajordocumentation, filecacheTodd LipconTodd Lipcon
HADOOP-7183WritableComparator.get should not cache comparator objectsBlocker.Todd LipconTom White
HADOOP-7174null is displayed in the console,if the src path is invalid while doing copyToLocal operation from commandLineMinorfsUma Maheswara Rao GUma Maheswara Rao G
HADOOP-7172SecureIO should not check owner on non-secure clusters that have no native supportCriticalio, securityTodd LipconTodd Lipcon
HADOOP-7162FsShell: call srcFs.listStatus(src) twiceMinorfsAlexey DiominAlexey Diomin
HADOOP-7156getpwuid_r is not thread-safe on RHEL6Critical.Todd LipconTodd Lipcon
HADOOP-7146RPC server leaks file descriptorsMajor.Todd LipconTodd Lipcon
HADOOP-7145Configuration.getLocalPath should trim whitespace from the provided directoriesMajor.Todd LipconTodd Lipcon
HADOOP-7140IPC Reader threads do not stop when server stopsCritical.Todd LipconTodd Lipcon
HADOOP-7126TestDFSShell fails in trunkMajor.Po CheungPo Cheung
HADOOP-7122Timed out shell commands leak Timer threadsCriticalutilTodd LipconTodd Lipcon
HADOOP-7121Exceptions while serializing IPC call response are not handled wellCriticalipcTodd LipconTodd Lipcon
HADOOP-7120200 new Findbugs warningsMajortestTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-7118NPE in Configuration.writeXmlBlocker.Todd LipconTodd Lipcon
HADOOP-7104Remove unnecessary DNS reverse lookups from RPC layerMajoripc, securityKan ZhangKan Zhang
HADOOP-7102Remove “fs.ramfs.impl” field from core-deafult.xmlMajorconfKonstantin ShvachkoKonstantin Shvachko
HADOOP-7100Build broken by HADOOP-6811Blockerbuild, contrib/cloudTodd LipconTodd Lipcon
HADOOP-7097java.library.path missing basedirBlockerbuild, nativeNoah WatkinsNoah Watkins
HADOOP-7094hadoop.css got lost during project splitBlockerbuildTodd LipconKonstantin Boudnik
HADOOP-7093Servlets should default to text/plainMajorioTodd LipconTodd Lipcon
HADOOP-7091reloginFromKeytab() should happen even if TGT can't be foundMajorsecurityKan ZhangKan Zhang
HADOOP-7089Fix link resolution logic in hadoop-config.shMinorscriptsEli CollinsEli Collins
HADOOP-7087SequenceFile.createWriter ignores FileSystem parameterBlockerioTodd LipconTodd Lipcon
HADOOP-7082Configuration.writeXML should not hold lock while outputtingCriticalconfTodd LipconTodd Lipcon
HADOOP-7070JAAS configuration should delegate unknown application names to pre-existing configurationCriticalsecurityTodd LipconTodd Lipcon
HADOOP-7068Ivy resolve force mode should be turned off by defaultMajor.Luke LuLuke Lu
HADOOP-7057IOUtils.readFully and IOUtils.skipFully have typo in exception creation's messageMinorutilKonstantin BoudnikKonstantin Boudnik
HADOOP-7053wrong FSNamesystem Audit logging setting in conf/log4j.propertiesMinorconfJingguo YaoJingguo Yao
HADOOP-7052misspelling of threshold in conf/log4j.propertiesMajorconfJingguo YaoJingguo Yao
HADOOP-70461 Findbugs warning on trunk and branch-0.22BlockersecurityNigel DaleyPo Cheung
HADOOP-7038saveVersion script includes an additional \r while running whoami under windowsMinorbuildWang XuWang Xu
HADOOP-7028ant eclipse does not include requisite ant.jar in the classpathMinorbuildPatrick AngelesPatrick Angeles
HADOOP-7011KerberosName.main(...) throws NPEMajor.Aaron T. MyersAaron T. Myers
HADOOP-7006hadoop fs -getmerge does not work using codebase from trunk.MajorfsChris NaurothChris Nauroth
HADOOP-6993Broken link on cluster setup page of docsMajordocumentationAaron T. MyersEli Collins
HADOOP-6991SequenceFile::Reader discards length for files, does not call openFileMinor.Chris DouglasChris Douglas
HADOOP-6989TestSetFile is failing on trunkMajor.Jakob HomanChris Douglas
HADOOP-6984NPE from SequenceFile::Writer.CompressionCodecOptionMinorioChris DouglasChris Douglas
HADOOP-6975integer overflow in S3InputStream for blocks > 2GBMajor.Patrick KlingPatrick Kling
HADOOP-6970SecurityAuth.audit should be generated under /buildMajorbuildKonstantin ShvachkoBoris Shkolnik
HADOOP-6965Method in UGI to get Kerberos ticket.Major.Jitendra Nath PandeyJitendra Nath Pandey
HADOOP-6951Distinct minicluster services (e.g. NN and JT) overwrite each other's service policiesMajorsecurityAaron T. MyersAaron T. Myers
HADOOP-6947Kerberos relogin should set refreshKrb5Config to trueMajorsecurityTodd LipconTodd Lipcon
HADOOP-6940RawLocalFileSystem's markSupported method misnamed markSupportMinorfsTom WhiteTom White
HADOOP-6938ConnectionId.getRemotePrincipal() should check if security is enabledMajoripc, securityKan ZhangKan Zhang
HADOOP-6933TestListFiles is flakyMinortestTodd LipconTodd Lipcon
HADOOP-6932Namenode start (init) fails because of invalid kerberos key, even when security set to “simple”Major.Boris ShkolnikBoris Shkolnik
HADOOP-6930AvroRpcEngine doesn't work with generated Avro codeMajoripcSharad AgarwalSharad Agarwal
HADOOP-6926SocketInputStream incorrectly implements read()MinorioTodd LipconTodd Lipcon
HADOOP-6925BZip2Codec incorrectly implements read()CriticalioTodd LipconTodd Lipcon
HADOOP-6922COMMON part of MAPREDUCE-1664Majordocumentation, securityRavi GummadiRavi Gummadi
HADOOP-6913Circular initialization between UserGroupInformation and KerberosNameMajorsecurityKan ZhangKan Zhang
HADOOP-6907Rpc client doesn‘t use the per-connection conf to figure out server’s Kerberos principalMajoripc, securityKan ZhangKan Zhang
HADOOP-6906FileContext copy() utility doesn't work with recursive copying of directories.MajorfsVinod Kumar VavilapalliVinod Kumar Vavilapalli
HADOOP-6900FileSystem#listLocatedStatus should not throw generic RuntimeException to indicate error conditionsMajor.Suresh SrinivasHairong Kuang
HADOOP-6899RawLocalFileSystem#setWorkingDir() does not work for relative namesMajorfsSanjay RadiaSanjay Radia
HADOOP-6898FileSystem.copyToLocal creates files with 777 permissionsBlockerfs, securityTodd LipconAaron T. Myers
HADOOP-6888Being able to close all cached FileSystem objects for a given UGIMajorfs, securityKan ZhangKan Zhang
HADOOP-6885Fix java doc warnings in Groups and RefreshUserMappingsProtocolMajorsecurityEli CollinsEli Collins
HADOOP-6873using delegation token over hftp for long running clients (part of hdfs 1296)Major.Boris ShkolnikBoris Shkolnik
HADOOP-6853Common component of HDFS-1045Major.Jakob HomanJakob Homan
HADOOP-6834TFile.append compares initial key against null lastKeyMajorioAhad RanaHong Tang
HADOOP-6833IPC leaks call parameters when exceptions thrownBlocker.Todd LipconTodd Lipcon
HADOOP-6815refreshSuperUserGroupsConfiguration should use server side configuration for the refreshMajor.Boris ShkolnikBoris Shkolnik
HADOOP-6812fs.inmemory.size.mb not listed in conf. Cluster setup page gives wrong advice.MajordocumentationEdward CaprioloChris Douglas
HADOOP-6781security audit log shouldn't have exception in it.Major.Boris ShkolnikBoris Shkolnik
HADOOP-6778add isRunning() method to AbstractDelegationTokenSecretManager (for HDFS-1044)Major.Boris ShkolnikBoris Shkolnik
HADOOP-6763Remove verbose logging from the Groups classMajor.Owen O'MalleyBoris Shkolnik
HADOOP-6758MapFile.fix does not allow index interval definitionMajor.Gianmarco De Francisci MoralesGianmarco De Francisci Morales
HADOOP-6756Clean up and add documentation for configuration keys in CommonConfigurationKeys.javaMajorfsErik StefflErik Steffl
HADOOP-6747TestNetUtils fails on Mac OS XMajor.Luke LuTodd Lipcon
HADOOP-6724IPC doesn't properly handle IOEs thrown by socket factoryMajoripcTodd LipconTodd Lipcon
HADOOP-6715AccessControlList.toString() returns empty string when we set acl to “*”Majorsecurity, utilRavi GummadiRavi Gummadi
HADOOP-6706Relogin behavior for RPC clients could be improvedMajorsecurityDevaraj DasDevaraj Das
HADOOP-6702Incorrect exit codes for “dfs -chown”, “dfs -chgrp” when input is given in wildcard format.MinorfsRavi PhulariRavi Phulari
HADOOP-6682NetUtils:normalizeHostName does not process hostnames starting with [a-f] correctlyMajorioJakob HomanJakob Homan
HADOOP-6670UserGroupInformation doesn't support use in hash tablesMajorsecurityOwen O'MalleyOwen O'Malley
HADOOP-6669zlib.compress.level ignored for DefaultCodec initializationMinorioKoji NoguchiKoji Noguchi
HADOOP-6663BlockDecompressorStream get EOF exception when decompressing the file compressed from empty fileMajorioKang XiaoKang Xiao
HADOOP-6656Security framework needs to renew Kerberos tickets while the process is runningMajor.Owen O'MalleyDevaraj Das
HADOOP-6652ShellBasedUnixGroupsMapping shouldn't have a cacheMajor.Devaraj DasDevaraj Das
HADOOP-6648Credentials should ignore null tokensMajorsecurityOwen O'MalleyDevaraj Das
HADOOP-6642Fix javac, javadoc, findbugs warningsMajor.Arun C MurthyPo Cheung
HADOOP-6620NPE if renewer is passed as null in getDelegationTokenMajor.Jitendra Nath PandeyJitendra Nath Pandey
HADOOP-6613RPC server should check for version mismatch firstMajoripc, securityKan ZhangKan Zhang
HADOOP-6612Protocols RefreshUserToGroupMappingsProtocol and RefreshAuthorizationPolicyProtocol will fail with security enabledMajorsecurityBoris ShkolnikBoris Shkolnik
HADOOP-6536FileUtil.fullyDelete(dir) behavior is not defined when we pass a symlink as the argumentMajorfsAmareshwari SriramadasuRavi Gummadi
HADOOP-6496HttpServer sends wrong content-type for CSS files (and others)Minor.Lars FranckeIvan Mitic
HADOOP-6482GenericOptionsParser constructor that takes Options and String[] ignores optionsMinorutilChris WilkesEli Collins
HADOOP-6404Rename the generated artifacts to common instead of coreBlockerbuildOwen O'MalleyTom White
HADOOP-6344rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.Majorfsgary murryJakob Homan
HDFS-2573TestFiDataXceiverServer is failing, not testing OOMEMajordatanode, testKonstantin ShvachkoKonstantin Boudnik
HDFS-2514Link resolution bug for intermediate symlinks with relative targetsMajornamenodeEli CollinsEli Collins
HDFS-2491TestBalancer can fail when datanode utilization and avgUtilization is exactly same.Major.Uma Maheswara Rao GUma Maheswara Rao G
HDFS-2452OutOfMemoryError in DataXceiverServer takes down the DataNodeMajordatanodeKonstantin ShvachkoUma Maheswara Rao G
HDFS-2388Remove dependency on different version of slf4j in avroMajorbuildKonstantin ShvachkoKonstantin Shvachko
HDFS-2383TestDfsOverAvroRpc is failing on 0.22BlockertestKonstantin ShvachkoKonstantin Shvachko
HDFS-2346TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methodsBlockertestUma Maheswara Rao GLaxman
HDFS-2343Make hdfs use same version of avro as HBaseBlockerhdfs-clientJoep RottinghuisJoep Rottinghuis
HDFS-2341Contribs not buildingBlockerbuildJoep RottinghuisJoep Rottinghuis
HDFS-2315Build fails with ant 1.7.0 but works with 1.8.0BlockerbuildJoep RottinghuisJoep Rottinghuis
HDFS-2297FindBugs OutOfMemoryErrorBlockerbuildJoep RottinghuisJoep Rottinghuis
HDFS-2290Block with corrupt replica is not getting replicatedMajornamenodeKonstantin ShvachkoBenoy Antony
HDFS-2287TestParallelRead has a small off-by-one bugTrivialtestTodd LipconTodd Lipcon
HDFS-2281NPE in checkpoint during processIOError()MajornamenodeKonstantin ShvachkoUma Maheswara Rao G
HDFS-2280BackupNode fails with MD5 checksum Exception during checkpoint if BN's image is outdated.MajornamenodeKonstantin ShvachkoKonstantin Shvachko
HDFS-2271startJournalSpool should invoke ProcessIOError with failed storage directories if createEditLogFile throws any exception.MajornamenodeUma Maheswara Rao GUma Maheswara Rao G
HDFS-2258TestLeaseRecovery2 fails as lease hard limit is not reset to defaultMajornamenode, testKonstantin ShvachkoKonstantin Shvachko
HDFS-2232TestHDFSCLI fails on 0.22 branchBlockertestKonstantin ShvachkoPlamen Jeliazkov
HDFS-2214Generated POMs hardcode dependency on hadoop-common version 0.22.0-SNAPSHOTMajorbuildJoep RottinghuisJoep Rottinghuis
HDFS-2211Build does not pass along properties to contrib buildsBlockerbuildJoep RottinghuisJoep Rottinghuis
HDFS-2189guava-r09 dependency missing from “ivy/hadoop-hdfs-template.xml” in HDFS.Blocker.Plamen JeliazkovJoep Rottinghuis
HDFS-2071Use of isConnected() in DataXceiver is invalidMinordatanodeKihwal LeeKihwal Lee
HDFS-2012Recurring failure of TestBalancer due to incorrect treatment of nodes whose utilization equals avgUtilization.Blockerbalancer & mover, testAaron T. MyersUma Maheswara Rao G
HDFS-2002Incorrect computation of needed blocks in getTurnOffTip()MajornamenodeKonstantin ShvachkoPlamen Jeliazkov
HDFS-2000Missing deprecation for io.bytes.per.checksumMajor.Aaron T. MyersAaron T. Myers
HDFS-1981When namenode goes down while checkpointing and if is started again subsequent Checkpointing is always failingBlockernamenoderamkrishna.s.vasudevanUma Maheswara Rao G
HDFS-1978All but first option in LIBHDFS_OPTS is ignoredMajorlibhdfsBrock NolandEli Collins
HDFS-1969Running rollback on new-version namenode destroys namespaceBlockernamenodeTodd LipconTodd Lipcon
HDFS-1965IPCs done using block token-based tickets can't reuse connectionsCriticalsecurityTodd LipconTodd Lipcon
HDFS-1964Incorrect HTML unescaping in DatanodeJspHelper.javaMajor.Aaron T. MyersAaron T. Myers
HDFS-1952FSEditLog.open() appears to succeed even if all EDITS directories failMajor.Matt FoleyAndrew
HDFS-1943fail to start datanode while start-dfs.sh is executed by root userBlockerscriptsWei YongjunMatt Foley
HDFS-1936Updating the layout version from HDFS-1822 causes upgrade problems.BlockernamenodeSuresh SrinivasSuresh Srinivas
HDFS-1932Ensure that HDFS configuration deprecations are set up in every spot that HDFS configurations are loaded.Critical.Todd LipconJolly Chen
HDFS-1925SafeModeInfo should use DFS_NAMENODE_SAFEMODE_THRESHOLD_PCT_DEFAULT instead of 0.95Major.Konstantin ShvachkoJoey Echeverria
HDFS-1921Save namespace can cause NN to be unable to come up on restartBlocker.Aaron T. MyersMatt Foley
HDFS-1909TestHDFSCLI fails due to typo in expected outputMajor.Tom WhiteTom White
HDFS-1897Documention refers to removed option dfs.network.scriptMinordocumentationAri RabkinAndrew Whang
HDFS-1891TestBackupNode fails intermittentlyMajortestSuresh SrinivasSuresh Srinivas
HDFS-1850DN should transmit absolute failed volume count rather than increments to the NNMajordatanode, namenodeEli CollinsEli Collins
HDFS-1845symlink comes up as directory after namenode restartMajor.John GeorgeJohn George
HDFS-1823start-dfs.sh script fails if HADOOP_HOME is not setBlockerscriptsTom WhiteTom White
HDFS-1822Editlog opcodes overlap between 20 security and later releasesBlockernamenodeSuresh SrinivasSuresh Srinivas
HDFS-1821FileContext.createSymlink with kerberos enabled sets wrong ownerMajor.John GeorgeJohn George
HDFS-1806TestBlockReport.blockReport_08() and _09() are timing-dependent and likely to fail on fast serversMajordatanode, namenodeMatt FoleyMatt Foley
HDFS-1786Some cli test cases expect a “null” messageMinortestTsz Wo Nicholas SzeUma Maheswara Rao G
HDFS-1782FSNamesystem.startFileInternal(..) throws NullPointerExceptionMajornamenodeJohn GeorgeJohn George
HDFS-1781jsvc executable delivered into wrong package...MajorscriptsJohn GeorgeJohn George
HDFS-1750fs -ls hftp://file not workingMajor.Tsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1728SecondaryNameNode.checkpointSize is in byte but not MB.MinornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1665Balancer sleeps inadequatelyMinorbalancer & moverTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1625TestDataNodeMXBean fails if disk space usage changes during test runMinortestTodd LipconTsz Wo Nicholas Sze
HDFS-1621Fix references to hadoop-common-${version} in build.xmlMajor.Todd LipconJolly Chen
HDFS-1615seek() on closed DFS input stream throws NPEMajor.Todd LipconScott Carey
HDFS-1612HDFS Design Documentation is outdatedMinordocumentationJoe CrobakJoe Crobak
HDFS-1602NameNode storage failed replica restoration is brokenMajornamenodeKonstantin BoudnikBoris Shkolnik
HDFS-1598ListPathsServlet excludes .*.crc filesMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1597Batched edit log syncs can reset synctxid throw assertionsBlocker.Todd LipconTodd Lipcon
HDFS-1591Fix javac, javadoc, findbugs warningsMajor.Po CheungPo Cheung
HDFS-1575viewing block from web UI brokenBlocker.Todd LipconAaron T. Myers
HDFS-1572Checkpointer should trigger checkpoint with specified period.Blocker.Liyin LiangJakob Homan
HDFS-1561BackupNode listens on default hostBlockernamenodeKonstantin ShvachkoKonstantin Shvachko
HDFS-1550NPE when listing a file with no locationBlockerhdfs-clientHairong KuangHairong Kuang
HDFS-1544Ivy resolve force mode should be turned off by defaultMajor.Luke LuLuke Lu
HDFS-1542Deadlock in Configuration.writeXml when serialized form is larger than one DFS blockCriticalhdfs-clientTodd LipconTodd Lipcon
HDFS-1532Exclude Findbugs warning in FSImageFormat$SaverMajortestTodd LipconTodd Lipcon
HDFS-1531Clean up stack traces due to duplicate MXBean registrationTrivialdatanode, namenodeTodd LipconTodd Lipcon
HDFS-1529Incorrect handling of interrupts in waitForAckedSeqno can cause deadlockBlockerhdfs-clientTodd LipconTodd Lipcon
HDFS-1527SocketOutputStream.transferToFully fails for blocks >= 2GB on 32 bit JVMMajordatanodePatrick KlingPatrick Kling
HDFS-1524Image loader should make sure to read every byte in image fileBlockernamenodeHairong KuangHairong Kuang
HDFS-1523TestLargeBlock is failing on trunkMajortestKonstantin BoudnikKonstantin Boudnik
HDFS-151198 Release Audit warnings on trunk and branch-0.22Blocker.Nigel DaleyJakob Homan
HDFS-1507TestAbandonBlock should abandon a blockMinortestEli CollinsEli Collins
HDFS-1505saveNamespace appears to succeed even if all directories fail to saveBlocker.Todd LipconAaron T. Myers
HDFS-1504FSImageSaver should catch all exceptions, not just IOEMinornamenodeTodd LipconTodd Lipcon
HDFS-1503TestSaveNamespace failsMinortestEli CollinsTodd Lipcon
HDFS-1502TestBlockRecovery triggers NPE in assertMinor.Eli CollinsHairong Kuang
HDFS-1500TestOfflineImageViewer failing on trunkMajortest, toolsTodd LipconTodd Lipcon
HDFS-1498FSDirectory#unprotectedConcat calls setModificationTime on a fileMinornamenodeEli CollinsEli Collins
HDFS-1487FSDirectory.removeBlock() should update diskspace count of the block owner nodeMajornamenodeZhong WangZhong Wang
HDFS-1483DFSClient.getBlockLocations returns BlockLocations with no indication that the corresponding blocks are corruptMajorhdfs-clientPatrick KlingPatrick Kling
HDFS-1467Append pipeline never succeeds with more than one replicaBlockerdatanodeTodd LipconTodd Lipcon
HDFS-1466TestFcHdfsSymlink relies on /tmp/test not existingMinortestTodd LipconEli Collins
HDFS-1440TestComputeInvalidateWork fails intermittentlyMajortestSuresh SrinivasSuresh Srinivas
HDFS-1433Fix test failures - TestPread and TestFileLimitMajortestSuresh SrinivasSuresh Srinivas
HDFS-1409The “register” method of the BackupNode class should be “UnsupportedActionException(“register”)”TrivialnamenodeChing-Shen ChenChing-Shen Chen
HDFS-1399Distinct minicluster services (e.g. NN and JT) overwrite each other's service policiesMajorsecurityAaron T. MyersAaron T. Myers
HDFS-1377Quota bug for partial blocks allows quotas to be violatedBlockernamenodeEli CollinsEli Collins
HDFS-1364HFTP client should support relogin from keytabMajorsecurityKan ZhangJitendra Nath Pandey
HDFS-1361Add -fileStatus operation to NNThroughputBenchmarkMajor.Konstantin ShvachkoKonstantin Shvachko
HDFS-1357HFTP traffic served by DataNode shouldn't use service port on NameNodeMajordatanode, securityKan ZhangKan Zhang
HDFS-1355ant veryclean (clean-cache) doesn't clean enoughMajorbuildLuke LuLuke Lu
HDFS-1352Fix jsvc.locationMajorbuildEli CollinsEli Collins
HDFS-1349Remove empty java filesMajor.Tom WhiteEli Collins
HDFS-1347TestDelegationToken uses mortbay.log for loggingMajortestBoris ShkolnikBoris Shkolnik
HDFS-1340A null delegation token is appended to the url if security is disabled when browsing filesystem.Major.Jitendra Nath PandeyJitendra Nath Pandey
HDFS-1334open in HftpFileSystem does not add delegation tokens to the url.Major.Jitendra Nath PandeyJitendra Nath Pandey
HDFS-1317HDFSProxy needs additional changes to work after changes to streamFile servlet in HDFS-1109Majorcontrib/hdfsproxyRohini PalaniswamyRohini Palaniswamy
HDFS-1308job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystem (part of MR-1718)Major.Boris ShkolnikBoris Shkolnik
HDFS-1301TestHDFSProxy need to use server side conf for ProxyUser stuff.Major.Boris ShkolnikBoris Shkolnik
HDFS-1296using delegation token over hftp for long running clients (spawn from hdfs-1007).Major.Boris ShkolnikBoris Shkolnik
HDFS-1289Datanode secure mode is brokenMajordatanodeKan ZhangKan Zhang
HDFS-1284TestBlockToken failsMajortestKonstantin ShvachkoKan Zhang
HDFS-1283ant eclipse-files has drifted againMajorbuildJakob HomanJakob Homan
HDFS-1258Clearing namespace quota on “/” corrupts FS imageBlockernamenodeAaron T. MyersAaron T. Myers
HDFS-1250Namenode accepts block report from dead datanodesMajornamenodeSuresh SrinivasSuresh Srinivas
HDFS-1206TestFiHFlush fails intermittentlyMajortestTsz Wo Nicholas SzeKonstantin Boudnik
HDFS-1202DataBlockScanner throws NPE when updated before initializedMajordatanodeTodd LipconTodd Lipcon
HDFS-1198Resolving cross-realm principalsMajornamenodeJitendra Nath PandeyJitendra Nath Pandey
HDFS-1192refreshSuperUserGroupsConfiguration should use server side configuration for the refresh (for HADOOP-6815)Major.Boris ShkolnikBoris Shkolnik
HDFS-1189Quota counts missed between clear quota and set quotaMajornamenodeKang XiaoJohn George
HDFS-1164TestHdfsProxy is failingMajorcontrib/hdfsproxyEli CollinsTodd Lipcon
HDFS-1163normalize property names for JT/NN kerberos principal names in configuration (from HADOOP 6633)Major.Boris ShkolnikBoris Shkolnik
HDFS-1157Modifications introduced by HDFS-1150 are breaking aspect's bindingsMajortestKonstantin BoudnikKonstantin Boudnik
HDFS-1146Javadoc for getDelegationTokenSecretManager in FSNamesystemMajor.Jitendra Nath PandeyJitendra Nath Pandey
HDFS-1145When NameNode is shutdown it tries to exit safemodeMajornamenodedhruba borthakurdhruba borthakur
HDFS-1141completeFile does not check lease ownershipBlockernamenodeTodd LipconTodd Lipcon
HDFS-1138Modification times are being overwritten when FSImage loadsMajor.Dmytro MolkovDmytro Molkov
HDFS-1130Pass Administrator acl to HTTPServer for common servlet access.MajorsecurityAmareshwari SriramadasuDevaraj Das
HDFS-1118DFSOutputStream socket leak when cannot connect to DataNodeMajor.Zheng ShaoZheng Shao
HDFS-1112Edit log buffer should not grow unboundedlyMajornamenodeHairong KuangHairong Kuang
HDFS-1085hftp read failing silentlyMajordatanodeKoji NoguchiTsz Wo Nicholas Sze
HDFS-1045In secure clusters, re-login is necessary for https clients before opening connectionsMajorsecurityJakob HomanJakob Homan
HDFS-1044Cannot submit mapreduce job from secure client to unsecure severMajor.Boris ShkolnikBoris Shkolnik
HDFS-1039Service should be set in the token in JspHelper.getUGIMajor.Jitendra Nath PandeyJitendra Nath Pandey
HDFS-1038In nn_browsedfscontent.jsp fetch delegation token only if security is enabled.Major.Jitendra Nath PandeyJitendra Nath Pandey
HDFS-1036in DelegationTokenFetch dfs.getURI returns no portMajor.Boris ShkolnikBoris Shkolnik
HDFS-1027Update year to 2010.Trivial.Ravi PhulariRavi Phulari
HDFS-1021specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in DFSAdmin (for HADOOP-6612)MajorsecurityBoris ShkolnikBoris Shkolnik
HDFS-1019Incorrect default values for delegation tokens in hdfs-default.xmlMajor.Jitendra Nath PandeyJitendra Nath Pandey
HDFS-1017browsedfs jsp should call JspHelper.getUGI rather than using createRemoteUser()MajorsecurityJakob HomanJakob Homan
HDFS-1007HFTP needs to be updated to use delegation tokensMajorsecurityDevaraj DasDevaraj Das
HDFS-1006getImage/putImage http requests should be https for the case of security enabled.Major.Boris ShkolnikBoris Shkolnik
HDFS-1001DataXceiver and BlockReader disagree on when to send/recv CHECKSUM_OKMinordatanodebc Wongbc Wong
HDFS-988saveNamespace race can corrupt the edits logBlockernamenodedhruba borthakurEli Collins
HDFS-977DataNode.createInterDataNodeProtocolProxy() guards a log at the wrong levelTrivialdatanodeSteve LoughranHarsh J
HDFS-970FSImage writing should always fsync before closeCriticalnamenodeTodd LipconTodd Lipcon
HDFS-939libhdfs test is brokenBlockerlibhdfsEli CollinsEli Collins
HDFS-912sed in build.xml failsMinor.Allen WittenauerAllen Wittenauer
HDFS-900Corrupt replicas are not tracked correctly through block report from DNBlocker.Todd LipconKonstantin Shvachko
HDFS-874TestHDFSFileContextMainOperations fails on weirdly configured DNS hostsMajorhdfs-client, testTodd LipconTodd Lipcon
HDFS-829hdfsJniHelper.c: #include <error.h> is not portableMajor.Allen WittenauerAllen Wittenauer
HDFS-727bug setting block size hdfsOpenFileBlockerlibhdfsEli CollinsEli Collins
HDFS-671Documentation change for updated configuration keys.Blocker.Jitendra Nath PandeyTom White
HDFS-613TestBalancer and TestBlockTokenWithDFS fail Balancer assertMajortestKonstantin ShvachkoTodd Lipcon
HDFS-96HDFS does not support blocks greater than 2GBMajor.dhruba borthakurPatrick Kling
MAPREDUCE-3438TestRaidNode fails because of “Too many open files”Majorcontrib/raidKonstantin ShvachkoRamkumar Vadali
MAPREDUCE-3429Few contrib tests are failing because of the missing commons-lang dependencyMajorcapacity-sched, contrib/gridmixKonstantin BoudnikKonstantin Boudnik
MAPREDUCE-3151Contrib tests failingMajorcontrib/verticaJoep RottinghuisJoep Rottinghuis
MAPREDUCE-3139SlivePartitioner generates negative partitionsMajortestKonstantin ShvachkoJakob Homan
MAPREDUCE-3138Allow for applications to deal with MAPREDUCE-954Blockerclient, mrv2Arun C MurthyOwen O'Malley
MAPREDUCE-3088Clover 2.4.3 breaks build for 0.22 branchMajorbuildKonstantin ShvachkoKonstantin Shvachko
MAPREDUCE-3039Make mapreduce use same version of avro as HBaseMajorcapacity-sched, contrib/fair-share, contrib/gridmix, contrib/mrunit, contrib/mumak, contrib/raid, contrib/streaming, jobhistoryserverJoep RottinghuisJoep Rottinghuis
MAPREDUCE-3026When user adds hierarchical queues to the cluster, mapred queue -list returns NULL Pointer ExceptionMajorjobtrackerMayank BansalMayank Bansal
MAPREDUCE-3025Contribs not buildingBlockerbuildJoep RottinghuisJoep Rottinghuis
MAPREDUCE-2991queueinfo.jsp fails to show queue status if any Capacity scheduler queue name has dash/hiphen in it.MajorschedulerPriyo MustafiPriyo Mustafi
MAPREDUCE-2948Hadoop streaming test failure, post MR-2767Majorcontrib/streamingMilind BhandarkarMahadev konar
MAPREDUCE-2940Build fails with ant 1.7.0 but works with 1.8.0MajorbuildJoep RottinghuisJoep Rottinghuis
MAPREDUCE-2936Contrib Raid compilation broken after HDFS-1620Major.Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-2779JobSplitWriter.java can't handle large job.split fileMajorjob submissionMing MaMing Ma
MAPREDUCE-2767Remove Linux task-controller from 0.22 branchBlockersecurityMilind BhandarkarMilind Bhandarkar
MAPREDUCE-2753Generated POMs hardcode dependency on hadoop-common version 0.22.0-SNAPSHOTMajorbuildJoep RottinghuisJoep Rottinghuis
MAPREDUCE-2752Build does not pass along properties to contrib buildsMinorbuildJoep RottinghuisJoep Rottinghuis
MAPREDUCE-2571CombineFileInputFormat.getSplits throws a java.lang.ArrayStoreExceptionBlocker.Bochun BaiBochun Bai
MAPREDUCE-2531org.apache.hadoop.mapred.jobcontrol.getAssignedJobID throw class cast exceptionBlockerclientRobert Joseph EvansRobert Joseph Evans
MAPREDUCE-2516option to control sensitive web actionsMinor.Ari RabkinAri Rabkin
MAPREDUCE-2515MapReduce references obsolete optionsMajorjobtrackerAri RabkinAri Rabkin
MAPREDUCE-2487ChainReducer uses MAPPER_BY_VALUE instead of REDUCER_BY_VALUEMinor.Forrest VinesDevaraj K
MAPREDUCE-24860.22 - snapshot incorrect dependency published in .pom filesBlocker.Dmitriy V. RyaboyTodd Lipcon
MAPREDUCE-2472Extra whitespace in mapred.child.java.opts breaks JVM initializationMajortask-controllerTodd LipconAaron T. Myers
MAPREDUCE-2457job submission should inject group.name (on the JT side)CriticaljobtrackerAlejandro AbdelnurAlejandro Abdelnur
MAPREDUCE-2448NoSuchMethodError: org.apache.hadoop.hdfs.TestDatanodeBlockScanner.corruptReplica(..)Minorcontrib/raid, testTsz Wo Nicholas SzeEli Collins
MAPREDUCE-2445TestMiniMRWithDFSWithDistinctUsers is very brokenMajorsecurity, testTodd LipconTodd Lipcon
MAPREDUCE-2437SLive should process only part* files while generating the report.BlockertestKonstantin ShvachkoKonstantin Shvachko
MAPREDUCE-2428start-mapred.sh script fails if HADOOP_HOME is not setBlocker.Tom WhiteTom White
MAPREDUCE-2394JUnit output format doesn't propagate into some contrib buildsBlocker.Todd LipconTodd Lipcon
MAPREDUCE-2392TaskTracker shutdown in the tests sometimes take 60sMajor.Tom WhiteTom White
MAPREDUCE-2336Tool-related packages should be in the Tool javadoc groupMajordocumentationTom WhiteTom White
MAPREDUCE-2327MapTask doesn't need to put username information in SpillRecordBlocker.Todd LipconTodd Lipcon
MAPREDUCE-2317HadoopArchives throwing NullPointerException while creating hadoop archives (.har files)MinorharchiveDevaraj KDevaraj K
MAPREDUCE-2315javadoc is failing in nightlyBlocker.Todd LipconTodd Lipcon
MAPREDUCE-2311TestFairScheduler failing on trunkBlockercontrib/fair-shareTodd LipconScott Chen
MAPREDUCE-2304TestMRCLI fails when hostname has a hyphen (-)MinortestPriyo MustafiPriyo Mustafi
MAPREDUCE-2285MiniMRCluster does not start after ant test-patchBlockertestRamkumar VadaliTodd Lipcon
MAPREDUCE-2284TestLocalRunner.testMultiMaps times outCriticaltestTodd LipconTodd Lipcon
MAPREDUCE-2283TestBlockFixer hangs initializing MiniMRClusterBlockercontrib/raidNigel DaleyRamkumar Vadali
MAPREDUCE-2282MapReduce tests don't compile following HDFS-1561BlockertestTom WhiteKonstantin Shvachko
MAPREDUCE-2281Fix javac, javadoc, findbugs warningsMajor.Po CheungPo Cheung
MAPREDUCE-2277TestCapacitySchedulerWithJobTracker fails sometimesMinorcapacity-schedTodd LipconTodd Lipcon
MAPREDUCE-2272Job ACL file should not be executableTrivialtasktrackerTodd LipconHarsh J
MAPREDUCE-2256FairScheduler fairshare preemption from multiple pools may preempt all tasks from one pool causing that pool to go below fairshare.Majorcontrib/fair-sharePriyo MustafiPriyo Mustafi
MAPREDUCE-2253Servlets should specify content typeCritical.Todd LipconTodd Lipcon
MAPREDUCE-2251Remove mapreduce.job.userhistorylocation configMajor.Todd LipconHarsh J
MAPREDUCE-2238Undeletable build directoriesCriticalbuild, testEli CollinsTodd Lipcon
MAPREDUCE-2224Synchronization bugs in JvmManagerCriticaltasktrackerTodd LipconTodd Lipcon
MAPREDUCE-2222Ivy resolve force mode should be turned off by defaultMajor.Luke LuLuke Lu
MAPREDUCE-2219JT should not try to remove mapred.system.dir during startupMajorjobtrackerTodd LipconTodd Lipcon
MAPREDUCE-2200TestUmbilicalProtocolWithJobToken is failing without Krb evironment: needs to be conditionalMajortestKonstantin BoudnikKonstantin Boudnik
MAPREDUCE-2195New property for local conf directory in system-test-mapreduce.xml file.MajortestKonstantin BoudnikKonstantin Boudnik
MAPREDUCE-2188The new API MultithreadedMapper doesn't call the initialize method of the RecordReaderMajor.Owen O'MalleyOwen O'Malley
MAPREDUCE-2179RaidBlockSender.java compilation failsBlockercontrib/raidGiridharan KesavanRamkumar Vadali
MAPREDUCE-2173Race condition in TestBlockFixer causes intermittent failureMajor.Patrick KlingPatrick Kling
MAPREDUCE-2146Raid should not affect access time of a source fileMinorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-2143HarFileSystem is not able to handle spaces in its pathMajorharchiveRamkumar VadaliRamkumar Vadali
MAPREDUCE-2127mapreduce trunk builds are failing on hudsonMajorbuild, pipesGiridharan KesavanBruno Mahé
MAPREDUCE-2099RaidNode should recreate outdated parity HARsMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-2096Secure local filesystem IO from symlink vulnerabilitiesBlockerjobtracker, security, tasktrackerTodd LipconTodd Lipcon
MAPREDUCE-2095Gridmix unable to run for compressed traces(.gz format).Majorcontrib/gridmixVinay Kumar ThotaRanjit Mathew
MAPREDUCE-2084Deprecated org.apache.hadoop.util package in MapReduce produces deprecations in Common classes in EclipseBlockerdocumentationTom WhiteTom White
MAPREDUCE-2082Race condition in writing the jobtoken password file when launching pipes jobsMajor.Jitendra Nath PandeyJitendra Nath Pandey
MAPREDUCE-2078TraceBuilder unable to generate the traces while giving the job history path by globing.Majortools/rumenVinay Kumar ThotaAmar Kamat
MAPREDUCE-2077Name clash in the deprecated o.a.h.util.MemoryCalculatorPluginMajor.Luke LuLuke Lu
MAPREDUCE-2067Distinct minicluster services (e.g. NN and JT) overwrite each other's service policiesMajorsecurityAaron T. MyersAaron T. Myers
MAPREDUCE-2059RecoveryManager attempts to add jobtracker.infoMajorjobtrackerDan AdkinsSubroto Sanyal
MAPREDUCE-2054Hierarchical queue implementation broke dynamic queue addition in Dynamic SchedulerMajorcontrib/dynamic-schedulerThomas SandholmThomas Sandholm
MAPREDUCE-2032TestJobOutputCommitter fails in ant test runMajortaskAmareshwari SriramadasuDick King
MAPREDUCE-2031TestTaskLauncher and TestTaskTrackerLocalization fail with NPE in trunk.Majortasktracker, testAmareshwari SriramadasuRavi Gummadi
MAPREDUCE-2029DistributedRaidFileSystem not removed from cache on close()Majorcontrib/raidPaul YangRamkumar Vadali
MAPREDUCE-2023TestDFSIO read test may not read specified bytes.MajorbenchmarksHong TangHong Tang
MAPREDUCE-2022trunk build brokenBlockertestAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-2021CombineFileInputFormat returns duplicate hostnames in split locationsMajorclientAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-2000Rumen is not able to extract counters for Job history logs from Hadoop 0.20Majortools/rumenHong TangHong Tang
MAPREDUCE-1999ClientProtocol incorrectly uses hdfs DelegationTokenSelectorMajor.Jitendra Nath PandeyJitendra Nath Pandey
MAPREDUCE-1996API: Reducer.reduce() method detail misstatementTrivialdocumentationGlynn DurhamHarsh J
MAPREDUCE-1993TestTrackerDistributedCacheManagerWithLinuxTaskController fails on trunkMajor.Devaraj DasDevaraj Das
MAPREDUCE-1992NPE in JobTracker's constructorMajorjobtrackerRavi GummadiKan Zhang
MAPREDUCE-1989Gridmix3 doesn't emit out proper mesage when user resolver is set and no user list is givenMajorcontrib/gridmixRavi GummadiRavi Gummadi
MAPREDUCE-1982[Rumen] TraceBuilder's output shows jobname as NULL for jobhistory files with valid jobnamesMajortools/rumenAmar KamatRavi Gummadi
MAPREDUCE-1979“Output directory already exists” error in gridmix when gridmix.output.directory is not definedMajorcontrib/gridmixRavi GummadiRavi Gummadi
MAPREDUCE-1975gridmix shows unnecessary InterruptedExceptionMajorcontrib/gridmixRavi GummadiRavi Gummadi
MAPREDUCE-1974FairScheduler can preempt the same task many timesMajorcontrib/fair-shareScott ChenScott Chen
MAPREDUCE-1961[gridmix3] ConcurrentModificationException when shutting down GridmixMajorcontrib/gridmixHong TangHong Tang
MAPREDUCE-1958using delegation token over hftp for long running clients (part of hdfs 1296)Major.Boris ShkolnikBoris Shkolnik
MAPREDUCE-1925TestRumenJobTraces fails in trunkMajortools/rumenAmareshwari SriramadasuRavi Gummadi
MAPREDUCE-1915IndexCache - getIndexInformation - check reduce index Out Of BoundsTrivialtasktrackerRares VernicaPriyo Mustafi
MAPREDUCE-1911Fix errors in -info option in streamingMajorcontrib/streamingAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1908DistributedRaidFileSystem does not handle ChecksumException correctlyMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-1900MapReduce daemons should close FileSystems that are not needed anymoreMajorjobtracker, tasktrackerDevaraj DasKan Zhang
MAPREDUCE-1894DistributedRaidFileSystem.readFully() does not returnMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-1888Streaming overrides user given output key and value types.Majorcontrib/streamingAmareshwari SriramadasuRavi Gummadi
MAPREDUCE-1887MRAsyncDiskService does not properly absolutize volume root pathsMajor.Aaron KimballAaron Kimball
MAPREDUCE-1880“java.lang.ArithmeticException: Non-terminating decimal expansion; no exact representable decimal result.” while running “hadoop jar hadoop-0.20.1+169.89-examples.jar pi 4 30”MinorexamplesVictor PakhomovTsz Wo Nicholas Sze
MAPREDUCE-1867Remove unused methods in org.apache.hadoop.streaming.StreamUtilMinorcontrib/streamingAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1865[Rumen] Rumen should also support jobhistory files generated using trunkMajortools/rumenAmar KamatAmar Kamat
MAPREDUCE-1864PipeMapRed.java has uninitialized members log_ and LOGNAMEMajorcontrib/streamingAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1863[Rumen] Null failedMapAttemptCDFs in job traces generated by RumenMajortools/rumenAmar KamatAmar Kamat
MAPREDUCE-1857Remove unused streaming configuration from srcTrivialcontrib/streamingAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1853MultipleOutputs does not cache TaskAttemptContextCriticaltaskTorsten CurdtTorsten Curdt
MAPREDUCE-1845FairScheduler.tasksToPeempt() can return negative numberMajorcontrib/fair-shareScott ChenScott Chen
MAPREDUCE-1836Refresh for proxy superuser config (mr part for HDFS-1096)Major.Boris ShkolnikBoris Shkolnik
MAPREDUCE-1834TestSimulatorDeterministicReplay timesout on trunkMajorcontrib/mumakAmareshwari SriramadasuHong Tang
MAPREDUCE-1825jobqueue_details.jsp and FairSchedulerServelet should not call finishedMaps and finishedReduces when job is not initializedMajorjobtrackerAmareshwari SriramadasuScott Chen
MAPREDUCE-1820InputSampler does not create a deep copy of the key object when creating a sample, which causes problems with some formats like SequenceFile<Text,Text>Major.Alex KozlovAlex Kozlov
MAPREDUCE-1813NPE in PipeMapred.MRErrorThreadMajorcontrib/streamingAmareshwari SriramadasuRavi Gummadi
MAPREDUCE-1784IFile should check for null compressorMinor.Eli CollinsEli Collins
MAPREDUCE-1780AccessControlList.toString() is used for serialization of ACL in JobStatus.javaMajorjobtrackerRavi GummadiRavi Gummadi
MAPREDUCE-1773streaming doesn't support jobclient.output.filterMajorcontrib/streamingAlok SinghAmareshwari Sriramadasu
MAPREDUCE-1772Hadoop streaming doc should not use IdentityMapper as an exampleMinorcontrib/streaming, documentationMarco NicosiaAmareshwari Sriramadasu
MAPREDUCE-1754Replace mapred.persmissions.supergroup with an acl : mapreduce.cluster.administratorsMajorjobtrackerAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1718job conf key for the services name of DelegationToken for HFTP url is constructed incorrectly in HFTPFileSystemMajor.Boris ShkolnikBoris Shkolnik
MAPREDUCE-1707TaskRunner can get NPE in getting ugi from TaskTrackerMajortasktrackerAmareshwari SriramadasuVinod Kumar Vavilapalli
MAPREDUCE-1701AccessControlException while renewing a delegation token in not correctly handled in the JobTrackerMajorjobtrackerDevaraj DasBoris Shkolnik
MAPREDUCE-1686ClassNotFoundException for custom format classes provided in libjarsMinorcontrib/streaming, testPaul BurkhardtPaul Burkhardt
MAPREDUCE-1670RAID should avoid policies that scan their own destination pathMajorcontrib/raidRodrigo SchmidtRamkumar Vadali
MAPREDUCE-1668RaidNode should only Har a directory if all its parity files have been createdMajorcontrib/raidRodrigo SchmidtRamkumar Vadali
MAPREDUCE-1662TaskRunner.prepare() and close() can be removedMajortasktrackerAmareshwari SriramadasuAmareshwari Sriramadasu
MAPREDUCE-1621Streaming's TextOutputReader.getLastOutput throws NPE if it has never read any outputMajorcontrib/streamingTodd LipconAmareshwari Sriramadasu
MAPREDUCE-1617TestBadRecords failed once in our test runsMajortestAmareshwari SriramadasuLuke Lu
MAPREDUCE-1599MRBench reuses jobConf and credentials there in.Major.Jitendra Nath PandeyJitendra Nath Pandey
MAPREDUCE-1597combinefileinputformat does not work with non-splittable filesMajor.Namit JainAmareshwari Sriramadasu
MAPREDUCE-1566Need to add a mechanism to import tokens and secrets into a submitted job.MajorsecurityOwen O'MalleyJitendra Nath Pandey
MAPREDUCE-1559The DelegationTokenRenewal timer task should use the jobtracker's credentials to create the filesystemMajorjobtrackerDevaraj DasDevaraj Das
MAPREDUCE-1558specify correct server principal for RefreshAuthorizationPolicyProtocol and RefreshUserToGroupMappingsProtocol protocols in MRAdmin (for HADOOP-6612)MajorsecurityBoris ShkolnikBoris Shkolnik
MAPREDUCE-1543Log messages of JobACLsManager should use security logging of HADOOP-6586MajorsecurityVinod Kumar VavilapalliLuke Lu
MAPREDUCE-1533Reduce or remove usage of String.format() usage in CapacityTaskScheduler.updateQSIObjects and Counters.makeEscapedString()MajorjobtrackerRajesh BalamohanDick King
MAPREDUCE-1532Delegation token is obtained as the superuserMajorjob submission, securityDevaraj DasDevaraj Das
MAPREDUCE-1528TokenStorage should not be staticMajor.Owen O'MalleyJitendra Nath Pandey
MAPREDUCE-1505Cluster class should create the rpc client only when neededMajorclientDevaraj DasDick King
MAPREDUCE-1375TestFileArgs fails intermittentlyMajorcontrib/streaming, testAmar KamatTodd Lipcon
MAPREDUCE-1288DistributedCache localizes only once per cache URICriticaldistributed-cache, security, tasktrackerDevaraj DasDevaraj Das
MAPREDUCE-1280Eclipse Plugin does not work with Eclipse Ganymede (3.4)Major.Aaron KimballAlex Kozlov
MAPREDUCE-1225TT successfully localizes a task even though the corresponding cache-file has already changed on DFS.MajortasktrackerVinod Kumar VavilapalliZhong Wang
MAPREDUCE-1118Capacity Scheduler scheduling information is hard to read / should be tabular formatMajorcapacity-schedAllen WittenauerKrishna Ramachandran
MAPREDUCE-1085For tasks, “ulimit -v -1” is being run when user doesn't specify mapred.child.ulimitMinortasktrackerRavi GummadiTodd Lipcon
MAPREDUCE-869Documentation for config to set map/reduce task environmentMajordocumentation, taskArun C MurthyAlejandro Abdelnur
MAPREDUCE-714JobConf.findContainingJar unescapes unnecessarily on LinuxMajor.Todd LipconTodd Lipcon
MAPREDUCE-647Update the DistCp forrest doc to make it consistent with the latest changes (5472, 5620, 5762, 5826)MajordocumentationRodrigo SchmidtRodrigo Schmidt
MAPREDUCE-577Duplicate Mapper input when using StreamXmlRecordReaderMajorcontrib/streamingDavid CampbellRavi Gummadi
MAPREDUCE-572If #link is missing from uri format of -cacheArchive then streaming does not throw error.Minorcontrib/streamingKaram SinghAmareshwari Sriramadasu

TESTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7783Add more symlink tests that cover intermediate linksMajorfsEli CollinsEli Collins
HADOOP-7298Add test utility for writing multi-threaded testsMajortestTodd LipconTodd Lipcon
HADOOP-7034Add TestPath tests to cover dot, dot dot, and slash normalizationMajorfsEli CollinsEli Collins
HADOOP-7024Create a test method for adding file systems during tests.MajortestKan ZhangKan Zhang
HADOOP-6934test for ByteWritable comparatorMajorrecordJohannes ZillmannJohannes Zillmann
HADOOP-6803Add native gzip read/write coverage to TestCodecMajorioEli CollinsEli Collins
HDFS-1855TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy() part 2 fails in two different waysMajortestMatt FoleyMatt Foley
HDFS-1762Allow TestHDFSCLI to be run against a clusterMajorbuild, testTom WhiteKonstantin Boudnik
HDFS-1562Add rack policy testsMajornamenode, testEli CollinsEli Collins
HDFS-1310TestFileConcurrentReader failsMajorhdfs-clientSuresh Srinivassam rash
HDFS-1132Refactor TestFileStatusMinortestEli CollinsEli Collins
HDFS-982TestDelegationToken#testDelegationTokenWithRealUser is failingBlockercontrib/hdfsproxy, securityEli CollinsPo Cheung
HDFS-981test-contrib fails due to test-cactus failureBlockercontrib/hdfsproxyEli CollinsKonstantin Boudnik
HDFS-697Enable asserts for tests by defaultMajor.Eli CollinsEli Collins
HDFS-696Java assertion failures triggered by testsMajortestEli CollinsEli Collins
MAPREDUCE-3156Allow TestMRCLI to be run against a clusterMajortestKonstantin BoudnikKonstantin Boudnik
MAPREDUCE-2241ClusterWithLinuxTaskController should accept relative path on the command lineTrivialtask-controller, testTodd LipconTodd Lipcon
MAPREDUCE-2180Add coverage of fair scheduler servlet to system testMinorcontrib/fair-shareTodd LipconTodd Lipcon
MAPREDUCE-2073TestTrackerDistributedCacheManager should be up-front about requirements on build environmentTrivialdistributed-cache, testTodd LipconTodd Lipcon
MAPREDUCE-2051Contribute a fair scheduler preemption system testMajorcontrib/fair-shareTodd LipconTodd Lipcon
MAPREDUCE-2034TestSubmitJob triggers NPE instead of permissions errorTrivialtestTodd LipconTodd Lipcon
MAPREDUCE-1092Enable asserts for tests by defaultMajortestEli CollinsEli Collins

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-6683the first optimization: ZlibCompressor does not fully utilize the bufferMinorioKang XiaoKang Xiao
HDFS-1997Image transfer process misreports client side exceptionsMajornamenodeTodd LipconTodd Lipcon
HDFS-1473Refactor storage management into separate classes than fsimage file reading/writingMajornamenodeTodd LipconTodd Lipcon
HDFS-1462Refactor edit log loading to a separate class from edit log writingMajornamenodeTodd LipconTodd Lipcon
HDFS-1319Fix location of re-login for secondary namenode from HDFS-999MajornamenodeJakob HomanJakob Homan
HDFS-1119Refactor BlocksMap with GettableSetMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-1071savenamespace should write the fsimage to all configured fs.name.dir in parallelMajornamenodedhruba borthakurDmytro Molkov
HDFS-1057Concurrent readers hit ChecksumExceptions if following a writer to very end of fileBlockerdatanodeTodd Lipconsam rash
HDFS-259Remove intentionally corrupt 0.13 directory layout creationMajor.Todd LipconTodd Lipcon
MAPREDUCE-2234If Localizer can't create task log directory, it should fail on the spotMajortasktrackerTodd LipconTodd Lipcon
MAPREDUCE-1970Reed-Solomon code implementation to be used in raidMajorcontrib/raidScott ChenScott Chen
MAPREDUCE-927Cleanup of task-logs should happen in TaskTracker instead of the ChildMajorsecurity, tasktrackerVinod Kumar VavilapalliAmareshwari Sriramadasu

OTHER:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7291Update Hudson job not to run test-contribMajor.Eli CollinsEli Collins
HADOOP-7283Include 32-bit and 64-bit native libraries in Jenkins tarball buildsBlockerbuildTom WhiteTom White
HADOOP-6846Scripts for building Hadoop 0.22.0 releaseMajorbuildTom WhiteTom White
HDFS-2513Bump jetty to 6.1.26MajorbuildKonstantin BoudnikKonstantin Boudnik
HDFS-1948Forward port ‘hdfs-1520 lightweight namenode operation to trigger lease reccovery’Major.stackstack
HDFS-1946HDFS part of HADOOP-7291Major.Eli CollinsEli Collins
HDFS-1167New property for local conf directory in system-test-hdfs.xml file.MajortestVinay Kumar ThotaVinay Kumar Thota
HDFS-712Move libhdfs from mr to hdfsMajorlibhdfsEli CollinsEli Collins
MAPREDUCE-3311Bump jetty to 6.1.26MajorbuildKonstantin BoudnikKonstantin Boudnik
MAPREDUCE-2939Ant setup on hadoop7 jenkins hostMajorbuildJoep RottinghuisJoep Rottinghuis
MAPREDUCE-2383Improve documentation of DistributedCache methodsMajordistributed-cache, documentationTodd LipconHarsh J
MAPREDUCE-2169Integrated Reed-Solomon code with RaidNodeMajorcontrib/raidRamkumar VadaliRamkumar Vadali
MAPREDUCE-2142Refactor RaidNode to remove dependence on map reduceMajor.Patrick KlingPatrick Kling
MAPREDUCE-231Split map/reduce into sub-projectMajor.Owen O'MalleyOwen O'Malley