Apache Hadoop Changelog

Release 0.23.1 - 2012-02-17

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-8013ViewFileSystem does not honor setVerifyChecksumMajorfsDaryn SharpDaryn Sharp
HADOOP-7470move up to Jackson 1.8.8MinorutilSteve LoughranEnis Soztutar
HADOOP-7348Modify the option of FsShell getmerge from [addnl] to [-nl] for consistencyMajorfsXieXianshanXieXianshan
MAPREDUCE-3720Command line listJobs should not visit each AMMajorclient, mrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7808Port token service changes from 205Majorfs, securityDaryn SharpDaryn Sharp
HDFS-2316[umbrella] WebHDFS: a complete FileSystem implementation for accessing HDFS over HTTPMajorwebhdfsTsz Wo Nicholas SzeTsz Wo Nicholas Sze
MAPREDUCE-2765DistCp RewriteMajordistcp, mrv2Mithun RadhakrishnanMithun Radhakrishnan
MAPREDUCE-778[Rumen] Need a standalone JobHistory log anonymizerMajortools/rumenHong TangAmar Kamat

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-8027Visiting /jmx on the daemon web interfaces may print unnecessary error in logsMinormetricsHarsh JAaron T. Myers
HADOOP-8015ChRootFileSystem should extend FilterFileSystemMajorfsDaryn SharpDaryn Sharp
HADOOP-8009Create hadoop-client and hadoop-minicluster artifacts for downstream projectsCriticalbuildAlejandro AbdelnurAlejandro Abdelnur
HADOOP-7987Support setting the run-as user in unsecure modeMajorsecurityDevaraj DasJitendra Nath Pandey
HADOOP-7939Improve Hadoop subcomponent integration in Hadoop 0.23Majorbuild, conf, documentation, scriptsRoman ShaposhnikRoman Shaposhnik
HADOOP-7934Normalize dependencies versions across all modulesCriticalbuildAlejandro AbdelnurAlejandro Abdelnur
HADOOP-7919[Doc] Remove hadoop.logfile.* properties.TrivialdocumentationHarsh JHarsh J
HADOOP-7910add configuration methods to handle human readable size valuesMinorconfSho ShimauchiSho Shimauchi
HADOOP-7890Redirect hadoop script's deprecation message to stderrTrivialscriptsKoji NoguchiKoji Noguchi
HADOOP-7858Drop some info logging to DEBUG level in IPC, metrics, and HTTPTrivial.Todd LipconTodd Lipcon
HADOOP-7841Run tests with non-secure randomTrivialbuildTodd LipconTodd Lipcon
HADOOP-7804enable hadoop config generator to set dfs.block.local-path-access.user to enable short circuit readMajorconfArpit GuptaArpit Gupta
HADOOP-7792Common component for HDFS-2416: Add verifyToken method to AbstractDelegationTokenSecretManagerMajor.Jitendra Nath PandeyJitendra Nath Pandey
HADOOP-7777Implement a base class for DNSToSwitchMapping implementations that can offer extra topology informationMajorutilSteve LoughranSteve Loughran
HADOOP-7761Improve performance of raw comparisonsMajorio, performance, utilTodd LipconTodd Lipcon
HADOOP-7758Make GlobFilter class publicMajorfsAlejandro AbdelnurAlejandro Abdelnur
HADOOP-7736Remove duplicate call of Path#normalizePath during initialization.TrivialfsHarsh JHarsh J
HADOOP-7657Add support for LZ4 compressionMajor.Bert SandersBinglin Chang
HADOOP-7574Improvement for FSshell -statTrivialfsXieXianshanXieXianshan
HADOOP-7504hadoop-metrics.properties missing some Ganglia31 optionsTrivialmetricsEli CollinsHarsh J
HADOOP-7424Log an error if the topology script doesn't handle multiple argsMajor.Eli CollinsUma Maheswara Rao G
HADOOP-6886LocalFileSystem Needs createNonRecursive APIMinorfsNicolas SpiegelbergNicolas Spiegelberg
HADOOP-6840Support non-recursive create() in FileSystem & SequenceFile.WriterMinorfs, ioNicolas SpiegelbergNicolas Spiegelberg
HADOOP-6614RunJar should provide more diags when it can't create a temp fileMinorutilSteve LoughranJonathan Hsieh
HADOOP-4515conf.getBoolean must be case insensitiveMinor.Abhijit BagriSho Shimauchi
HDFS-3139Minor Datanode logging improvementMinordatanodeEli CollinsEli Collins
HDFS-2868Add number of active transfer threads to the DataNode statusMinordatanodeHarsh JHarsh J
HDFS-2826Test case for HDFS-1476 (safemode can initialize repl queues before exiting)Minornamenode, testTodd LipconTodd Lipcon
HDFS-2825Add test hook to turn off the writer preferring its local DNMinornamenodeTodd LipconTodd Lipcon
HDFS-2817Combine the two TestSafeMode test suitesMinortestTodd LipconTodd Lipcon
HDFS-2814NamenodeMXBean does not account for svn revision in the version informationMinor.Hitesh ShahHitesh Shah
HDFS-2803Adding logging to LeaseRenewer for better lease expiration triage.MinornamenodeJimmy XiangJimmy Xiang
HDFS-2788HdfsServerConstants#DN_KEEPALIVE_TIMEOUT is dead codeMajordatanodeEli CollinsEli Collins
HDFS-2761Improve Hadoop subcomponent integration in Hadoop 0.23Majorbuild, hdfs-client, scriptsRoman ShaposhnikRoman Shaposhnik
HDFS-2729Update BlockManager's comments regarding the invalid block setMinornamenodeHarsh JHarsh J
HDFS-2726“Exception in createBlockOutputStream” shouldn't delete exception stack traceMajor.Michael BieniosekHarsh J
HDFS-2675Reduce verbosity when double-closing edit logsTrivialnamenodeTodd LipconTodd Lipcon
HDFS-2654Make BlockReaderLocal not extend RemoteBlockReader2MajordatanodeEli CollinsEli Collins
HDFS-2653DFSClient should cache whether addrs are non-local when short-circuiting is enabledMajordatanodeEli CollinsEli Collins
HDFS-2604Add a log message to show if WebHDFS is enabledMinorwebhdfsTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-2570Add descriptions for dfs.*.https.address in hdfs-default.xmlTrivialdocumentationEli CollinsEli Collins
HDFS-2568Use a set to manage child sockets in XceiverServerTrivialdatanodeHarsh JHarsh J
HDFS-2566Move BPOfferService to be a non-inner classMinordatanodeTodd LipconTodd Lipcon
HDFS-2563Some cleanup in BPOfferServiceMajordatanodeTodd LipconTodd Lipcon
HDFS-2562Refactor DN configuration variables out of DataNode classMinordatanodeTodd LipconTodd Lipcon
HDFS-2560Refactor BPOfferService to be a static inner classMajordatanodeTodd LipconTodd Lipcon
HDFS-2536Remove unused importsTrivialnamenodeAaron T. MyersHarsh J
HDFS-2533Remove needless synchronization on FSDataSet.getBlockFileMinordatanode, performanceTodd LipconTodd Lipcon
HDFS-2511Add dev script to generate HDFS protobufsMinorbuildTodd LipconAlejandro Abdelnur
HDFS-2502hdfs-default.xml should include dfs.name.dir.restoreMinordocumentationEli CollinsHarsh J
HDFS-2454Move maxXceiverCount check to before starting the thread in dataXceiverMinordatanodeUma Maheswara Rao GHarsh J
HDFS-2397Undeprecate SecondaryNameNodeMajornamenodeTodd LipconEli Collins
HDFS-2349DN should log a WARN, not an INFO when it detects a corruption during block transferTrivialdatanodeHarsh JHarsh J
HDFS-2335DataNodeCluster and NNStorage always pull fresh entropyMajordatanode, namenodeEli CollinsUma Maheswara Rao G
HDFS-2246Shortcut a local client reads to a Datanodes files directlyMajor.Sanjay RadiaJitendra Nath Pandey
HDFS-2178HttpFS - a read/write Hadoop file system proxyMajor.Alejandro AbdelnurAlejandro Abdelnur
HDFS-2080Speed up DFS read path by lessening checksum overheadMajorhdfs-client, performanceTodd LipconTodd Lipcon
HDFS-554BlockInfo.ensureCapacity may get a speedup from System.arraycopy()MinornamenodeSteve LoughranHarsh J
HDFS-362FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array itemsMajornamenodeTsz Wo Nicholas SzeUma Maheswara Rao G
MAPREDUCE-3771Port MAPREDUCE-1735 to trunk/0.23Major.Arun C MurthyArun C Murthy
MAPREDUCE-3756Make single shuffle limit configurableMajormrv2Arun C MurthyHitesh Shah
MAPREDUCE-3693Add admin env to mapred-default.xmlMinormrv2Roman ShaposhnikRoman Shaposhnik
MAPREDUCE-3692yarn-resourcemanager out and log files can get bigBlockermrv2Eli CollinsEli Collins
MAPREDUCE-3679AM logs and others should not automatically refresh after every 1 second.Majormrv2Mahadev konarVinod Kumar Vavilapalli
MAPREDUCE-3610Some parts in MR use old property dfs.block.sizeMinor.Sho ShimauchiSho Shimauchi
MAPREDUCE-3597Provide a way to access other info of history file from RumentoolMajortools/rumenRavi GummadiRavi Gummadi
MAPREDUCE-3481[Gridmix] Improve STRESS mode lockingMajorcontrib/gridmixAmar KamatAmar Kamat
MAPREDUCE-3415improve MiniMRYarnCluster & DistributedShell JAR resolutionMajormrv2Alejandro AbdelnurAlejandro Abdelnur
MAPREDUCE-3411Performance Upgrade for jQueryMinormrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3371Review and improve the yarn-api javadocs.Minordocumentation, mrv2Ravi PrakashRavi Prakash
MAPREDUCE-3369Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169Majormrv1, mrv2, testAhmed RadwanAhmed Radwan
MAPREDUCE-3360Provide information about lost nodes in the UI.Criticalmrv2Bhallamudi Venkata Siva KameshBhallamudi Venkata Siva Kamesh
MAPREDUCE-3341Enhance logging of initalized queue limit valuesMajormrv2Anupam SethAnupam Seth
MAPREDUCE-3331Improvement to single node cluster setup documentation for 0.23Minormrv2Anupam SethAnupam Seth
MAPREDUCE-3325Improvements to CapacityScheduler docMajormrv2Thomas GravesThomas Graves
MAPREDUCE-3299Add AMInfo table to the AM job pageMinormrv2Siddharth SethJonathan Eagles
MAPREDUCE-3265Reduce log level on MR2 IPC construction, etcBlockermrv2Todd LipconArun C Murthy
MAPREDUCE-3238Small cleanup in SchedulerAppTrivialmrv2Todd LipconTodd Lipcon
MAPREDUCE-3169Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2Majormrv1, mrv2, testTodd LipconAhmed Radwan
MAPREDUCE-3147Handle leaf queues with the same name properlyMajormrv2Ravi PrakashRavi Prakash
MAPREDUCE-2863Support web-services for RM & NMBlockermrv2, nodemanager, resourcemanagerArun C MurthyThomas Graves

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-8055Distribution tar.gz does not contain etc/hadoop/core-site.xmlMajorbuildEric CharlesHarsh J
HADOOP-8054NPE with FilterFileSystemCriticalfsAmareshwari SriramadasuDaryn Sharp
HADOOP-8052Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's gmetad coreMajormetricsVarun KapoorVarun Kapoor
HADOOP-8018Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL: http://java.sun.com/javase/6/docs/api/package-listMajorbuild, testMatt FoleyJonathan Eagles
HADOOP-8012hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chow log/pid dirs which can failMinorscriptsRoman ShaposhnikRoman Shaposhnik
HADOOP-8006TestFSInputChecker is failing in trunk.MajorfsUma Maheswara Rao GDaryn Sharp
HADOOP-8002SecurityUtil acquired token message should be a debug rather than infoMajor.Arpit GuptaArpit Gupta
HADOOP-8001ChecksumFileSystem‘s rename doesn’t correctly handle checksum filesMajorfsDaryn SharpDaryn Sharp
HADOOP-8000fetchdt command not available in bin/hadoopCritical.Arpit GuptaArpit Gupta
HADOOP-7999“hadoop archive” fails with ClassNotFoundExceptionCriticalscriptsJason LoweJason Lowe
HADOOP-7998CheckFileSystem does not correctly honor setVerifyChecksumMajorfsDaryn SharpDaryn Sharp
HADOOP-7993Hadoop ignores old-style config options for enabling compressed outputMajorconfAnupam SethAnupam Seth
HADOOP-7988Upper case in hostname part of the principals doesn't work with kerberos.Major.Jitendra Nath PandeyJitendra Nath Pandey
HADOOP-7986Add config for History Server protocol in hadoop-policy for service level authorization.Major.Mahadev konarMahadev konar
HADOOP-7982UserGroupInformation fails to login if thread‘s context classloader can’t load HadoopLoginModuleMajorsecurityTodd LipconTodd Lipcon
HADOOP-7981Improve documentation for org.apache.hadoop.io.compress.Decompressor.getRemainingMajorioJonathan EaglesJonathan Eagles
HADOOP-7975Add entry to XML defaults for new LZ4 codecMinor.Harsh JHarsh J
HADOOP-7974TestViewFsTrash incorrectly determines the user's home directoryMajorfs, testEli CollinsHarsh J
HADOOP-7971hadoop <job/queue/pipes> removed - should be added back, but deprecatedBlocker.Thomas GravesPrashant Sharma
HADOOP-7964Deadlock in class init.Blockersecurity, utilKihwal LeeDaryn Sharp
HADOOP-7963test failures: TestViewFileSystemWithAuthorityLocalFileSystem and TestViewFileSystemLocalFileSystemBlocker.Thomas GravesSiddharth Seth
HADOOP-7949Updated maxIdleTime default in the code to match core-default.xmlTrivialipcEli CollinsEli Collins
HADOOP-7948Shell scripts created by hadoop-dist/pom.xml to build tar do not properly propagate failureMinorbuildMichajlo MatijkiwMichajlo Matijkiw
HADOOP-7936There's a Hoop README in the root dir of the tarballMajorbuildEli CollinsAlejandro Abdelnur
HADOOP-7933Viewfs changes for MAPREDUCE-3529CriticalviewfsSiddharth SethSiddharth Seth
HADOOP-7917compilation of protobuf files fails in windows/cygwinMajorbuildAlejandro AbdelnurAlejandro Abdelnur
HADOOP-7914duplicate declaration of hadoop-hdfs test-jarMajorbuildTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HADOOP-7912test-patch should run eclipse:eclipse to verify that it does not break againMajorbuildRobert Joseph EvansRobert Joseph Evans
HADOOP-7907hadoop-tools JARs are not part of the distroBlockerbuildAlejandro AbdelnurAlejandro Abdelnur
HADOOP-7902skipping name rules setting (if already set) should be done on UGI initialization onlyMajor.Tsz Wo Nicholas SzeAlejandro Abdelnur
HADOOP-7898Fix javadoc warnings in AuthenticationToken.javaMinorsecuritySuresh SrinivasSuresh Srinivas
HADOOP-7887KerberosAuthenticatorHandler is not setting KerberosName name rules from configurationCriticalsecurityAlejandro AbdelnurAlejandro Abdelnur
HADOOP-7878Regression HADOOP-7777 switch changes break HDFS tests when the isSingleSwitch() predicate is usedMinorutilSteve LoughranSteve Loughran
HADOOP-7870fix SequenceFile#createWriter with boolean createParent arg to respect createParent.Major.Jonathan HsiehJonathan Hsieh
HADOOP-7864Building mvn site with Maven < 3.0.2 causes OOM errorsMajorbuildAndrew BayerAndrew Bayer
HADOOP-7859TestViewFsHdfs.testgetFileLinkStatus is failing an assertMajorfsEli CollinsEli Collins
HADOOP-7854UGI getCurrentUser is not synchronizedCriticalsecurityDaryn SharpDaryn Sharp
HADOOP-7853multiple javax security configurations cause conflictsBlockersecurityDaryn SharpDaryn Sharp
HADOOP-7851Configuration.getClasses() never returns the default value.MajorconfAmar KamatUma Maheswara Rao G
HADOOP-7843compilation failing because workDir not initialized in RunJar.javaMajor.John GeorgeJohn George
HADOOP-7837no NullAppender in the log4j configMajorconfSteve LoughranEli Collins
HADOOP-7813test-patch +1 patches that introduce javadoc and findbugs warnings in some casesMajorbuild, testJonathan EaglesJonathan Eagles
HADOOP-7811TestUserGroupInformation#testGetServerSideGroups test fails in chrootMajorsecurity, testJonathan EaglesJonathan Eagles
HADOOP-7810move hadoop archive to core from toolsBlocker.John GeorgeJohn George
HADOOP-7802Hadoop scripts unconditionally source “$bin”/../libexec/hadoop-config.sh.Major.Bruno MahéBruno Mahé
HADOOP-7801HADOOP_PREFIX cannot be overridenMajorbuildBruno MahéBruno Mahé
HADOOP-7787Make source tarball use conventional name.MajorbuildBruno MahéBruno Mahé
HADOOP-6490Path.normalize should use StringUtils.replace in favor of String.replaceMinorfsZheng ShaoUma Maheswara Rao G
HDFS-2923Namenode IPC handler count uses the wrong configuration keyCriticalnamenodeTodd LipconTodd Lipcon
HDFS-2893The start/stop scripts don't start/stop the 2NN when using the default configurationMinor.Eli CollinsEli Collins
HDFS-2889getNumCurrentReplicas is package private but should be public on 0.23 (see HDFS-2408)Majorhdfs-clientGregory ChananGregory Chanan
HDFS-2869Error in Webhdfs documentation for mkdirMinorwebhdfsHarsh JHarsh J
HDFS-2840TestHostnameFilter should work with localhost or localhost.localdomainMajortestEli CollinsAlejandro Abdelnur
HDFS-2837mvn javadoc:javadoc not seeing LimitedPrivate classMajor.Robert Joseph EvansRobert Joseph Evans
HDFS-2836HttpFSServer still has 2 javadoc warnings in trunkMajor.Robert Joseph EvansRobert Joseph Evans
HDFS-2835Fix org.apache.hadoop.hdfs.tools.GetConf$Command Findbug issueMajortoolsRobert Joseph EvansRobert Joseph Evans
HDFS-2827Cannot save namespace after renaming a directory above a file with an open leaseMajornamenodeUma Maheswara Rao GUma Maheswara Rao G
HDFS-2822processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicatedMajorha, namenodeTodd LipconTodd Lipcon
HDFS-2818dfshealth.jsp missing space between role and node nameTrivialnamenodeTodd LipconDevaraj K
HDFS-2816Fix missing license header in hadoop-hdfs-project/hadoop-hdfs-httpfs/dev-support/findbugsExcludeFile.xmlTrivial.Hitesh ShahHitesh Shah
HDFS-2810Leases not properly getting renewed by clientsCriticalhdfs-clientTodd LipconTodd Lipcon
HDFS-2791If block report races with closing of file, replica is incorrectly marked corruptMajordatanode, namenodeTodd LipconTodd Lipcon
HDFS-2790FSNamesystem.setTimes throws exception with wrong configuration name in the messageMinor.Arpit GuptaArpit Gupta
HDFS-2751Datanode drops OS cache behind reads even for short readsMajordatanodeTodd LipconTodd Lipcon
HDFS-2722HttpFs shouldn't be using an int for block sizeMajorhdfs-clientHarsh JHarsh J
HDFS-2710HDFS part of MAPREDUCE-3529, HADOOP-7933Critical.Siddharth Seth
HDFS-2707HttpFS should read the hadoop-auth secret from a file instead inline from the configurationMajorsecurityAlejandro AbdelnurAlejandro Abdelnur
HDFS-2706Use configuration for blockInvalidateLimit if it is setMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-2705HttpFS server should check that upload requests have correct content-typeMajor.Alejandro AbdelnurAlejandro Abdelnur
HDFS-2658HttpFS introduced 70 javadoc warningsMajor.Eli CollinsAlejandro Abdelnur
HDFS-2657TestHttpFSServer and TestServerWebApp are failing on trunkMajor.Eli CollinsAlejandro Abdelnur
HDFS-2649eclipse:eclipse build fails for hadoop-hdfs-httpfsMajorbuildJason LoweJason Lowe
HDFS-2646Hadoop HttpFS introduced 4 findbug warnings.Major.Uma Maheswara Rao GAlejandro Abdelnur
HDFS-2640Javadoc generation hangsMajor.Tom WhiteTom White
HDFS-2614hadoop dist tarball is missing hdfs headersMajorbuildBruno MahéAlejandro Abdelnur
HDFS-2606webhdfs client filesystem impl must set the content-type header for create/appendCriticalwebhdfsAlejandro AbdelnurAlejandro Abdelnur
HDFS-2596TestDirectoryScanner doesn't test parallel scansMajordatanode, testEli CollinsEli Collins
HDFS-2594webhdfs HTTP API should implement getDelegationTokens() instead getDelegationToken()CriticalwebhdfsAlejandro AbdelnurTsz Wo Nicholas Sze
HDFS-2590Some links in WebHDFS forrest doc do not workMajorwebhdfsTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-2588hdfs jsp pages missing DOCTYPE [post-split branches]TrivialscriptsDave VronayDave Vronay
HDFS-2575DFSTestUtil may create empty filesMinortestTodd LipconTodd Lipcon
HDFS-2567When 0 DNs are available, show a proper error when trying to browse DFS via web UIMajornamenodeHarsh JHarsh J
HDFS-2553BlockPoolSliceScanner spinning in loopCriticaldatanodeTodd LipconUma Maheswara Rao G
HDFS-2545Webhdfs: Support multiple namenodes in federationMajorwebhdfsTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-2544Hadoop scripts unconditionally source “$bin”/../libexec/hadoop-config.sh.MajorscriptsBruno MahéBruno Mahé
HDFS-2543HADOOP_PREFIX cannot be overridenMajorscriptsBruno MahéBruno Mahé
HDFS-2541For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value.MajordatanodeHarsh JHarsh J
HDFS-1314dfs.blocksize accepts only absolute valueMinor.Karim SaadahSho Shimauchi
HDFS-442dfsthroughput in test.jar throws NPEMinortestRamya SunilHarsh J
HDFS-69Improve dfsadmin command line helpMinor.Ravi PhulariHarsh J
MAPREDUCE-3880Allow for 32-bit container-executorBlockerbuild, mrv2Arun C MurthyArun C Murthy
MAPREDUCE-3858Task attempt failure during commit results in task never completingCriticalmrv2Tom WhiteTom White
MAPREDUCE-3856Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm.Criticalmrv2Eric PayneEric Payne
MAPREDUCE-3843Job summary log file found missing on the RM hostCriticaljobhistoryserver, mrv2Anupam SethAnupam Seth
MAPREDUCE-3840JobEndNotifier doesn't use the proxyToUse during connectingBlockermrv2Ravi PrakashRavi Prakash
MAPREDUCE-3834If multiple hosts for a split belong to the same rack, the rack is added multiple times in the AM request tableCriticalmr-am, mrv2Siddharth SethSiddharth Seth
MAPREDUCE-3833Capacity scheduler queue refresh doesn't recompute queue capacities properlyMajormrv2Jason LoweJason Lowe
MAPREDUCE-3828Broken urls: AM tracking url and jobhistory url in a single node setup.Majormrv2Ahmed RadwanSiddharth Seth
MAPREDUCE-3826RM UI when loaded throws a message stating Data Tables warning and then the column sorting stops workingMajormrv2Arpit GuptaJonathan Eagles
MAPREDUCE-3822TestJobCounters is failing intermittently on trunk and 0.23.Criticalmrv2Mahadev konarMahadev konar
MAPREDUCE-3817bin/mapred command cannot run distcp and archive jobsMajormrv2Arpit GuptaArpit Gupta
MAPREDUCE-3814MR1 compile failsMajormrv1, mrv2Arun C MurthyArun C Murthy
MAPREDUCE-3808NPE in FileOutputCommitter when running a 0 reduce jobBlockermrv2Siddharth SethRobert Joseph Evans
MAPREDUCE-3804yarn webapp interface vulnerable to cross scripting attacksMajorjobhistoryserver, mrv2, resourcemanagerDave ThompsonDave Thompson
MAPREDUCE-3795“job -status” command line output is malformedMajormrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3794Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibilityMajormrv2Tom WhiteTom White
MAPREDUCE-3791can't build site in hadoop-yarn-server-commonMajordocumentation, mrv2Roman ShaposhnikMahadev konar
MAPREDUCE-3784maxActiveApplications(|PerUser) per queue is too low for small clustersMajormrv2Ramya SunilArun C Murthy
MAPREDUCE-3780RM assigns containers to killed applicationsBlockermrv2Ramya SunilHitesh Shah
MAPREDUCE-3775Change MiniYarnCluster to escape special chars in testnameMinormrv2Hitesh ShahHitesh Shah
MAPREDUCE-3774yarn-default.xml should be moved to hadoop-yarn-common.Majormrv2Mahadev konarMahadev konar
MAPREDUCE-3770[Rumen] Zombie.getJobConf() results into NPECriticaltools/rumenAmar KamatAmar Kamat
MAPREDUCE-3765FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb settingMinormrv2Hitesh ShahHitesh Shah
MAPREDUCE-3764AllocatedGB etc metrics incorrect if min-allocation-mb isn't a multiple of 1GBCriticalmrv2Siddharth SethArun C Murthy
MAPREDUCE-3762Resource Manager fails to come up with default capacity scheduler configs.Criticalmrv2Mahadev konarMahadev konar
MAPREDUCE-3760Blacklisted NMs should not appear in Active nodes listMajormrv2Ramya SunilVinod Kumar Vavilapalli
MAPREDUCE-3759ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodesMajormrv2Ramya SunilVinod Kumar Vavilapalli
MAPREDUCE-3754RM webapp should have pages filtered based on App-stateMajormrv2, webappsVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3752Headroom should be capped by queue max-capBlockermrv2Arun C MurthyArun C Murthy
MAPREDUCE-3749ConcurrentModificationException in counter groupsBlockermrv2Tom WhiteTom White
MAPREDUCE-3748Move CS related nodeUpdate log messages to DEBUGMinormrv2Ramya SunilRamya Sunil
MAPREDUCE-3747Memory Total is not refreshed until an app is launchedMajormrv2Ramya SunilArun C Murthy
MAPREDUCE-3744Unable to retrieve application logs via “yarn logs” or “mapred job -logs”Blockermrv2Jason LoweJason Lowe
MAPREDUCE-3742“yarn logs” command fails with ClassNotFoundExceptionBlockermrv2Jason LoweJason Lowe
MAPREDUCE-3737The Web Application Proxy's is not documented very wellCriticalmrv2Robert Joseph EvansRobert Joseph Evans
MAPREDUCE-3735Add distcp jar to the distribution (tar)Blockermrv2Mahadev konarMahadev konar
MAPREDUCE-3733Add Apache License Header to hadoop-distcp/pom.xmlMajor.Mahadev konarMahadev konar
MAPREDUCE-3732CS should only use ‘activeUsers with pending requests’ for computing user-limitsBlockermrv2, resourcemanager, schedulerArun C MurthyArun C Murthy
MAPREDUCE-3727jobtoken location property in jobconf refers to wrong jobtoken fileCriticalsecurityAlejandro AbdelnurAlejandro Abdelnur
MAPREDUCE-3723TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting testsMajormrv2, test, webappsBhallamudi Venkata Siva KameshBhallamudi Venkata Siva Kamesh
MAPREDUCE-3721Race in shuffle can cause it to hangBlockermrv2Siddharth SethSiddharth Seth
MAPREDUCE-3717JobClient test jar has missing files to run all the test programs.Blockermrv2Mahadev konarMahadev konar
MAPREDUCE-3716java.io.File.createTempFile fails in map/reduce tasksBlockermrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3714Reduce hangs in a corner caseBlockermrv2, taskVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3713Incorrect headroom reported to jobsBlockermrv2, resourcemanagerSiddharth SethArun C Murthy
MAPREDUCE-3712The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar.Blockermrv2Ravi PrakashMahadev konar
MAPREDUCE-3710last split generated by FileInputFormat.getSplits may not have the best localityMajormrv1, mrv2Siddharth SethSiddharth Seth
MAPREDUCE-3709TestDistributedShell is failingMajormrv2, testEli CollinsHitesh Shah
MAPREDUCE-3708Metrics: Incorrect Apps Submitted CountMajormrv2Bhallamudi Venkata Siva KameshBhallamudi Venkata Siva Kamesh
MAPREDUCE-3705ant build fails on 0.23 branchBlockermrv2Thomas GravesThomas Graves
MAPREDUCE-3703ResourceManager should provide node lists in JMX outputCriticalmrv2, resourcemanagerEric PayneEric Payne
MAPREDUCE-3702internal server error trying access application master via proxy with filter enabledCriticalmrv2Thomas GravesThomas Graves
MAPREDUCE-3701Delete HadoopYarnRPC from 0.23 branch.Majormrv2Mahadev konarMahadev konar
MAPREDUCE-3699Default RPC handlers are very low for YARN serversMajormrv2Vinod Kumar VavilapalliHitesh Shah
MAPREDUCE-3697Hadoop Counters API limits Oozie's working across different hadoop versionsBlockermrv2John GeorgeMahadev konar
MAPREDUCE-3696MR job via oozie does not work on hadoop 23Blockermrv2John GeorgeJohn George
MAPREDUCE-3691webservices add support to compress responseCriticalmrv2Thomas GravesThomas Graves
MAPREDUCE-3689RM web UI doesn't handle newline in job nameBlockermrv2Thomas GravesThomas Graves
MAPREDUCE-3684LocalDistributedCacheManager does not shut down its thread poolMajorclientTom WhiteTom White
MAPREDUCE-3683Capacity scheduler LeafQueues maximum capacity calculation issuesBlockermrv2Thomas GravesArun C Murthy
MAPREDUCE-3681capacity scheduler LeafQueues calculate used capacity wrongCriticalmrv2Thomas GravesArun C Murthy
MAPREDUCE-3669Getting a lot of PriviledgedActionException / SaslException when running a jobBlockermrv2Thomas GravesMahadev konar
MAPREDUCE-3664HDFS Federation Documentation has incorrect configuration exampleMinordocumentationpraveen sripatiBrandon Li
MAPREDUCE-3657State machine visualize build failsMinorbuild, mrv2Jason LoweJason Lowe
MAPREDUCE-3656Sort job on 350 scale is consistently failing with latest MRV2 codeBlockerapplicationmaster, mrv2, resourcemanagerKaram SinghSiddharth Seth
MAPREDUCE-3652org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization failsBlockermrv2Thomas GravesThomas Graves
MAPREDUCE-3651TestQueueManagerRefresh failsBlockermrv2Thomas GravesThomas Graves
MAPREDUCE-3649Job End notification gives an error on calling back.Blockermrv2Mahadev konarRavi Prakash
MAPREDUCE-3648TestJobConf failingBlockermrv2Thomas GravesThomas Graves
MAPREDUCE-3646Remove redundant URL info from “mapred job” outputMajorclient, mrv2Ramya SunilJonathan Eagles
MAPREDUCE-3645TestJobHistory failsBlockermrv1Thomas GravesThomas Graves
MAPREDUCE-3639TokenCache likely broken for FileSystems which don't issue delegation tokensBlockermrv2Siddharth SethSiddharth Seth
MAPREDUCE-3625CapacityScheduler web-ui display of queue's used capacity is brokenCriticalmrv2Arun C MurthyJason Lowe
MAPREDUCE-3624bin/yarn script adds jdk tools.jar to the classpath.Majormrv2Mahadev konarMahadev konar
MAPREDUCE-3617Remove yarn default values for resource manager and nodemanager principalMajormrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3615mapred ant test failuresBlockermrv2Thomas GravesThomas Graves
MAPREDUCE-3608MAPREDUCE-3522 commit causes compilation to failMajormrv2Mahadev konarMahadev konar
MAPREDUCE-3604Streaming's check for local mode is brokenBlockercontrib/streamingArun C MurthyArun C Murthy
MAPREDUCE-3596Sort benchmark got hang after completion of 99% map phaseBlockerapplicationmaster, mrv2Ravi PrakashVinod Kumar Vavilapalli
MAPREDUCE-3588bin/yarn broken after MAPREDUCE-3366Blocker.Arun C MurthyArun C Murthy
MAPREDUCE-3586Lots of AMs hanging around in PIG testingBlockermr-am, mrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3582Move successfully passing MR1 tests to MR2 maven tree.Majormrv2, testAhmed RadwanAhmed Radwan
MAPREDUCE-3579ConverterUtils should not include a port in a path for a URL with no portMajormrv2Aaron T. MyersAaron T. Myers
MAPREDUCE-3564TestStagingCleanup and TestJobEndNotifier are failing on trunk.Blockermrv2Mahadev konarSiddharth Seth
MAPREDUCE-3563LocalJobRunner doesn't handle Jobs using o.a.h.mapreduce.OutputCommitterMajormrv2Arun C MurthyArun C Murthy
MAPREDUCE-3560TestRMNodeTransitions is failing on trunkBlockermrv2, resourcemanager, testVinod Kumar VavilapalliSiddharth Seth
MAPREDUCE-3557MR1 test fail to compile because of missing hadoop-archives dependencyMajorbuildAlejandro AbdelnurAlejandro Abdelnur
MAPREDUCE-3549write api documentation for web service apis for RM, NM, mapreduce app master, and job history serverBlockermrv2Thomas GravesThomas Graves
MAPREDUCE-3544gridmix build is broken, requires hadoop-archives to be added as ivy dependencyMajorbuild, tools/rumenAlejandro AbdelnurAlejandro Abdelnur
MAPREDUCE-3542Support “FileSystemCounter” legacy counter group name for compatibilityMajor.Tom WhiteTom White
MAPREDUCE-3541Fix broken TestJobQueueClient testBlockermrv2Ravi PrakashRavi Prakash
MAPREDUCE-3537DefaultContainerExecutor has a race condn. with multiple concurrent containersBlocker.Arun C MurthyArun C Murthy
MAPREDUCE-3532When 0 is provided as port number in yarn.nodemanager.webapp.address, NMs webserver component picks up random port, NM keeps on Reporting 0 port to RMCriticalmrv2, nodemanagerKaram SinghBhallamudi Venkata Siva Kamesh
MAPREDUCE-3531Sometimes java.lang.IllegalArgumentException: Invalid key to HMAC computation in NODE_UPDATE also causing RM to stop schedulingBlockermrv2, resourcemanager, schedulerKaram SinghRobert Joseph Evans
MAPREDUCE-3530Sometimes NODE_UPDATE to the scheduler throws an NPE causing the scheduling to stopBlockermrv2, resourcemanager, schedulerKaram SinghArun C Murthy
MAPREDUCE-3529TokenCache does not cache viewfs credentials correctlyCriticalmrv2Siddharth SethSiddharth Seth
MAPREDUCE-3528The task timeout check interval should be configurable independent of mapreduce.task.timeoutMajormr-am, mrv2Siddharth SethSiddharth Seth
MAPREDUCE-3527Fix minor API incompatibilities between 1.0 and 0.23Major.Tom WhiteTom White
MAPREDUCE-3522Capacity Scheduler ACLs not inherited by defaultMajormrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3521Hadoop Streaming ignores unknown parametersMinormrv2Robert Joseph EvansRobert Joseph Evans
MAPREDUCE-3518mapred queue -info <queue> -showJobs throws NPECriticalclient, mrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3513Capacity Scheduler web UI has a spelling mistake for Memory.Trivialmrv2Mahadev konarchackaravarthy
MAPREDUCE-3510Capacity Scheduler inherited ACLs not displayed by mapred queue -showaclsMajorcapacity-sched, mrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3505yarn APPLICATION_CLASSPATH needs to be overridableMajormrv2Bruno MahéAhmed Radwan
MAPREDUCE-3500MRJobConfig creates an LD_LIBRARY_PATH using the platform ARCHMajormrv2Alejandro AbdelnurAlejandro Abdelnur
MAPREDUCE-3499New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not workBlockermrv2, testAlejandro AbdelnurJohn George
MAPREDUCE-3496Yarn initializes ACL operations from capacity scheduler config in a non-deterministic orderMajormrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3490RMContainerAllocator counts failed maps towards Reduce ramp upBlockermr-am, mrv2Siddharth SethSharad Agarwal
MAPREDUCE-3488Streaming jobs are failing because the main class isnt set in the pom files.Blockermrv2Mahadev konarMahadev konar
MAPREDUCE-3487jobhistory web ui task counters no longer links to singletakecounter pageCriticalmrv2Thomas GravesJason Lowe
MAPREDUCE-3484JobEndNotifier is getting interrupted before completing all its retries.Majormr-am, mrv2Ravi PrakashRavi Prakash
MAPREDUCE-3479JobClient#getJob cannot find local jobsMajorclientTom WhiteTom White
MAPREDUCE-3478Cannot build against ZooKeeper 3.4.0Minormrv2Andrew BayerTom White
MAPREDUCE-3477Hadoop site documentation cannot be built anymore on trunk and branch-0.23Majordocumentation, mrv2Bruno MahéJonathan Eagles
MAPREDUCE-3465org.apache.hadoop.yarn.util.TestLinuxResourceCalculatorPlugin fails on 0.23Minormrv2Hitesh ShahHitesh Shah
MAPREDUCE-3464mapreduce jsp pages missing DOCTYPE [post-split branches]Trivial.Dave VronayDave Vronay
MAPREDUCE-3463Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost jobBlockerapplicationmaster, mrv2Karam SinghSiddharth Seth
MAPREDUCE-3462Job submission failing in JUnit testsBlockermrv2, testAmar KamatRavi Prakash
MAPREDUCE-3460MR AM can hang if containers are allocated on a node blacklisted by the AMBlockermr-am, mrv2Siddharth SethRobert Joseph Evans
MAPREDUCE-3458Fix findbugs warnings in hadoop-examplesMajormrv2Arun C MurthyDevaraj K
MAPREDUCE-3456$HADOOP_PREFIX/bin/yarn should set defaults for $HADOOP_*_HOMEBlockermrv2Eric PayneEric Payne
MAPREDUCE-3454[Gridmix] TestDistCacheEmulation is brokenMajorcontrib/gridmixAmar KamatHitesh Shah
MAPREDUCE-3453RM web ui application details page shows RM cluster about informationMajormrv2Thomas GravesJonathan Eagles
MAPREDUCE-3452fifoscheduler web ui page always shows 0% used for the queueMajormrv2Thomas GravesJonathan Eagles
MAPREDUCE-3450NM port info no longer available in JobHistoryMajormr-am, mrv2Siddharth SethSiddharth Seth
MAPREDUCE-3448TestCombineOutputCollector javac unchecked warning on mocked genericsMinormrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3447mapreduce examples not workingBlockermrv2Thomas GravesMahadev konar
MAPREDUCE-3444trunk/0.23 builds brokenBlockermrv2Hitesh ShahHitesh Shah
MAPREDUCE-3443Oozie jobs are running as oozie user even though they create the jobclient as doAs.Blockermrv2Mahadev konarMahadev konar
MAPREDUCE-3437Branch 23 fails to build with Failure to find org.apache.hadoop:hadoop-project:pom:0.24.0-SNAPSHOTBlockerbuild, mrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3436JobHistory webapp address should use the host from the jobhistory addressMajormrv2, webappsBruno MahéAhmed Radwan
MAPREDUCE-3434Nightly build brokenBlockermrv2Hitesh ShahHitesh Shah
MAPREDUCE-3427streaming tests fail with MR2Blockercontrib/streaming, mrv2Alejandro AbdelnurHitesh Shah
MAPREDUCE-3422Counter display names are not being picked upMajormrv2Tom WhiteJonathan Eagles
MAPREDUCE-3420[Umbrella ticket] Make uber jobs functionalMajormrv2Hitesh Shah
MAPREDUCE-3417job access controls not working app master and job history UI'sBlockermrv2Thomas GravesJonathan Eagles
MAPREDUCE-3413RM web ui applications not sorted in any order by defaultMinormrv2Jonathan EaglesJonathan Eagles
MAPREDUCE-3412‘ant docs’ is brokenMajor.Amar KamatAmar Kamat
MAPREDUCE-3408yarn-daemon.sh unconditionnaly sets yarn.root.loggerMajormrv2, nodemanager, resourcemanagerBruno MahéBruno Mahé
MAPREDUCE-3407Wrong jar getting used in TestMR*Jobs* for MiniMRYarnClusterMinormrv2Hitesh ShahHitesh Shah
MAPREDUCE-3404Speculative Execution: speculative map tasks launched even if -Dmapreduce.map.speculative=falseCriticaljob submission, mrv2patrick whiteEric Payne
MAPREDUCE-3398Log Aggregation broken in Secure ModeBlockermrv2, nodemanagerSiddharth SethSiddharth Seth
MAPREDUCE-3391Connecting to CM is logged as Connecting to RMMinorapplicationmasterSubroto SanyalSubroto Sanyal
MAPREDUCE-3389MRApps loads the ‘mrapp-generated-classpath’ file with classpath from the build machineCriticalmrv2Alejandro AbdelnurAlejandro Abdelnur
MAPREDUCE-3387A tracking URL of N/A before the app master is launched breaks oozieCriticalmrv2Robert Joseph EvansRobert Joseph Evans
MAPREDUCE-3382Network ACLs can prevent AMs to ping the Job-end notification URLCriticalapplicationmaster, mrv2Vinod Kumar VavilapalliRavi Prakash
MAPREDUCE-3379LocalResourceTracker should not tracking deleted cache entriesMajormrv2, nodemanagerSiddharth SethSiddharth Seth
MAPREDUCE-3376Old mapred API combiner uses NULL reporterMajormrv1, mrv2Robert Joseph EvansSubroto Sanyal
MAPREDUCE-3373Hadoop scripts unconditionally source “$bin”/../libexec/hadoop-config.sh.Major.Bruno MahéBruno Mahé
MAPREDUCE-3372HADOOP_PREFIX cannot be overridenMajor.Bruno MahéBruno Mahé
MAPREDUCE-3370MiniMRYarnCluster uses a hard coded path location for the MapReduce application jarMajormrv2, testAhmed RadwanAhmed Radwan
MAPREDUCE-3368compile-mapred-test failsCriticalbuild, mrv2Ramya SunilHitesh Shah
MAPREDUCE-3366Mapreduce component should use consistent directory structure layout as HDFS/commonMajormrv2Eric YangEric Yang
MAPREDUCE-3355AM scheduling hangs frequently with sort job on 350 nodesBlockerapplicationmaster, mrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3354JobHistoryServer should be started by bin/mapred and not by bin/yarnBlockerjobhistoryserver, mrv2Vinod Kumar VavilapalliJonathan Eagles
MAPREDUCE-3349No rack-name logged in JobHistory for unsuccessful tasksBlockermrv2Vinod Kumar VavilapalliAmar Kamat
MAPREDUCE-3346Rumen LoggedTaskAttempt getHostName call returns hostname as nullBlockertools/rumenKaram SinghAmar Kamat
MAPREDUCE-3345Race condition in ResourceManager causing TestContainerManagerSecurity to fail sometimesMajormrv2, resourcemanagerVinod Kumar VavilapalliHitesh Shah
MAPREDUCE-3344o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIteratorMajor.Brock NolandBrock Noland
MAPREDUCE-3342JobHistoryServer doesn't show job queueCriticaljobhistoryserver, mrv2Thomas GravesJonathan Eagles
MAPREDUCE-3339Job is getting hanged indefinitely,if the child processes are killed on the NM. KILL_CONTAINER eventtype is continuosly sent to the containers that are not existingBlockermrv2Ramgopal NSiddharth Seth
MAPREDUCE-3336com.google.inject.internal.Preconditions not public api - shouldn't be using itCriticalmrv2Thomas GravesThomas Graves
MAPREDUCE-3333MR AM for sort-job going out of memoryBlockerapplicationmaster, mrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3329capacity schedule maximum-capacity allowed to be less then capacityBlockermrv2Thomas GravesArun C Murthy
MAPREDUCE-3328mapred queue -list output inconsistent and missing child queuesCriticalmrv2Thomas GravesRavi Prakash
MAPREDUCE-3327RM web ui scheduler link doesn't show correct max value for queuesCriticalmrv2Thomas GravesAnupam Seth
MAPREDUCE-3326RM web UI scheduler link not as useful as should beCriticalmrv2Thomas GravesJason Lowe
MAPREDUCE-3324Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI serversCriticaljobhistoryserver, mrv2, nodemanagerJonathan EaglesJonathan Eagles
MAPREDUCE-3312Make MR AM not send a stopContainer w/o corresponding start containerMajormrv2Robert Joseph EvansRobert Joseph Evans
MAPREDUCE-3291App fail to launch due to delegation token not found in cacheBlockermrv2Ramya SunilRobert Joseph Evans
MAPREDUCE-3280MR AM should not read the username from configurationMajorapplicationmaster, mrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3243Invalid tracking URL for streaming jobsMajorcontrib/streaming, mrv2Ramya SunilJonathan Eagles
MAPREDUCE-3194“mapred mradmin” command is broken in mrv2Majormrv2Siddharth SethJason Lowe
MAPREDUCE-3121DFIP aka ‘NodeManager should handle Disk-Failures In Place’Blockermrv2, nodemanagerVinod Kumar VavilapalliRavi Gummadi
MAPREDUCE-3045Elapsed time filter on jobhistory server displays incorrect table entriesMinorjobhistoryserver, mrv2Ramya SunilJonathan Eagles
MAPREDUCE-2950[Gridmix] TestUserResolve fails in trunkMajorcontrib/gridmixAmar KamatRavi Gummadi
MAPREDUCE-2784[Gridmix] TestGridmixSummary fails with NPE when run in DEBUG mode.Majorcontrib/gridmixAmar KamatAmar Kamat
MAPREDUCE-2450Calls from running tasks to TaskTracker methods sometimes fail and incur a 60s timeoutMajor.Matei ZahariaRajesh Balamohan
MAPREDUCE-1744DistributedCache creates its own FileSytem instance when adding a file/archive to the pathMajor.Dick KingDick King

TESTS:

JIRASummaryPriorityComponentReporterContributor
MAPREDUCE-3854Reinstate environment variable tests in TestMiniMRChildTaskMajormrv2Tom WhiteTom White
MAPREDUCE-3803HDFS-2864 broke ant compilationMajorbuildRavi PrakashRavi Prakash
MAPREDUCE-3595Add missing TestCounters#testCounterValue test from branch 1 to 0.23MajortestTom WhiteTom White

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7590Mavenize streaming and MR examplesMajorbuildAlejandro AbdelnurAlejandro Abdelnur
HDFS-2879Change FSDataset to package privateMajordatanodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-2864Remove redundant methods and a constant from FSDatasetMajordatanodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-2786Fix host-based token incompatibilities in DFSUtilMajornamenode, securityDaryn SharpKihwal Lee
HDFS-2785Update webhdfs and httpfs for host-based token supportMajorwebhdfsDaryn SharpRobert Joseph Evans
HDFS-2784Update hftp and hdfs for host-based token supportMajorhdfs-client, namenode, securityDaryn SharpKihwal Lee
HDFS-2130Switch default checksum to CRC32CMajorhdfs-clientTodd LipconTodd Lipcon
HDFS-2129Simplify BlockReader to not inherit from FSInputCheckerMajorhdfs-client, performanceTodd LipconTodd Lipcon
MAPREDUCE-3846Restarted+Recovered AM hangs in some corner casesCriticalmrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3827Counters aggregation slowed down significantly after MAPREDUCE-3749Blockermrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3823Counters are getting calculated twice at job-finish and delaying clients.Majormrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3815Data Locality suffers if the AM asks for containers using IPs instead of hostnamesCriticalmrv2Siddharth SethSiddharth Seth
MAPREDUCE-3813RackResolver should maintain a cache to avoid repetitive lookups.Majormrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3810MR AM's ContainerAllocator is assigning the allocated containers very slowlyBlockermrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3809Tasks may take upto 3 seconds to exit after completionBlockermrv2Siddharth SethSiddharth Seth
MAPREDUCE-3802If an MR AM dies twice it looks like the process freezesCriticalapplicationmaster, mrv2Robert Joseph EvansVinod Kumar Vavilapalli
MAPREDUCE-3718Default AM heartbeat interval should be one secondMajormrv2, performanceVinod Kumar VavilapalliHitesh Shah
MAPREDUCE-3711AppMaster recovery for Medium to large jobs take long timeBlockermrv2Siddharth SethRobert Joseph Evans
MAPREDUCE-3698Client cannot talk to the history server in secure modeBlockermrv2Siddharth SethMahadev konar
MAPREDUCE-3641CapacityScheduler should be more conservative assigning off-switch requestsBlockermrv2, schedulerArun C MurthyArun C Murthy
MAPREDUCE-3640AMRecovery should pick completed task form partial JobHistory filesBlockermrv2Siddharth SethArun C Murthy
MAPREDUCE-3618TaskHeartbeatHandler holds a global lock for all task-updatesMajormrv2, performanceSiddharth SethSiddharth Seth
MAPREDUCE-3616Thread pool for launching containers in MR AM not expanding as expectedMajormr-am, mrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3572MR AM's dispatcher is blocked by heartbeats to ResourceManagerCriticalmr-am, mrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3569TaskAttemptListener holds a global lock for all task-updatesCriticalmr-am, mrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3568Optimize Job's progress calculations in MR AMCriticalmr-am, mrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3567Extraneous JobConf objects in AM heapMajormr-am, mrv2, performanceVinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3566MR AM slows down due to repeatedly constructing ContainerLaunchContextCriticalmr-am, mrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3553Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSONMinormrv2Thomas GravesThomas Graves
MAPREDUCE-3548write unit tests for web services for mapreduce app master and job history serverCriticalmrv2Thomas GravesThomas Graves
MAPREDUCE-3547finish unit tests for web services for RM and NMCriticalmrv2Thomas GravesThomas Graves
MAPREDUCE-3534Compression benchmark run-time increased by 13% in 0.23Blockermrv2Vinay Kumar ThotaVinod Kumar Vavilapalli
MAPREDUCE-3525Shuffle benchmark is nearly 1.5x slower in 0.23Blockermrv2Karam SinghVinod Kumar Vavilapalli
MAPREDUCE-3519Deadlock in LocalDirsHandlerService and ShuffleHandlerBlockermrv2, nodemanagerRavi GummadiRavi Gummadi
MAPREDUCE-3512Batch jobHistory disk flushesBlockermr-am, mrv2Siddharth SethSiddharth Seth
MAPREDUCE-3511Counters occupy a good part of AM heapBlockermr-am, mrv2Siddharth SethVinod Kumar Vavilapalli
MAPREDUCE-3485DISKS_FAILED -101 error code should be defined in same location as ABORTED_CONTAINER_EXIT_STATUSMajormrv2Hitesh ShahRavi Gummadi
MAPREDUCE-3433Finding counters by legacy group name returns empty countersMajorclient, mrv2Tom WhiteTom White
MAPREDUCE-3426uber-jobs tried to write outputs into wrong dirBlockermrv2Hitesh ShahHitesh Shah
MAPREDUCE-3402AMScalability test of Sleep job with 100K 1-sec maps regressed into running very slowlyBlockerapplicationmaster, mrv2Vinod Kumar VavilapalliVinod Kumar Vavilapalli
MAPREDUCE-3399ContainerLocalizer should request new resources after completing the current oneBlockermrv2, nodemanagerSiddharth SethSiddharth Seth
MAPREDUCE-3392Cluster.getDelegationToken() throws NPE if client.getDelegationToken() returns null.Blocker.John GeorgeJohn George
MAPREDUCE-3380Token infrastructure for running clients which are not kerberos authenticatedBlockermr-am, mrv2Alejandro AbdelnurMahadev konar
MAPREDUCE-3221ant test TestSubmitJob failing on trunkMinormrv2, testHitesh ShahDevaraj K
MAPREDUCE-3219ant test TestDelegationToken failing on trunkMinormrv2, testHitesh ShahHitesh Shah
MAPREDUCE-3217ant test TestAuditLogger fails on trunkMinormrv2, testHitesh ShahDevaraj K
MAPREDUCE-3215org.apache.hadoop.mapreduce.TestNoJobSetupCleanup failing on trunkMinormrv2Hitesh ShahHitesh Shah
MAPREDUCE-3102NodeManager should fail fast with wrong configuration or permissions for LinuxContainerExecutorMajormrv2, securityVinod Kumar VavilapalliHitesh Shah

OTHER:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7877Federation: update Balancer documentationMajordocumentationTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-2587Add WebHDFS apt docMajorwebhdfsTsz Wo Nicholas SzeTsz Wo Nicholas Sze
HDFS-2574remove references to deprecated properties in hdfs-site.xml template and hdfs-default.xmlTrivialdocumentationJoe CrobakJoe Crobak
HDFS-2552Add WebHdfs Forrest docMajorwebhdfsTsz Wo Nicholas SzeTsz Wo Nicholas Sze
MAPREDUCE-3811Make the Client-AM IPC retry count configurableCriticalmrv2Siddharth SethSiddharth Seth
MAPREDUCE-3630NullPointerException running teragenCriticalmrv2Amol KekreMahadev konar
MAPREDUCE-3468Change version to 0.23.1 for ant builds on the 23 branchMajor.Siddharth SethSiddharth Seth
MAPREDUCE-3375Memory Emulation system tests.Major.Vinay Kumar ThotaVinay Kumar Thota
MAPREDUCE-3297Move Log Related components from yarn-server-nodemanager to yarn-commonMajormrv2Siddharth SethSiddharth Seth
MAPREDUCE-3251Network ACLs can prevent some clients to talk to MR ApplicationMasterCriticalmrv2Anupam SethAnupam Seth
MAPREDUCE-2733Gridmix v3 cpu emulation system tests.Major.Vinay Kumar ThotaVinay Kumar Thota