Apache Hadoop Changelog

Release 2.6.3 - 2015-12-17

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-12413AccessControlList should avoid calling getGroupNames in isUserInList with empty groups.Majorsecurityzhihai xuzhihai xu
HDFS-9434Recommission a datanode with 500k blocks may pause NN for 30 secondsMajornamenodeTsz Wo Nicholas SzeTsz Wo Nicholas Sze

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-12577Bump up commons-collections version to 3.2.2 to address a security flawBlockerbuild, securityWei-Chiu ChuangWei-Chiu Chuang
HADOOP-12526[Branch-2] there are duplicate dependency definitions in pom'sMajorbuildSangjin LeeSangjin Lee
HADOOP-12230hadoop-project declares duplicate, conflicting curator dependenciesMinorbuildSteve LoughranRakesh R
HADOOP-11267TestSecurityUtil fails when run with JDK8 because of empty principal namesMinorsecurity, testStephen ChuStephen Chu
HADOOP-10134[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc commentsMinor.Andrew PurtellAndrew Purtell
HADOOP-9242Duplicate surefire plugin config in hadoop-commonMajortestAndrey KlochkovAndrey Klochkov
HDFS-9470Encryption zone on root not loaded from fsimage after NN restartCritical.Xiao ChenXiao Chen
HDFS-9431DistributedFileSystem#concat fails if the target path is relative.Majorhdfs-clientKazuho FujiiKazuho Fujii
HDFS-9289Make DataStreamer#block thread safe and verify genStamp in commitBlockCritical.Chang LiChang Li
HDFS-9273ACLs on root directory may be lost after NN restartCriticalnamenodeXiao ChenXiao Chen
HDFS-9083Replication violates block placement policy.BlockernamenodeRushabh S ShahRushabh S Shah
HDFS-8615Correct HTTP method in WebHDFS documentMajordocumentationAkira AJISAKABrahma Reddy Battula
MAPREDUCE-6549multibyte delimiters with LineRecordReader cause duplicate recordsMajormrv1, mrv2Dustin CoteWilfred Spiegelenburg
MAPREDUCE-6540TestMRTimelineEventHandling failsMajortestSangjin LeeSangjin Lee
MAPREDUCE-6528Memory leak for HistoryFileManager.getJobSummary()CriticaljobhistoryserverJunping DuJunping Du
MAPREDUCE-6481LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.Criticalmrv2zhihai xuzhihai xu
MAPREDUCE-6377JHS sorting on state column not working in webUiMinorjobhistoryserverBibin A Chundattzhihai xu
MAPREDUCE-6273HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED stateMinorjobhistoryserverzhihai xuzhihai xu
MAPREDUCE-5948org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters wellCritical.Kris GeusebroekAkira AJISAKA
MAPREDUCE-5883“Total megabyte-seconds” in job counters is slightly misleadingMinor.Nathan RobertsNathan Roberts
YARN-4434NodeManager Disk Checker parameter documentation is not correctMinordocumentation, nodemanagerTakashi OhnishiWeiwei Yang
YARN-4424Fix deadlock in RMAppImplBlocker.Yesha VoraJian He
YARN-4365FileSystemNodeLabelStore should check for root dir existence on startupMajorresourcemanagerJason LoweKuhu Shukla
YARN-4348ZKRMStateStore.syncInternal shouldn‘t wait for sync completion for avoiding blocking ZK’s event threadBlocker.Tsuyoshi OzawaTsuyoshi Ozawa
YARN-4344NMs reconnecting with changed capabilities can lead to wrong cluster resource calculationsCriticalresourcemanagerVarun VasudevVarun Vasudev
YARN-4326Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188Major.MENG DINGMENG DING
YARN-4320TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188Major.Varun SaxenaVarun Saxena
YARN-4312TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time outMajor.Varun SaxenaVarun Saxena
YARN-4241Fix typo of property name in yarn-default.xmlMajordocumentationAnthony RojasAnthony Rojas
YARN-3925ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.Criticalnodemanagerzhihai xuzhihai xu
YARN-3878AsyncDispatcher can hang while stopping if it is configured for draining events on stopCritical.Varun SaxenaVarun Saxena
YARN-2859ApplicationHistoryServer binds to default port 8188 in MiniYARNClusterCriticaltimelineserverHitesh ShahVinod Kumar Vavilapalli

TESTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-10668TestZKFailoverControllerStress#testExpireBackAndForth occasionally failsMajortestTed YuMing Ma

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor

OTHER:

JIRASummaryPriorityComponentReporterContributor