Apache Hadoop Changelog

Release 0.22.1 - Unreleased (as of 2016-03-04)

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-6453Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATHMinorscriptsChad Metcalf

IMPORTANT ISSUES:

JIRASummaryPriorityComponentReporterContributor

NEW FEATURES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7937Forward port SequenceFile#syncFs and friends from Hadoop 1.xMajorioEli CollinsTom White
HADOOP-7119add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consolesMajorsecurityAlejandro AbdelnurAlejandro Abdelnur
MAPREDUCE-3837Job tracker is not able to recover job in case of crash and after that no user can submit job.Major.Mayank BansalMayank Bansal

IMPROVEMENTS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7338LocalDirAllocator improvements for MR-2178Major.Todd LipconBenoy Antony
HADOOP-7272Remove unnecessary security related info logsMajoripc, securitySuresh SrinivasSuresh Srinivas
HADOOP-6995Allow wildcards to be used in ProxyUsers configurationsMinorsecurityTodd LipconTodd Lipcon
HDFS-2246Shortcut a local client reads to a Datanodes files directlyMajor.Sanjay RadiaJitendra Nath Pandey
HDFS-1601Pipeline ACKs are sent as lots of tiny TCP packetsMajordatanodeTodd LipconTodd Lipcon
MAPREDUCE-4405Adding test case for HierarchicalQueue in TestJobQueueClientMinorclientMayank BansalMayank Bansal
MAPREDUCE-4403Adding test case for resubmission of jobs in TestRecoveryManagerMinorjobtrackerMayank BansalMayank Bansal
MAPREDUCE-4349Distributed Cache gives inconsistent result if cache Archive files get deleted from task trackerMinor.Mayank BansalMayank Bansal
MAPREDUCE-2353Make the MR changes to reflect the API changes in SecureIO libraryMajorsecurity, task, tasktrackerDevaraj DasBenoy Antony
MAPREDUCE-1521Protection against incorrectly configured reducesMajorjobtrackerArun C MurthyMahadev konar

BUG FIXES:

JIRASummaryPriorityComponentReporterContributor
HADOOP-7680TestHardLink fails on Mac OS X, when gnu stat is in pathMajor.Milind BhandarkarMilind Bhandarkar
HADOOP-7621alfredo config should be in a file not readable by usersCriticalsecurityAlejandro AbdelnurAaron T. Myers
HADOOP-7115Add a cache for getpwuid_r and getpwgid_r callsMajor.Arun C MurthyAlejandro Abdelnur
HDFS-3402Fix hdfs scripts for secure datanodesMinorscripts, securityBenoy AntonyBenoy Antony
HDFS-3368Missing blocks due to bad DataNodes coming up and down.MajornamenodeKonstantin ShvachkoKonstantin Shvachko
HDFS-2991failure to load edits: ClassCastExceptionBlockernamenodeTodd LipconTodd Lipcon
HDFS-2877If locking of a storage dir fails, it will remove the other NN's lock file on exitMajornamenodeTodd LipconTodd Lipcon
HDFS-2718Optimize OP_ADD in edits loadingMajornamenodeKonstantin ShvachkoKonstantin Shvachko
HDFS-2698BackupNode is downloading image from NameNode for every checkpointMajornamenodeKonstantin ShvachkoKonstantin Shvachko
HDFS-1910when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every timeMinornamenodeGokul
HDFS-1584Need to check TGT and renew if needed when fetching delegation tokens using HFTPMajorsecurityKan ZhangBenoy Antony
MAPREDUCE-5706toBeDeleted parent directories aren't being cleaned upMajorsecurityRobert KanterRobert Kanter
MAPREDUCE-4404Adding Test case for TestMRJobClient to verify the user nameMinorclientMayank BansalMayank Bansal
MAPREDUCE-4360Capacity Scheduler Hierarchical leaf queue does not honor the max capacity of container queueMajor.Mayank BansalMayank Bansal
MAPREDUCE-4318TestRecoveryManager should not use raw and deprecated configuration parameters.MajortestKonstantin ShvachkoBenoy Antony
MAPREDUCE-4314Synchronization in JvmManager for 0.22 branchMajortasktrackerKonstantin ShvachkoBenoy Antony
MAPREDUCE-4164Hadoop 22 Exception thrown after task completion causes its reexecutionMajortasktrackerMayank BansalMayank Bansal
MAPREDUCE-38630.22 branch mvn deploy is not publishing hadoop-streaming JARCriticalbuildAlejandro AbdelnurBenoy Antony
MAPREDUCE-3725Hadoop 22 hadoop job -list returns user name as NULLMajorclientMayank BansalMayank Bansal
MAPREDUCE-3593MAPREDUCE Impersonation is not working in 22Majorjob submissionMayank BansalMayank Bansal
MAPREDUCE-2452Delegation token cancellation shouldn't hold global JobTracker lockMajorjobtrackerDevaraj DasDevaraj Das
MAPREDUCE-2420JobTracker should be able to renew delegation token over HTTPMajor.Boris ShkolnikBoris Shkolnik
MAPREDUCE-2377task-controller fails to parse configuration if it doesn't end in \nMajortask-controllerTodd LipconBenoy Antony
MAPREDUCE-2178Race condition in LinuxTaskController permissions handlingMajorsecurity, task-controllerTodd LipconBenoy Antony

TESTS:

JIRASummaryPriorityComponentReporterContributor

SUB-TASKS:

JIRASummaryPriorityComponentReporterContributor
HADOOP-8383TestKerberosAuthenticator failsMinorsecurityBenoy AntonyBenoy Antony
HADOOP-8381Substitute _HOST with hostname for HTTP principalsMinorsecurityBenoy AntonyBenoy Antony
HDFS-2886CreateEditLogs should generate a realistic edit log.MajornamenodeKonstantin ShvachkoKonstantin Shvachko

OTHER:

JIRASummaryPriorityComponentReporterContributor
HADOOP-8357Restore security in Hadoop 0.22 branchMajorsecurityKonstantin ShvachkoBenoy Antony
MAPREDUCE-4249Fix failures in streaming test TestFileArgsMinorsecurityBenoy AntonyBenoy Antony
MAPREDUCE-4248TestRecoveryManager failsMinorsecurityBenoy AntonyBenoy Antony
MAPREDUCE-4247TestTaskTrackerLocalization failsMinorsecurityBenoy AntonyBenoy Antony
MAPREDUCE-4246Failure in deleting user directories in Secure hadoopMajorsecurityBenoy AntonyBenoy Antony
MAPREDUCE-4244Fix an issue related to do with setting of correct groups for tasksMinorsecurityBenoy AntonyBenoy Antony
MAPREDUCE-4243Modify mapreduce build to include task-controllerMinorbuildBenoy AntonyBenoy Antony
MAPREDUCE-4240Revert MAPREDUCE-2767MinorsecurityBenoy AntonyBenoy Antony