HBASE Changelog

Release 2.2.4 - Unreleased (as of 2020-03-11)

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-23710Priority configuration for system coprocessorsMajorCoprocessors

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-22827Expose multi-region merge in shell and Admin APIMajorAdmin, shell
HBASE-23864No need to submit SplitTableRegionProcedure/MergeTableRegionsProcedure when split/merge is disabledMajor.
HBASE-23859Modify “Block locality” of RegionServer Web UI to human readable percentageTrivial.
HBASE-23802Remove unnecessary Configuration instantiation in LossyAccountingMinormetrics
HBASE-23822Fix typo in procedures.jspTrivialwebsite
HBASE-23686Revert binary incompatible change and remove reflectionMajor.
HBASE-23683Make HBaseInterClusterReplicationEndpoint more extensibleMajorReplication
HBASE-23646Fix remaining Checkstyle violations in tests of hbase-restMinor.
HBASE-23674Too many rit page Numbers show confusionTrivialmaster
HBASE-23383[hbck2] `fixHoles` should queue assignment procedures for any regions its fixingMinorhbck2, master, Region Assignment
HBASE-23165[hbtop] Some modifications from HBASE-22988Minor.

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-23953SimpleBalancer bug when second pass to fill up to minMajorBalancer
HBASE-23954SplitParent region should not be balancedMajorBalancer
HBASE-23944The method setClusterLoad of SimpleLoadBalancer is incorrect when balance by tableMajorBalancer
HBASE-23909list_regions fails if table is under splitMinorshell
HBASE-23892SecureTestCluster should allow its subclasses to pass their Class reference on HBaseKerberosUtils.setSSLConfigurationMajor.
HBASE-23809The RSGroup shell test is missingMajorrsgroup, test
HBASE-17115HMaster/HRegion Info Server does not honour admin.aclMajor.
HBASE-23737[Flakey Tests] TestFavoredNodeTableImport fails 30% of the timeMajor.
HBASE-23733[Flakey Tests] TestSplitTransactionOnClusterMajorflakies
HBASE-23701Make sure HBaseClassTestRule doesn't suffer same issue as HBaseClassTestRuleCheckerMinor.
HBASE-23695Fail more gracefully when test class is missing CategoryMinor.
HBASE-23677region.jsp returns 500/NPE when provided encoded region name is not onlineMinorregionserver, UI
HBASE-23679FileSystem instance leaks due to bulk loads with Kerberos enabledCritical.
HBASE-21345[hbck2] Allow version check to proceed even though master is ‘initializing’.Majorhbck2

TESTS:

JIRASummaryPriorityComponent
HBASE-23808[Flakey Test] TestMasterShutdown#testMasterShutdownBeforeStartingAnyRegionServerMajortest
HBASE-23793Increase maven heap allocation to 4G in Yetus personalityMajorbuild, test
HBASE-23792[Flakey Test] TestExportSnapshotNoCluster.testSnapshotWithRefsExportFileSystemStateMajortest
HBASE-23749TestHFileWriterV3 should have tests for all data block encodingsMajor.
HBASE-23711Add test for MinVersions and KeepDeletedCells TTLMinor.
HBASE-23569Validate that the log cleaner actually cleans oldWALs as expectedMajorintegration tests, master, test

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-23755[OpenTracing] Declare HTrace is unusable in the user docMajor.
HBASE-23748Include HBASE-21284 to branch-2.2Major.
HBASE-23773Backport “HBASE-23601 OutputSink.WriterThread exception gets stuck and repeated indefinietly” to branch-2.2Major.
HBASE-23728Include HBASE-21018 in 2.2 & 2.3Major.
HBASE-23727Port HBASE-20981 in 2.2 & 2.3Major.
HBASE-23692Set version as 2.2.4-SNAPSHOT in branch-2.2Major.

OTHER:

JIRASummaryPriorityComponent
HBASE-23874Move Jira-attached file precommit definition from script in Jenkins config to dev-supportMinorbuild
HBASE-23854Documentation update of external_apis.adoc#example-scala-codeTrivialdocumentation
HBASE-23774Announce user-zh listTrivialwebsite
HBASE-23734Backport [HBASE-21874 Bucket cache on Persistent memory] to branch-2.2Major.

Release 2.2.3 - Unreleased (as of 2020-01-10)

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-22280Separate read/write handler for priority request(especially for meta).MajorScheduler
HBASE-22969A new binary component comparator(BinaryComponentComparator) to perform comparison of arbitrary length and positionMinorFilters

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-23654Please add Apache Trafodion and EsgynDB to “Powered by Apache HBase” pageMajordocumentation
HBASE-23651Region balance throttling can be disabledMajor.
HBASE-23645Fix remaining Checkstyle violations in tests of hbase-commonMinor.
HBASE-23635Reduce number of Checkstyle violations in hbase-mapreduceMinormapreduce
HBASE-23333Include simple Call.toShortString() in sendCall exceptionsMinorClient, Operability
HBASE-23629Addition to Supporting projects pageMinor.
HBASE-23623Reduce number of Checkstyle violations in hbase-restMinorREST
HBASE-23627Resolve remaining Checkstyle violations in hbase-thriftMinorThrift
HBASE-23615Use a dedicated thread for executing WorkerMonitor in ProcedureExecutor.Majoramv2
HBASE-23626Reduce number of Checkstyle violations in tests of hbase-commonMinor.
HBASE-23622Reduce number of Checkstyle violations in hbase-commonMinor.
HBASE-23621Reduce number of Checkstyle violations in tests of hbase-commonMinor.
HBASE-23619Use built-in formatting for logging in hbase-zookeeperTrivialZookeeper
HBASE-23238Additional test and checks for null references on ScannerCallableWithReplicasMinor.
HBASE-23613ProcedureExecutor check StuckWorkers blocked by DeadServerMetricRegionChoreMajor.
HBASE-23239Reporting on status of backing MOB files from client-facing cellsMajormapreduce, mob, Operability
HBASE-23549Document steps to disable MOB for a column familyMinordocumentation, mob
HBASE-23380General Cleanup of FSUtilMinorFilesystem Integration
HBASE-23379Clean Up FSUtil getRegionLocalityMappingFromFSMinor.
HBASE-23377Balancer should skip disabled tables's regionsMajorBalancer
HBASE-23373Log `RetriesExhaustedException` context with full time precisionMinorasyncclient, Client
HBASE-23303Add security headers to REST server/info pageMajorREST
HBASE-23361[UI] Limit two decimals even for total average loadMinorUI
HBASE-23365Minor change MemStoreFlusher's logTrivial.
HBASE-23362WalPrettyPrinter should include the table nameMinortooling
HBASE-23352Allow chaos monkeys to access cmd line params, and improve FillDiskCommandActionMinorintegration tests
HBASE-23293[REPLICATION] make ship edits timeout configurableMinorReplication
HBASE-23334The table-lock node of zk is not needed since HBASE-16786Minor.
HBASE-23325[UI]rsgoup average load keep two decimalsMinor.
HBASE-23321[hbck2] fixHoles of fixMeta doesn't update in-memory stateMinorhbck2
HBASE-23315Miscellaneous HBCK Report page cleanupMinor.
HBASE-23278Add a table-level compaction progress display on the UIMinorUI
HBASE-19450Add log about average execution time for ScheduledChoreMinorOperability
HBASE-23283Provide clear and consistent logging about the period of enabled choresMinorOperability
HBASE-23245All MutableHistogram implementations should remove maxExpectedMajormetrics
HBASE-23228Allow for jdk8 specific modules on branch-1 in precommit/nightly testingCriticalbuild, test
HBASE-23082Backport low-latency snapshot tracking for space quotas to 2.xMajorQuotas
HBASE-23221Polish the WAL interface after HBASE-23181Majorregionserver, wal
HBASE-23191Log spams on ReplicationTrivialReplication
HBASE-23207Log a region open journalMinor.
HBASE-23172HBase Canary region success count metrics reflect column family successes, not region successesMinorcanary
HBASE-23170Admin#getRegionServers use ClusterMetrics.Option.SERVERS_NAMEMajor.
HBASE-23038Provide consistent and clear logging about disabling choresMinormaster, regionserver

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-23658Fix flaky TestSnapshotFromMasterMajor.
HBASE-23659BaseLoadBalancer#wouldLowerAvailability should consider region replicasMajor.
HBASE-23655Fix flaky TestRSGroupsKillRS: should wait the SCP to finishMajor.
HBASE-23663Allow dot and hyphen in Profiler's URLMinorprofiler
HBASE-23666Backport “HBASE-23660 hbase:meta's table.jsp ref to wrong rs address” to branch-2Majormaster
HBASE-23636Disable table may hang when regionserver stop or abort.Majoramv2
HBASE-23175Yarn unable to acquire delegation token for HBase Spark jobsMajorsecurity, spark
HBASE-23553Snapshot referenced data files are deleted in some caseMajor.
HBASE-23587The FSYNC_WAL flag does not work on branch-2.xMajorwal
HBASE-23596HBCKServerCrashProcedure can double assignMajorproc-v2
HBASE-23589FlushDescriptor contains non-matching family/output combinationsCriticalread replicas
HBASE-23581Creating table gets stuck when specifying an invalid split policy as METADATAMajor.
HBASE-23572In ‘HBCK Report’, distinguish between live, dead, and unknown serversTrivial.
HBASE-23564RegionStates may has some expired serverinfo and make regions do not balance.Major.
HBASE-23594Procedure stuck due to region happen to recorded on two servers.Criticalamv2, Region Assignment
HBASE-23376NPE happens while replica region is movingMinorread replicas
HBASE-23582Unbalanced braces in string representation of table descriptorMinor.
HBASE-23566Fix package/packet terminology problem in chaos monkeysMinorintegration tests
HBASE-23360[CLI] Fix help command “set_quota” to explain removing quotaMinorshell
HBASE-23554Encoded regionname to regionname utilityMajorshell
HBASE-22096/storeFile.jsp shows CorruptHFileException when the storeFile is a reference fileMajorUI
HBASE-22529Sanity check for in-memory compaction policyMinor.
HBASE-23337Several modules missing in nexus for Apache HBase 2.2.2Blockerbuild, community, scripts
HBASE-23345Table need to replication unless all of cfs are excludedMinorReplication
HBASE-23356When construct StoreScanner throw exceptions it is possible to left some KeyValueScanner not closed.Major.
HBASE-23117Bad enum in hbase:meta info:state column can fail loadMeta and stop startupMinor.
HBASE-23312HBase Thrift SPNEGO configs (HBASE-19852) should be backwards compatibleMajorThrift
HBASE-23197“IllegalArgumentException: Wrong FS” on edits replay when WALs on different file system and hbase.region.archive.recovered.edits is enabled.Major.
HBASE-23336[CLI] Incorrect row(s) count “clear_deadservers”Minorshell
HBASE-23237Negative ‘Requests per Second’ counts in UIMajorUI
HBASE-23328info:regioninfo goes wrong when region replicas enabledMajorread replicas
HBASE-22607TestExportSnapshotNoCluster::testSnapshotWithRefsExportFileSystemState() fails intermittentlyMajortest
HBASE-23318LoadTestTool doesn't startMinor.
HBASE-23282HBCKServerCrashProcedure for ‘Unknown Servers’Majorhbck2, proc-v2
HBASE-23294ReplicationBarrierCleaner should delete all the barriers for a removed region which does not belong to any serial replication peerMajormaster, Replication
HBASE-23290shell processlist command is brokenMajorshell
HBASE-18439Subclasses of o.a.h.h.chaos.actions.Action all use the same loggerMinorintegration tests
HBASE-23262Cannot load Master UIMajormaster, UI
HBASE-23263NPE in Quotas.jspMajorUI
HBASE-22980HRegionPartioner getPartition() method incorrectly partitions the regions of the table.Majormapreduce
HBASE-21458Error: Could not find or load main class org.apache.hadoop.hbase.util.GetJavaPropertyMinorbuild, Client
HBASE-23243[pv2] Filter out SUCCESS procedures; on decent-sized cluster, plethora overwhelms problemsMajorproc-v2, UI
HBASE-23247[hbck2] Schedule SCPs for ‘Unknown Servers’Majorhbck2
HBASE-23241TestExecutorService sometimes failMajortest
HBASE-23244NPEs running CanaryMajorcanary
HBASE-23231ReplicationSource do not update metrics after refreshMajorwal
HBASE-22739ArrayIndexOutOfBoundsException when balanceMajorBalancer
HBASE-23192CatalogJanitor consistencyCheck does not log problematic row on exceptionMinorhbck2
HBASE-20827Add pause when retrying after CallQueueTooBigException for reportRegionStateTransitionMajorRegion Assignment
HBASE-23187Update parent region state to SPLIT in metaMajormaster
HBASE-23199Error populating Table-Attribute fieldsMajormaster, UI
HBASE-23222Better logging and mitigation for MOB compaction failuresCriticalmob
HBASE-23181Blocked WAL archive: “LogRoller: Failed to schedule flush of XXXX, because it is not online on us”Majorregionserver, wal
HBASE-23193ConnectionImplementation.isTableAvailable can not deal with meta table on branch-2.xMajorrsgroup, test
HBASE-23177If fail to open reference because FNFE, make it plain it is a ReferenceMajorOperability
HBASE-23042Parameters are incorrect in procedures jspMajor.

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-23320Upgrade surefire plugin to 3.0.0-M4Majordependencies, test
HBASE-20461Implement fsync for AsyncFSWALMajorwal
HBASE-23085Network and Data related ActionsMinorintegration tests
HBASE-23307Add running of ReplicationBarrierCleaner to hbck2 fixMeta invocationMajorhbck2
HBASE-23322[hbck2] Simplification on HBCKSCP schedulingMinorhbck2
HBASE-22480Get block from BlockCache once and return this block to BlockCache twice make ref count error.Major.
HBASE-23136PartionedMobFileCompactor bulkloaded files shouldn't get replicated (addressing buklload replication related issue raised in HBASE-22380)Critical.
HBASE-23217Set version as 2.2.3-SNAPSHOT in branch-2.2Major.
HBASE-22982Send SIGSTOP to hang or SIGCONT to resume rs and add graceful rolling restartMinorintegration tests

OTHER:

JIRASummaryPriorityComponent
HBASE-23642Reintroduce ReplicationUtils.contains as deprecatedMajorReplication
HBASE-23575Remove dead code from AsyncRegistry interfaceMinorClient
HBASE-23236Upgrade to yetus 0.11.1Majorbuild
HBASE-23250Log message about CleanerChore delegate initialization should be at INFOMinormaster, Operability
HBASE-23227Upgrade jackson-databind to 2.9.10.1 to avoid recent CVEsBlockerdependencies, REST, security

Release 2.2.2 - Unreleased (as of 2019-10-16)

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-11062hbtopMajorhbtop

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-20626Change the value of “Requests Per Second” on WEBUIMajormetrics, UI
HBASE-23093Avoid Optional Anti-Pattern where possibleMinor.
HBASE-23114Use archiveArtifacts in JenkinsfilesTrivial.
HBASE-23140Remove unknown table errorMinor.
HBASE-23095Reuse FileStatus in StoreFileInfoMajormob, snapshots
HBASE-23116LoadBalancer should log table name when balancing per tableMinor.
HBASE-22874Define a public interface for Canary and move existing implementation to LimitedPrivateCriticalcanary
HBASE-22930Set unique name to longCompactions/shortCompactions threadsMinor.
HBASE-23035Retain region to the last RegionServer make the failover slowerMajor.
HBASE-23075Upgrade jackson to version 2.9.10 due to CVE-2019-16335 and CVE-2019-14540Majordependencies, hbase-connectors, REST, security
HBASE-22975Add read and write QPS metrics at server level and table levelMinormetrics
HBASE-23058Should be “Column Family Name” in table.jspMinor.
HBASE-23049TableDescriptors#getAll should return the tables ordering by the name which contain namespaceMinor.
HBASE-23041Should not show split parent regions in HBCK report's unknown server partMajor.
HBASE-23044CatalogJanitor#cleanMergeQualifier may clean wrong parent regionsCritical.
HBASE-23037Make the split WAL related log more readableMinor.
HBASE-22846Internal Error 500 when Using HBASE REST API to Create Namespace.Majorhbase-connectors
HBASE-22804Provide an API to get list of successful regions and total expected regions in CanaryMinorcanary
HBASE-22899logging improvements for snapshot operations w/large manifestsMinorsnapshots
HBASE-22701Better handle invalid local directory for DynamicClassLoaderMajorregionserver

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-22370ByteBuf LEAK ERRORMajorrpc, wal
HBASE-23078BaseLoadBalancer should consider region replicas when randomAssignment and roundRobinAssignmentMajor.
HBASE-23155May NPE when concurrent AsyncNonMetaRegionLocator#updateCachedLocationOnErrorMajorasyncclient
HBASE-21540when set property “hbase.systemtables.compacting.memstore.type” to “basic” or “eager” will cause an exceptionMajorconf
HBASE-23153PrimaryRegionCountSkewCostFunction SLB function should implement CostFunction#isNeededMajor.
HBASE-23154list_deadservers return incorrect no of rowsMinorshell
HBASE-23152Compaction_switch does not work by RegionServer nameMajorClient, Compaction
HBASE-23115Unit change for StoreFileSize and MemStoreSizeMinormetrics, UI
HBASE-23138Drop_all table by regex fail from Shell - Similar to HBASE-23134Majorshell
HBASE-23139MapReduce jobs lauched from convenience distribution are nonfunctionalBlockermapreduce
HBASE-22767System table RIT STUCK if their RSGroup has no highest version RSesMajorrsgroup
HBASE-23134Enable_all and Disable_all table by Regex fail from ShellMajorshell
HBASE-22903alter_status command is brokenMajormetrics, shell
HBASE-23094Wrong log message in simpleRegionNormaliser while checking if merge is enabled.Minor.
HBASE-23125TestRSGroupsAdmin2 is flakyMajortest
HBASE-23119ArrayIndexOutOfBoundsException in PrivateCellUtil#qualifierStartsWithMajor.
HBASE-23054Remove synchronization block from MetaTableMetrics and fix LossyCounting algorithmMajormetrics
HBASE-22380break circle replication when doing bulkloadCriticalReplication
HBASE-23079RegionRemoteProcedureBase should override setTimeoutFailureBlockeramv2
HBASE-22965RS Crash due to DBE reference to an reused ByteBuffMajor.
HBASE-22012SpaceQuota DisableTableViolationPolicy will cause cycles of enable/disable tableMajor.
HBASE-22944TableNotFoundException: hbase:quota is thrown when region server is restarted.MinorQuotas
HBASE-22142Space quota: If table inside namespace having space quota is dropped, data size usage is still considered for the drop table.Minor.
HBASE-22649Encode StoreFile path URLs in the UI to handle scenarios where CF contains special characters (like # etc.)MajorUI
HBASE-23051Remove unneeded Mockito.mock invocationsMajortest
HBASE-23005Table UI showed exception message when table is disabledMinor.
HBASE-23040region mover gives NullPointerException instead of saying a host isn't in the clusterMinor.
HBASE-23043TestWALEntryStream times outMajorwal
HBASE-22955Branches-1 precommit and nightly yetus jobs are using jdk8 for jdk7 jobsMajor.
HBASE-22929MemStoreLAB ChunkCreator may memory leakMajor.
HBASE-23006RSGroupBasedLoadBalancer should also try to place replicas for the same region to different region serversMajorRegion Assignment, rsgroup
HBASE-23007UnsatisfiedLinkError when using hbase-shaded packages under linuxCriticalshading
HBASE-22013SpaceQuotas - getNumRegions() returning wrong number of regions due to region replicasMajor.
HBASE-22979Call ChunkCreator.initialize in TestHRegionWithInMemoryFlushCritical.
HBASE-22964Fix flaky TestClusterRestartFailover and TestClusterRestartFailoverSplitWithoutZkMajor.
HBASE-22963Netty ByteBuf leak in rpc client implementationMajorrpc
HBASE-22981Remove unused flags for YetusCriticalbuild

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-23168Generate CHANGES.md and RELEASENOTES.md for 2.2.2Majordocumentation
HBASE-23167Set version as 2.2.2 in branch-2.2 in prep for first RC of 2.2.2Majorbuild
HBASE-23163Refactor HStore.getStorefilesSize related methodsMajorregionserver
HBASE-22927Upgrade mockito version for Java 11 compatibilityMajor.
HBASE-23027Set version to 2.2.2-SNAPSHOT in branch-2.2Major.
HBASE-22796[HBCK2] Add fix of overlaps to fixMeta hbck ServiceMajor.
HBASE-22993HBCK report UI showed -1 if hbck chore not runningMinor.
HBASE-23014Should not show split parent regions in hbck report UIMajor.
HBASE-22859[HBCK2] Fix the orphan regions on filesystemMajordocumentation, hbck2

OTHER:

JIRASummaryPriorityComponent
HBASE-21745Make HBCK2 be able to fix issues other than region assignmentCriticalhbase-operator-tools, hbck2
HBASE-23053Disable concurrent nightly buildsMinorbuild
HBASE-23023upgrade shellcheck used to test in nightly and precommitMajorbuild

Release 2.2.1 - Unreleased (as of 2019-09-04)

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponent
HBASE-22690Deprecate / Remove OfflineMetaRepair in hbase-2+Majorhbck2

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-15666shaded dependencies for hbase-testing-utilCriticaltest

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-22724Add a emoji on the vote table for pre commit result on githubMajorbuild, test
HBASE-22954Whitelist net.java.dev.jna which got pulled in through Hadoop 3.3.0Minorcommunity, hadoop3
HBASE-22905Avoid temp ByteBuffer allocation in BlockingRpcConnection#writeRequestMajor.
HBASE-22962Fix typo in javadoc descriptionMinordocumentation
HBASE-22933Do not need to kick reassign for rs group change any moreMajorrsgroup
HBASE-22872Don't create normalization plan unnecesarily when split and merge both are disabledMinor.
HBASE-20509Put List in HashSet directly without using addAll function to improve performanceTrivialPerformance
HBASE-21996Set locale for javadocMajordocumentation
HBASE-22464Improvements to hbase-vote scriptTrivialscripts
HBASE-22810Initialize an separate ThreadPoolExecutor for taking/restoring snapshotMajor.
HBASE-22844Fix Checkstyle issues in client snapshot exceptionsMinorClient
HBASE-22871Move the DirScanPool out and do not use static fieldMajormaster
HBASE-22841TimeRange's factory functions do not support ranges, only `allTime` and `at`MajorClient
HBASE-22828Log a region close journalMinor.
HBASE-22812InterfaceAudience annotation in CatalogJanitor uses fully-qualified nameMinor.
HBASE-22800Add mapreduce dependencies to hbase-shaded-testing-utilMajor.
HBASE-22731ReplicationSource and HBaseInterClusterReplicationEndpoint log messages should include a target Peer identifierMinorReplication
HBASE-22759Add user info to AUDITLOG events when doing grant/revokeMajorlogging, security
HBASE-22785Reduce number of Checkstyle issues in client exceptionsMinorClient
HBASE-22786Fix Checkstyle issues in tests of hbase-clientMinorClient
HBASE-22677Add unit tests for org.apache.hadoop.hbase.util.ByteRangeUtils and org.apache.hadoop.hbase.util.ClassesMajorjava, test
HBASE-22787Clean up of tests in hbase-zookeeperMinorZookeeper
HBASE-22363Remove hardcoded number of read cache block bucketsTrivialBlockCache, BucketCache
HBASE-22764Fix remaining Checkstyle issues in hbase-rsgroupTrivialrsgroup
HBASE-22763Fix remaining Checkstyle issue in hbase-procedureTrivial.
HBASE-22743ClientUtils for hbase-examplesMinor.
HBASE-22750Correct @throws in commentTrivialClient, rpc
HBASE-22702[Log] ‘Group not found for table’ is chattyTrivial.
HBASE-22721Refactor HBaseFsck: move the inner class outMajor.
HBASE-22692Rubocop definition is not used in the /bin directoryMinor.
HBASE-22610[BucketCache] Rename “hbase.offheapcache.minblocksize”Trivial.
HBASE-22704Avoid NPE when access table.jsp and snapshot.jsp but master not finish initializationMinor.
HBASE-22643Delete region without archiving only if regiondir is presentMajorHFile
HBASE-22689Line break for fix version in documentationTrivialdocumentation
HBASE-22638Zookeeper Utility enhancementsMinorZookeeper
HBASE-22669Add unit tests for org.apache.hadoop.hbase.util.StringsMajorjava
HBASE-22403Balance in RSGroup should consider throttling and a failure affects the wholeMajorrsgroup
HBASE-22604fix the link in the docs to “Understanding HBase and BigTable” by Jim R. WilsonTrivialdocumentation
HBASE-22624Should sanity check table configuration when clone snapshot to a new tableMajor.
HBASE-22633Remove redundant call to substring for ZKReplicationQueueStorageMinor.
HBASE-22595Use full qualified name in Checkstyle suppressionsTrivial.
HBASE-22454refactor WALSplitterMajorwal
HBASE-22616responseTooXXX logging for Multi should characterize the component opsMinor.
HBASE-22596[Chore] Separate the execution period between CompactionChecker and PeriodicMemStoreFlusherMinorCompaction
HBASE-22561modify HFilePrettyPrinter to accept non-hbase.rootdir directoriesMinor.
HBASE-22344Document deprecated public APIsMajorAPI, community, documentation
HBASE-22593Add local Jenv file to gitignoreTrivial.
HBASE-22116HttpDoAsClient to support keytab and principal in command line argument.Major.
HBASE-22160Add sorting functionality in regionserver web UI for user regionsMinormonitoring, regionserver, UI, Usability

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-22970split parents show as overlaps in the HBCK ReportMajor.
HBASE-22961Deprecate hbck1 in coreMajorhbck
HBASE-22896TestHRegion.testFlushMarkersWALFail is flakyMinor.
HBASE-22943Various procedures should not cache log trace levelMinorproc-v2
HBASE-22881Fix non-daemon threads in hbase server implementationMajormaster
HBASE-22893Change the comment in HBaseClassTestRule to reflect change in default test timeoutsTrivial.
HBASE-22928ScanMetrics counter update may not happen in case of exception in TableRecordReaderImplMinormapreduce
HBASE-22941MetaTableAccessor.getMergeRegions() returns parent regions in random orderMajor.
HBASE-22935TaskMonitor warns MonitoredRPCHandler task may be stuck when it recently startedMinorlogging
HBASE-22857Fix the failed ut TestHRegion and TestHRegionWithInMemoryFlushMajor.
HBASE-22922Only the two first regions are locked in MergeTableRegionsProcedureMajor.
HBASE-22852hbase nightlies leaking gpg-agentsMinorbuild
HBASE-22867The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands tableCriticalmaster
HBASE-22904NPE occurs when RS send space quota usage report during HMaster initMinor.
HBASE-22806Deleted CF are not cleared if memstore contain entriesMajorAPI
HBASE-22601Misconfigured addition of peers leads to cluster shutdown.Major.
HBASE-22863Avoid Jackson versions and dependencies with known CVEsMajordependencies
HBASE-22879user_permission command failed to show global permissionMajor.
HBASE-22882TestFlushSnapshotFromClient#testConcurrentSnapshottingAttempts is flakey (was written flakey)Majortest
HBASE-22870reflection fails to access a private nested classMajormaster
HBASE-22860Master's webui returns NPE/HTTP 500 under maintenance modeMajormaster, UI
HBASE-22856HBASE-Find-Flaky-Tests fails with pip errorMajorbuild, test
HBASE-22632SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store files for unknown column familiesMajorproc-v2
HBASE-22838assembly:single failure: user id or group id ‘xxxxx’ is too bigMajorbuild
HBASE-22417DeleteTableProcedure.deleteFromMeta method should remove table from Master's table descriptors cacheMajor.
HBASE-22539WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is usedBlockerrpc, wal
HBASE-22801Maven build issue on Github PRsMajorbuild
HBASE-22793RPC server connection is logging user as NULL principalMinorrpc
HBASE-22778Upgrade jasckson databind to 2.9.9.2Blockerdependencies
HBASE-22773when set blockSize option in Performance Evaluation tool, error occurs:ERROR: Unrecognized option/command: --blockSize=131072Minormapreduce
HBASE-22735list_regions may throw an error if a region is RITMinorshell
HBASE-22145windows hbase-env causes hbase cli/etc to ignore HBASE_OPTSMajor.
HBASE-22408add a metric for regions OPEN on non-live serversMajor.
HBASE-22758Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMetaMajor.
HBASE-22751table.jsp fails if ugly regions in tableMajorUI
HBASE-22733TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor is flakeyMajor.
HBASE-22715All scan requests should be handled by scan handler threads in RWQueueRpcExecutorMinor.
HBASE-22722Upgrade jackson databind dependencies to 2.9.9.1Blockerdependencies
HBASE-22603Javadoc Warnings related to @link tagTrivialdocumentation
HBASE-22720Incorrect link for hbase.unittestsTrivialdocumentation
HBASE-21426TestEncryptionKeyRotation.testCFKeyRotation is flakyMajor.
HBASE-20368Fix RIT stuck when a rsgroup has no online servers but AM's pendingAssginQueue is clearedMajorrsgroup
HBASE-22700Incorrect timeout in recommended ZooKeeper configurationMinordocumentation
HBASE-22661list_regions command in hbase shell is brokenMajorshell
HBASE-22684The log rolling request maybe canceled immediately in LogRoller due to a raceMajorwal
HBASE-22586Javadoc Warnings related to @param tagTrivialdocumentation
HBASE-22571Javadoc Warnings related to @return tagTrivialdocumentation
HBASE-22681The ‘assert highestUnsyncedTxid < entry.getTxid();’ in AbstractFWAL.append may fail when using AsyncFSWALCriticalwal
HBASE-22686ZkSplitLogWorkerCoordination doesn't allow a regionserver to pick up all of the split work it is capable ofMajor.
HBASE-22656[Metrics] Tabe metrics ‘BatchPut’ and ‘BatchDelete’ are never updatedMinormetrics
HBASE-22582The Compaction writer may access the lastCell whose memory has been released when appending fileInfo in the finalMajorCompaction
HBASE-22652Flakey TestLockManager; test timed out after 780 secondsMajorproc-v2
HBASE-22637fix flaky TestMetaTableMetrics testMajormetrics, test
HBASE-13798TestFromClientSide* don't close the TableTrivialtest
HBASE-21751WAL creation fails during region open may cause region assign forever failMajor.
HBASE-22477Throwing exception when meta region is not in OPEN state in client registry may crash a masterMajorClient, master, meta
HBASE-22169Open region failed cause memory leakCritical.
HBASE-22617Recovered WAL directories not getting cleaned upBlockerwal
HBASE-22605Ref guide includes dev guidance only applicable to EOM versionsTrivialdocumentation
HBASE-22565Javadoc Warnings: @see cannot be used in inline documentationTrivialdocumentation
HBASE-22562PressureAwareThroughputController#skipControl never invokedTrivialOperability
HBASE-22559[RPC] set guard against CALL_QUEUE_HANDLER_FACTOR_CONF_KEYMinorrpc
HBASE-22530The metrics of store files count of region are returned to clients incorrectlyMinormetrics, regionserver
HBASE-22458TestClassFinder fails when run on JDK11Minorjava, test
HBASE-22520Avoid possible NPE in HalfStoreFileReader seekBefore()Major.

TESTS:

JIRASummaryPriorityComponent
HBASE-22886Code Coverage Improvement: Create Unit Tests for ConnectionIdTrivialtest
HBASE-22766Code Coverage Improvement: Create Unit Tests for ResultStatsUtilTrivialtest
HBASE-22894Move testOpenRegionFailedMemoryLeak to dedicated classMajortest
HBASE-22725Remove all remaining javadoc warningsTrivialtest
HBASE-22615Make TestChoreService more robust to timingMinortest

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-22851Preparing HBase release 2.2.1RC0: set version to 2.2.1 in branch-2.2Major.
HBASE-22878Show table throttle quotas in table jspMajor.
HBASE-22946Fix TableNotFound when grant/revoke if AccessController is not loadedMajor.
HBASE-22945Show quota infos in master UIMajormaster, UI
HBASE-22858Add HBCK Report to master's header.jspMinormaster
HBASE-22891Use HBaseQA in HBase-PreCommit-GitHub-PR jobMajorbuild, scripts
HBASE-22771[HBCK2] fixMeta method and server-side supportMajorhbck2
HBASE-22845Revert MetaTableAccessor#makePutFromTableState access to publicBlocker.
HBASE-22777Add a multi-region merge (for fixing overlaps, etc.)Majorhbck2, proc-v2
HBASE-22803Modify config value range to enable turning off of the hbck choreMajor.
HBASE-22824Show filesystem path for the orphans regions on filesystemMajor.
HBASE-22808HBCK Report showed the offline regions which belong to disabled tableMajor.
HBASE-22807HBCK Report showed wrong orphans regions on FileSystemMajor.
HBASE-22737Add a new admin method and shell cmd to trigger the hbck chore to runMajor.
HBASE-22741Show catalogjanitor consistency complaints in new ‘HBCK Report’ pageMajorhbck2, UI
HBASE-22723Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:metaMajor.
HBASE-22709Add a chore thread in master to do hbck checking and display results in ‘HBCK Report’ pageMajor.
HBASE-22742[HBCK2] Add more log for hbck operations at master sideMinor.
HBASE-22527[hbck2] Add a master web ui to show the problematic regionsMajorhbase-operator-tools, hbck2
HBASE-22719Add debug support for github PR pre commit jobMajorbuild
HBASE-22673Avoid to expose protobuf stuff in Hbck interfaceMajorhbck2
HBASE-7191HBCK - Add offline create/fix hbase.version and hbase.idMajorhbck
HBASE-22600Document that LoadIncrementalHFiles will be removed in 3.0.0Major.
HBASE-22569Should treat null consistency as Consistency.STRONG in ConnectionUtils.timelineConsistentReadMajor.

OTHER:

JIRASummaryPriorityComponent
HBASE-22833MultiRowRangeFilter should provide a method for creating a filter which is functionally equivalent to multiple prefix filtersMinorClient
HBASE-22895Fix the flakey TestSpaceQuotasMajorQuotas, test
HBASE-22914Backport HBASE-20662 to branch-2.2Major.
HBASE-22910Enable TestMultiVersionConcurrencyControlMajortest
HBASE-22913Use Hadoop label for nightly buildsMajorbuild
HBASE-22911fewer concurrent github PR buildsCriticalbuild
HBASE-21400correct spelling error of ‘initilize’ in commentTrivialdocumentation
HBASE-22382Refactor tests in TestFromClientSideMajortest
HBASE-21606Document use of the meta table load metrics added in HBASE-19722Criticaldocumentation, meta, metrics, Operability
HBASE-19230Write up fixVersion policy from dev discussion in refguideMajordocumentation
HBASE-22566Call out default compaction throttling for 2.x in BookMajordocumentation
HBASE-22560Upgrade to Jetty 9.3.latest and Jackson 2.9.latestMajordependencies

Release 2.2.0 - Unreleased (as of 2019-06-11)

INCOMPATIBLE CHANGES:

JIRASummaryPriorityComponent
HBASE-21991Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvementsMajorCoprocessors, metrics
HBASE-22399Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checksMajorbuild, hadoop2
HBASE-21082Reimplement assign/unassign related procedure metricsCriticalamv2, metrics
HBASE-20587Replace Jackson with shaded thirdparty gsonMajordependencies
HBASE-21727Simplify documentation around client timeoutMinor.
HBASE-21684Throw DNRIOE when connection or rpc client is closedMajorasyncclient, Client
HBASE-21792Mark HTableMultiplexer as deprecated and remove it in 3.0.0MajorClient
HBASE-21657PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case.MajorPerformance
HBASE-21560Return a new TableDescriptor for MasterObserver#preModifyTable to allow coprocessor modify the TableDescriptorMajorCoprocessors
HBASE-21492CellCodec Written To WAL Before It's VerifiedCriticalwal
HBASE-21452Illegal character in hbase counters group nameMajorspark
HBASE-21158Empty qualifier cell should not be returned if it does not match QualifierFilterCriticalFilters
HBASE-21223[amv2] Remove abort_procedure from shellCriticalamv2, hbck2, shell
HBASE-20881Introduce a region transition procedure to handle all the state transition for a regionMajoramv2, proc-v2
HBASE-20884Replace usage of our Base64 implementation with java.util.Base64Major.

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-22148Provide an alternative to CellUtil.setTimestampBlockerAPI, Coprocessors
HBASE-21815Make isTrackingMetrics and getMetrics of ScannerContext publicMinor.
HBASE-21926Profiler servletMajormaster, Operability, regionserver
HBASE-20886[Auth] Support keytab login in hbase clientCriticalasyncclient, Client, security
HBASE-17942Disable region splits and merges per tableMajor.
HBASE-21753Support getting the locations for all the replicas of a regionMajorClient
HBASE-20636Introduce two bloom filter type : ROWPREFIX_FIXED_LENGTH and ROWPREFIX_DELIMITEDMajorHFile, regionserver, Scanners
HBASE-20649Validate HFiles do not have PREFIX_TREE DataBlockEncodingMinorOperability, tooling

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-22284optimization StringBuilder.append of AbstractMemStore.toStringTrivial.
HBASE-22523Refactor RegionStates#getAssignmentsByTable to make it easy to understandMajor.
HBASE-22511More missing /rs-status linksMinorUI
HBASE-22496UnsafeAccess.unsafeCopy should not copy more than UNSAFE_COPY_THRESHOLD on each iterationMajor.
HBASE-22488Cleanup the explicit timeout value for test methodsMajor.
HBASE-22411Refactor codes of moving reigons in RSGroupMajorrsgroup
HBASE-22467WebUI changes to enable Apache Knox UI proxyingMajorUI
HBASE-22474Add --mvn-custom-repo parameter to yetus callsMinor.
HBASE-20305Add option to SyncTable that skip deletes on target clusterMinormapreduce
HBASE-21784Dump replication queue should show list of wal files ordered chronologicallyMajorReplication, tooling
HBASE-22384Formatting issues in administration section of bookMinorcommunity, documentation
HBASE-21658Should get the meta replica number from zk instead of config at client sideCriticalClient
HBASE-22365Region may be opened on two RegionServersBlockeramv2
HBASE-22392Remove extra/useless +Trivial.
HBASE-20494Upgrade com.yammer.metrics dependencyMajordependencies
HBASE-22358Change rubocop configuration for method lengthMinorcommunity, shell
HBASE-22379Fix Markdown for “Voting on Release Candidates” in bookMinorcommunity, documentation
HBASE-22109Update hbase shaded content checker after guava update in hadoop branch-3.0 to 27.0-jreMinor.
HBASE-22087Update LICENSE/shading for the dependencies from the latest Hadoop trunkMinorhadoop3
HBASE-22341Add explicit guidelines for removing deprecations in bookMajorAPI, community, documentation
HBASE-22225Profiler tab on Master/RS UI not working w/o comprehensive messageMinorUI
HBASE-22291Fix recovery of recovered.edits files under root dirMajor.
HBASE-22283Print row and table information when failed to get region locationMajorClient, logging
HBASE-22296Remove TestFromClientSide.testGetStartEndKeysWithRegionReplicasMajortest
HBASE-22250The same constants used in many places should be placed in constant classesMinorClient, conf, regionserver
HBASE-20586SyncTable tool: Add support for cross-realm remote clustersMajormapreduce, Operability, Replication
HBASE-21257misspelled words.[occured -> occurred]Trivial.
HBASE-22193Add backoff when region failed open too many timesMajor.
HBASE-22188Make TestSplitMerge more stableMajortest
HBASE-22097Modify the description of split command in shellTrivialshell
HBASE-21964unset Quota by Throttle TypeMajormaster
HBASE-22093Combine TestRestoreSnapshotFromClientWithRegionReplicas to CloneSnapshotFromClientAfterSplittingRegionTestBase#testCloneSnapshotAfterSplittingRegionMajor.
HBASE-22009Improve RSGroupInfoManagerImpl#getDefaultServers()Minorrsgroup
HBASE-22032KeyValue validation should check for null byte arrayMajor.
HBASE-21667Move to latest ASF Parent POMMinorbuild
HBASE-21810bulkload support set hfile compression on clientMajormapreduce
HBASE-21987Simplify RSGroupInfoManagerImpl#flushConfig() for offline modeMinorrsgroup
HBASE-21871Support to specify a peer table name in VerifyReplication toolMajor.
HBASE-21255[acl] Refactor TablePermission into three classes (Global, Namespace, Table)Major.
HBASE-21410A helper page that help find all problematic regions and proceduresMajor.
HBASE-20734Colocate recovered edits directory with hbase.wal.dirMajorMTTR, Recovery, wal
HBASE-20401Make `MAX_WAIT` and `waitIfNotFinished` in CleanerContext configurableMinormaster
HBASE-21481[acl] Superuser's permissions should not be granted or revoked by any non-su global adminMajor.
HBASE-21967Split TestServerCrashProcedure and TestServerCrashProcedureWithReplicasMajor.
HBASE-21867Support multi-threads in HFileArchiverMajor.
HBASE-21932Use Runtime.getRuntime().halt to terminate regionserver when abort timeoutMajor.
HBASE-21875Change the retry logic in RSProcedureDispatcher to ‘retry by default, only if xxx’Majorproc-v2
HBASE-21780Avoid a wide line on the RegionServer webUI for many ZooKeeper serversMinorUI, Usability
HBASE-21636Enhance the shell scan command to support missing scanner specifications like ReadType, IsolationLevel etc.Majorshell
HBASE-21857Do not need to check clusterKey if replicationEndpoint is provided when adding a peerMajor.
HBASE-21201Support to run VerifyReplication MR tool without peeridMajorhbase-operator-tools
HBASE-21816Print source cluster replication config directoryTrivialReplication
HBASE-19616Review of LogCleaner ClassMinor.
HBASE-21830Backport HBASE-20577 (Make Log Level page design consistent with the design of other pages in UI) to branch-2MajorUI, Usability
HBASE-21833Use NettyAsyncFSWALConfigHelper.setEventLoopConfig to prevent creating too many netty event loop when executing TestHRegionMinortest
HBASE-21634Print error message when user uses unacceptable values for LIMIT while setting quotas.Minor.
HBASE-21789Rewrite MetaTableAccessor.multiMutate with Table.coprocessorServiceMajorClient, Coprocessors
HBASE-21689Make table/namespace specific current quota info available in shell(describe_namespace & describe)Minor.
HBASE-20215Rename CollectionUtils to ConcurrentMapUtilsTrivial.
HBASE-21720metric to measure how actions are distributed to servers within a MultiActionMinorClient, metrics, monitoring
HBASE-21595Print thread's information and stack traces when RS is aborting forciblyMinorregionserver
HBASE-20209Do Not Use Both Map containsKey and get Methods in Replication SinkTrivialReplication
HBASE-21712Make submit-patch.py python3 compatibleMinortooling
HBASE-21590Optimize trySkipToNextColumn in StoreScanner a bitCriticalPerformance, Scanners
HBASE-21297ModifyTableProcedure can throw TNDE instead of IOE in case of REGION_REPLICATION changeMinor.
HBASE-21700Simplify the implementation of RSGroupInfoManagerImplMajorrsgroup
HBASE-21694Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commandsMajor.
HBASE-21645Perform sanity check and disallow table creation/modification with region replication < 1Minor.
HBASE-21360Disable printing of stack-trace in shell for quotasMinorshell
HBASE-21662Add append_peer_exclude_namespaces and remove_peer_exclude_namespaces shell commandsMajor.
HBASE-21659Avoid to load duplicate coprocessors in system config and table descriptorMinor.
HBASE-21642CopyTable by reading snapshot and bulkloading will save a lot of time.Major.
HBASE-21643Introduce two new region coprocessor method and deprecated postMutationBeforeWALMajor.
HBASE-21640Remove the TODO when increment zeroMajor.
HBASE-21631list_quotas should print human readable values for LIMITMinorshell
HBASE-21635Use maven enforcer to ban imports from illegal packagesMajorbuild
HBASE-21514Refactor CacheConfigMajor.
HBASE-21520TestMultiColumnScanner cost long time when using ROWCOL bloom typeMajortest
HBASE-21554Show replication endpoint classname for replication peer on master web UIMinorUI
HBASE-21549Add shell command for serial replication peerMajor.
HBASE-21283Add new shell command ‘rit’ for listing regions in transitionMinorOperability, shell
HBASE-21567Allow overriding configs starting up the shellMajorshell
HBASE-21413Empty meta log doesn't get split when restart whole clusterMajor.
HBASE-21524Unnecessary DEBUG log in ConnectionImplementation#isTableEnabledMajorClient
HBASE-21511Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFilesMinorsnapshots
HBASE-21480Taking snapshot when RS crashes prevent we bring the regions onlineMajorsnapshots
HBASE-21485Add more debug logs for remote procedure executionMajorproc-v2
HBASE-21328add HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP switch to hbase-env.shMinordocumentation, Operability
HBASE-19682Use Collections.emptyList() For Empty List ValuesMinor.
HBASE-21388No need to instantiate MemStoreLAB for master which not carry tableMajor.
HBASE-21325Force to terminate regionserver when abort hang in somewhereMajor.
HBASE-21385HTable.delete request use rpc call directly instead of AsyncProcessMajor.
HBASE-21318Make RefreshHFilesClient runnableMinorHFile
HBASE-21263Mention compression algorithm along with other storefile detailsMinor.
HBASE-21290No need to instantiate BlockCache for master which not carry tableMajor.
HBASE-21256Improve IntegrationTestBigLinkedList for testing huge dataMajorintegration tests
HBASE-21251Refactor RegionMoverMajorOperability
HBASE-21303[shell] clear_deadservers with no args failsMajor.
HBASE-21098Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3Major.
HBASE-21299List counts of actual region states in master UI tables sectionMajorUI
HBASE-21289Remove the log “‘hbase.regionserver.maxlogs’ was deprecated.” in AbstractFSWALMinor.
HBASE-21185WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposesMinorOperability
HBASE-21103nightly test cache of yetus install needs to be more thorough in verificationMajortest
HBASE-21207Add client side sorting functionality in master web UI for table and region server details.Minormaster, monitoring, UI, Usability
HBASE-20857JMX - add Balancer status = enabled / disabledMajorAPI, master, metrics, REST, tooling, Usability
HBASE-21164reportForDuty to spew less log if master is initializingMinorregionserver
HBASE-21204NPE when scan raw DELETE_FAMILY_VERSION and codec is not setMajor.
HBASE-20307LoadTestTool prints too much zookeeper loggingMinortooling
HBASE-21155Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dirTrivial.
HBASE-21129Clean up duplicate codes in #equals and #hashCode methods of FilterMinorFilters
HBASE-21157Split TableInputFormatScan to individual testsMinortest
HBASE-21107add a metrics for netty direct memoryMinorIPC/RPC
HBASE-21153Shaded client jars should always build in relevant phase to avoid confusionMajorbuild
HBASE-21126Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodesMinorcanary, Zookeeper
HBASE-20749Upgrade our use of checkstyle to 8.6+Minorbuild, community
HBASE-21071HBaseTestingUtility::startMiniCluster() to use builder patternMajortest
HBASE-20387flaky infrastructure should work for all branchesCriticaltest
HBASE-20469Directory used for sidelining old recovered edits files should be made configurableMinor.
HBASE-20979Flaky test reporting should specify what JSON it needs and handle HTTP errorsMinortest
HBASE-20985add two attributes when we do normalizationMajor.
HBASE-20965Separate region server report requests to new handlersMajorPerformance
HBASE-20845Support set the consistency for Gets and Scans in thrift2MajorThrift
HBASE-20986Separate the config of block size when we do log splitting and write HlogMajor.
HBASE-19036Add action in Chaos Monkey to restart Active NamenodeMinor.
HBASE-20856PITA having to set WAL provider in two placesMinorOperability, wal
HBASE-20935HStore.removeCompactedFiles should log in case it is unable to delete a fileMinor.
HBASE-20873Update doc for Endpoint-based ExportMinordocumentation
HBASE-20672New metrics ReadRequestRate and WriteRequestRateMinormetrics
HBASE-20617Upgrade/remove jetty-jspMinor.
HBASE-20396Remove redundant MBean from thrift JMXMajorThrift
HBASE-20357AccessControlClient API EnhancementMajorsecurity

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-22563Reduce retained jobs for Jenkins pipelinesMajor.
HBASE-22552Rewrite TestEndToEndSplitTransaction.testCanSplitJustAfterASplitMajortest
HBASE-22551TestMasterOperationsForRegionReplicas is flakeyMajorread replicas, test
HBASE-22481Javadoc Warnings: reference not foundTrivialdocumentation
HBASE-22546TestRegionServerHostname#testRegionServerHostname fails reliably for meMajor.
HBASE-22534TestCellUtil fails when run on JDK11Minorjava, test
HBASE-22536TestForeignExceptionSerialization fails when run on JDK11Minorjava
HBASE-22535TestShellRSGroups fails when run on JDK11Minorjava, shell
HBASE-22518yetus personality is treating branch-1.4 like earlier branches for hadoopcheckMajortest
HBASE-22513Admin#getQuota does not work correctly if exceedThrottleQuota is setMajorQuotas
HBASE-22522The integration test in master branch's nightly job has error “ERROR: Only found 1050 rows.”Major.
HBASE-22490Nightly client integration test fails with hadoop-3Majorbuild
HBASE-22502Purge the logs when we reach the EOF for the last wal file when replicationMajor.
HBASE-22503Failed to upgrade to 2.2+ as the global permission which storaged in zk is not rightBlocker.
HBASE-22487getMostLoadedRegions is unusedTrivialregionserver
HBASE-22485Fix failed ut TestClusterRestartFailoverMajor.
HBASE-22486Fix flaky test TestLockManagerMajor.
HBASE-22471Our nightly jobs for master and branch-2 are still using hadoop-2.7.1 in integration testMajorbuild
HBASE-22003Fix flaky test TestVerifyReplication.testHBase14905Major.
HBASE-22441BucketCache NullPointerException in cacheBlockMajorBucketCache
HBASE-22473Split TestSCPMajorRecovery, test
HBASE-22456Polish TestSplitTransitionOnClusterMajortest
HBASE-21800RegionServer aborted due to NPE from MetaTableMetrics coprocessorCriticalCoprocessors, meta, metrics, Operability
HBASE-22462Should run a ‘mvn install’ at the end of hadoop check in pre commit jobMajorbuild
HBASE-22440HRegionServer#getWalGroupsReplicationStatus() throws NPEMajorregionserver, Replication
HBASE-22226Incorrect level for headings in asciidocTrivialdocumentation
HBASE-22442Nightly build is failing with hadoop 3.xMajorbuild, hadoop3
HBASE-20970Update hadoop check versions for hadoop3 in hbase-personalityMajorbuild
HBASE-22424Interactions in RSGroup test classes will cause TestRSGroupsAdmin2.testMoveServersAndTables and TestRSGroupsBalance.testGroupBalance flakyMajorrsgroup
HBASE-22404Open/Close region request may be executed twice when master restartMajor.
HBASE-22274Cell size limit check on append should consider cell's previous size.Minor.
HBASE-22072High read/write intensive regions may cause long crash recoveryMajorPerformance, Recovery
HBASE-22324loss a mass of data when the sequenceId of cells greater than Integer.Max, because MemStoreMergerSegmentsIterator can not merge segmentsBlockerin-memory-compaction
HBASE-21777“Tune compaction throughput” debug messages even when nothing has changedTrivialCompaction
HBASE-22360Abort timer doesn't set when abort is called during graceful shutdown processMajorregionserver
HBASE-20851Change rubocop config for max line length of 100Minorcommunity, shell
HBASE-21467Fix flaky test TestCoprocessorClassLoader.testCleanupOldJarsMinor.
HBASE-22312Hadoop 3 profile for hbase-shaded-mapreduce should like mapreduce as a provided dependencyMajormapreduce, shading
HBASE-22314shaded byo-hadoop client should list needed hadoop modules as provided scope to avoid inclusion of unnecessary transitive depednenciesMajorhadoop2, hadoop3, shading
HBASE-22047LeaseException in Scan should be retiredMajorClient, Scanners
HBASE-22343Make procedure retry interval configurable in testMajoramv2, test
HBASE-22190SnapshotFileCache may fail to load the correct snapshot file list when there is an on-going snapshot operationBlockersnapshots
HBASE-22354master never sets abortRequested, and thus abort timeout doesn't work for itMajor.
HBASE-22350Rewrite TestClientOperationTimeout so we do not timeout when creating tableMajortest
HBASE-22340Corrupt KeyValue is silently ignoredCriticalwal
HBASE-22054Space Quota: Compaction is not working for super user in case of NO_WRITES_COMPACTIONSMinor.
HBASE-22236AsyncNonMetaRegionLocator should not cache HRegionLocation with null locationMajorasyncclient
HBASE-22086space quota issue: deleting snapshot doesn't update the usage of tableMinor.
HBASE-22298branch-2.2 nightly fails “[ForOverride] Method annotated @ForOverride must have protected or package-private visibility”Major.
HBASE-22292PreemptiveFastFailInterceptor clean repeatedFailuresMap issueBlocker.
HBASE-22230REST Server drops connection on long scansMajor.
HBASE-22200WALSplitter.hasRecoveredEdits should use same FS instance from WAL region dirMajorwal
HBASE-22286License handling incorrectly lists CDDL/GPLv2+CE as safe to not aggregateCriticalbuild, community
HBASE-22282Should deal with error in the callback of RawAsyncHBaseAdmin.splitRegion methodsMajorAdmin, asyncclient
HBASE-22278RawAsyncHBaseAdmin should not use cached region locationMajorAdmin, asyncclient
HBASE-22222Site build fails after hbase-thirdparty upgradeBlockerwebsite
HBASE-22249Rest Server throws NoClassDefFoundError with Java 11 (run-time)Major.
HBASE-22235OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessorsMajorCoprocessors
HBASE-22207Fix flakey TestAssignmentManager.testAssignSocketTimeoutMajortest
HBASE-22202Fix new findbugs issues after we upgrade hbase-thirdparty dependenciesMajorfindbugs
HBASE-22144MultiRowRangeFilter does not work with reversed scansCriticalFilters, Scanners
HBASE-22198Fix flakey TestAsyncTableGetMultiThreadedMajortest
HBASE-22185RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch blockMajor.
HBASE-22163Should not archive the compacted store files when region warmupBlocker.
HBASE-22178Introduce a createTableAsync with TableDescriptor method in AdminMajorAdmin
HBASE-22180Make TestBlockEvictionFromClient.testBlockRefCountAfterSplits more stableMajortest
HBASE-22179Fix RawAsyncHBaseAdmin.getCompactionStateMajorAdmin, asyncclient
HBASE-22177Do not recreate IOException in RawAsyncHBaseAdmin.adminCallMajorAdmin, asyncclient
HBASE-22070Checking restoreDir in RestoreSnapshotHelperMinorsnapshots
HBASE-20912Add import order config in dev support for eclipseMajor.
HBASE-22133Forward port HBASE-22073 “/rits.jsp throws an exception if no procedure” to branch-2.2+MajorUI
HBASE-20911correct Swtich/case indentation in formatter template for eclipseMajor.
HBASE-21688Address WAL filesystem issuesMajorFilesystem Integration, wal
HBASE-22121AsyncAdmin can not deal with non default meta replicaMajorAdmin, asyncclient, Client
HBASE-22115HBase RPC aspires to grow an infinite tree of trace scopes; some other places are also unsafeCritical.
HBASE-22123REST gateway reports Insufficient permissions exceptions as 404 Not FoundMinorREST
HBASE-21135Build fails on windows as it fails to parse windows path during license checkMajorbuild
HBASE-21781list_deadservers elapsed time is incorrectMajorshell
HBASE-22100False positive for error prone warnings in pre commit jobMinorbuild
HBASE-22098Backport HBASE-18667 “Disable error-prone for hbase-protocol-shaded” to branch-2Majorbuild
HBASE-20662Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcementMajor.
HBASE-22057Impose upper-bound on size of ZK ops sent in a single multi()Major.
HBASE-22074Should use procedure store to persist the state in reportRegionStateTransitionBlockeramv2, proc-v2
HBASE-21619Fix warning message caused by incorrect ternary operator evaluationTrivial.
HBASE-22095Taking a snapshot fails in local modeMajor.
HBASE-22061SplitTableRegionProcedure should hold the lock of its daughter regionsMajor.
HBASE-22045Mutable range histogram reports incorrect outliersMajor.
HBASE-21736Remove the server from online servers before scheduling SCP for it in hbckMajorhbck2, test
HBASE-22011ThriftUtilities.getFromThrift should set filter when not set columnsMajor.
HBASE-21990puppycrawl checkstyle dtds 404... moved to sourceforgeMajorbuild
HBASE-22010docs on upgrade from 2.0,2.1 -> 2.2 renders incorrectlyMinordocumentation
HBASE-22006Fix branch-2.1 findbugs warning; causes nightly show as failed.Major.
HBASE-21960RESTServletContainer not configured for REST Jetty serverBlockerREST
HBASE-21915FileLink$FileLinkInputStream doesn't implement CanUnbufferMajorFilesystem Integration
HBASE-21565Delete dead server from dead server list too early leads to concurrent Server Crash Procedures(SCP) for a same serverCritical.
HBASE-21740NPE happens while shutdown the RSMajor.
HBASE-21866Do not move the table to null rsgroup when creating an existing tableMajorproc-v2, rsgroup
HBASE-21983Should track the scan metrics in AsyncScanSingleRegionRpcRetryingCaller if scan metrics is enabledMajorasyncclient, Client
HBASE-21980Fix typo in AbstractTestAsyncTableRegionReplicasReadMajortest
HBASE-21487Concurrent modify table ops can lead to unexpected resultsMajor.
HBASE-20724Sometimes some compacted storefiles are still opened after region failoverCritical.
HBASE-21961Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty rowCriticalasyncclient, Client
HBASE-21943The usage of RegionLocations.mergeRegionLocations is wrong for async clientCriticalasyncclient, Client
HBASE-21947TestShell is broken after we remove the jackson dependenciesMajordependencies, shell
HBASE-21942[UI] requests per second is incorrect in rsgroup page(rsgroup.jsp)Minor.
HBASE-21922BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filterMajor.
HBASE-21929The checks at the end of TestRpcClientLeaks are not executedMajortest
HBASE-21938Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metricsMajor.
HBASE-21928Deprecated HConstants.META_QOSMajorClient, rpc
HBASE-21899Fix missing variables in slf4j LoggerTriviallogging
HBASE-21910The nonce implementation is wrong for AsyncTableCriticalasyncclient, Client
HBASE-21900Infinite loop in AsyncMetaRegionLocator if we can not get the location for metaMajorasyncclient, Client
HBASE-21890Use execute instead of submit to submit a task in RemoteProcedureDispatcherCriticalproc-v2
HBASE-21889Use thrift 0.12.0 when build thrift by compile-thrift profileMajor.
HBASE-21785master reports open regions as RITs and also messes up rit age metricMajor.
HBASE-21854Race condition in TestProcedureSkipPersistenceMinorproc-v2
HBASE-21862IPCUtil.wrapException should keep the original exception types for all the connection exceptionsBlocker.
HBASE-18484VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clustersMajorReplication
HBASE-21775The BufferedMutator doesn't ever refresh region location cacheMajorClient
HBASE-21843RegionGroupingProvider breaks the meta wal file name pattern which may cause data loss for meta regionBlockerwal
HBASE-21795Client application may get stuck (time bound) if a table modify op is called immediately after split opCriticalamv2
HBASE-21840TestHRegionWithInMemoryFlush fails with NPEBlockertest
HBASE-21811region can be opened on two servers due to race condition with procedures and server reportsBlockeramv2
HBASE-21644Modify table procedure runs infinitely for a table having region replication > 1CriticalAdmin
HBASE-21733SnapshotQuotaObserverChore should only fetch space quotasMajor.
HBASE-21699Create table failed when using SPLITS_FILE => ‘splits.txt’BlockerClient, shell
HBASE-21535Zombie Master detector is not workingCriticalmaster
HBASE-21770Should deal with meta table in HRegionLocator.getAllRegionLocationsMajorClient
HBASE-21754ReportRegionStateTransitionRequest should be executed in priority executorMajor.
HBASE-21475Put mutation (having TTL set) added via co-processor is retrieved even after TTL expiresMajorCoprocessors
HBASE-21749RS UI may throw NPE and make rs-status page inaccessible with multiwal and replicationMajorReplication, UI
HBASE-21746Fix two concern cases in RegionMoverMajor.
HBASE-21732Should call toUpperCase before using Enum.valueOf in some methods for ColumnFamilyDescriptorCriticalClient
HBASE-21704The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrectMajor.
HBASE-20917MetaTableMetrics#stop references uninitialized requestsMap for non-meta regionMajormeta, metrics
HBASE-21639maxHeapUsage value not read properly from config during EntryBuffers initializationMinor.
HBASE-21225Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using ‘NONE’Major.
HBASE-21707Fix warnings in hbase-rsgroup module and also make the UTs more stableMajorRegion Assignment, rsgroup
HBASE-20220[RSGroup] Check if table exists in the cluster before moving it to the specified regionserver groupMajorrsgroup
HBASE-21691Fix flaky test TestRecoveredEditsMajor.
HBASE-21695Fix flaky test TestRegionServerAbortTimeoutMajor.
HBASE-21614RIT recovery with ServerCrashProcedure doesn't account for all regionsCriticalamv2
HBASE-21618Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one resultCriticalClient
HBASE-21683Reset readsEnabled flag after successfully flushing the primary regionCriticalread replicas
HBASE-21630[shell] Define ENDKEY == STOPROW (we have ENDROW)Trivialshell
HBASE-21547Precommit uses master flaky list for other branchesMajortest
HBASE-21660Apply the cell to right memstore for increment/append operationMajor.
HBASE-21646Flakey TestTableSnapshotInputFormat; DisableTable not completing...Majortest
HBASE-21545NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columnsMajorAPI
HBASE-21629draining_servers.rb is brokenMajorscripts
HBASE-21621Reversed scan does not return expected number of rowsCriticalScanners
HBASE-21620Problem in scan query when using more than one column prefix filter in some cases.MajorScanners
HBASE-21610numOpenConnections metric is set to -1 when zero server channel existMinormetrics
HBASE-21498Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCacheMajor.
HBASE-21592quota.addGetResult(r) throw NPEMajor.
HBASE-21589TestCleanupMetaWAL failsBlockertest, wal
HBASE-21575memstore above high watermark message is logged too muchMinorlogging, regionserver
HBASE-21582If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every timeMajor.
HBASE-21568Disable use of BlockCache for LoadIncrementalHFilesMajorClient
HBASE-21453Convert ReadOnlyZKClient to DEBUG instead of INFOMajorlogging, Zookeeper
HBASE-21559The RestoreSnapshotFromClientTestBase related UT are flakyMajor.
HBASE-21551Memory leak when use scan with STREAM at server sideBlockerregionserver
HBASE-21550Add a new method preCreateTableRegionInfos for MasterObserver which allows CPs to modify the TableDescriptorMajorCoprocessors
HBASE-21479Individual tests in TestHRegionReplayEvents class are failingMajor.
HBASE-21518TestMasterFailoverWithProcedures is flakyMajor.
HBASE-21504If enable FIFOCompactionPolicy, a compaction may write a “empty” hfile whose maxTimeStamp is long max. This kind of hfile will never be archived.CriticalCompaction
HBASE-21300Fix the wrong reference file path when restoring snapshots for tables with MOB columnsMajor.
HBASE-21507Compaction failed when execute AbstractMultiFileWriter.beforeShipped() methodMajorCompaction, regionserver
HBASE-21387Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot filesMajorsnapshots
HBASE-21503Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads.BlockerReplication
HBASE-21466WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdirMajor.
HBASE-21445CopyTable by bulkload will write hfile into yarn's HDFSMajormapreduce
HBASE-21437Bypassed procedure throw IllegalArgumentException when its state is WAITING_TIMEOUTMajor.
HBASE-21439StochasticLoadBalancer RegionLoads aren’t being used in RegionLoad cost functionsMajorBalancer
HBASE-20604ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolledCriticalReplication, wal
HBASE-21247Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in ProvidersMajorwal
HBASE-21430[hbase-connectors] Move hbase-spark* modules to hbase-connectors repoMajorhbase-connectors, spark
HBASE-21438TestAdmin2#testGetProcedures fails due to FailedProcedure inaccessibleMajor.
HBASE-214252.1.1 fails to start over 1.x data; namespace not assignedCriticalamv2
HBASE-21407Resolve NPE in backup Master UIMinorUI
HBASE-21422NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONRMajorproc-v2, test
HBASE-21424Change flakies and nightlies so scheduled less oftenMajorbuild
HBASE-21417Pre commit build is broken due to surefire plugin crashesCriticalbuild
HBASE-21371Hbase unable to compile against Hadoop trunk (3.3.0-SNAPSHOT) due to license errorMajor.
HBASE-21391RefreshPeerProcedure should also wait master initialized before executingMajorReplication
HBASE-21342FileSystem in use may get closed by other bulk load call in secure bulkLoadMajor.
HBASE-21349Cluster is going down but CatalogJanitor and Normalizer try to run and fail noiselyMinor.
HBASE-21356bulkLoadHFile API should ensure that rs has the source hfile's write permissionMajor.
HBASE-21355HStore's storeSize is calculated repeatedly which causing the confusing region splitBlockerregionserver
HBASE-21334TestMergeTableRegionsProcedure is flakeyMajoramv2, proc-v2, test
HBASE-21178[BC break] : Get and Scan operation with a custom converter_class not workingCriticalshell
HBASE-21200Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner.CriticalScanners
HBASE-21292IdLock.getLockEntry() may hang if interruptedMajor.
HBASE-21335Change the default wait time of HBCK2 toolCritical.
HBASE-21291Add a test for bypassing stuck state-machine proceduresMajor.
HBASE-21055NullPointerException when balanceOverall() but server balance info is nullMajorBalancer
HBASE-21327Fix minor logging issue where we don't report servername if no associated SCPTrivialamv2
HBASE-21320[canary] Cleanup of usage and add commentaryMajorcanary
HBASE-21266Not running balancer because processing dead regionservers, but empty dead rs listMajor.
HBASE-21260The whole balancer plans might be aborted if there are more than one plans to move a same regionMajorBalancer, master
HBASE-21280Add anchors for each heading in UITrivialUI, Usability
HBASE-20764build broken when latest commit is gpg signedCriticalbuild
HBASE-18549Unclaimed replication queues can go undetectedCriticalReplication
HBASE-21248Implement exponential backoff when retrying for ModifyPeerProcedureMajorproc-v2, Replication
HBASE-21196HTableMultiplexer clears the meta cache after every put operationCriticalPerformance
HBASE-19418RANGE_OF_DELAY in PeriodicMemstoreFlusher should be configurable.Minor.
HBASE-18451PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush requestMajorregionserver
HBASE-21228Memory leak since AbstractFSWAL caches Thread object and never clean laterCriticalwal
HBASE-20766Verify Replication Tool Has Typo “remove cluster”Trivial.
HBASE-21232Show table state in Tables view on Master home pageMajorOperability, UI
HBASE-21212Wrong flush time when update flush metricMinor.
HBASE-21208Bytes#toShort doesn't work without unsafeCritical.
HBASE-20704Sometimes some compacted storefiles are not archived on region closeCriticalCompaction
HBASE-21203TestZKMainServer#testCommandLineWorks won't pass with default 4lw whitelistMinortest, Zookeeper
HBASE-21102ServerCrashProcedure should select target server where no other replicas exist for the current regionMajorRegion Assignment
HBASE-21206Scan with batch size may return incomplete cellsCriticalScanners
HBASE-21182Failed to execute start-hbase.shMajor.
HBASE-21179Fix the number of actions in responseTooSlow logMajorlogging, rpc
HBASE-21174[REST] Failed to parse empty qualifier in TableResource#getScanResourceMajorREST
HBASE-21181Use the same filesystem for wal archive directory and wal directoryMajor.
HBASE-21021Result returned by Append operation should be orderedMajor.
HBASE-21173Remove the duplicate HRegion#close in TestHRegionMinortest
HBASE-21144AssignmentManager.waitForAssignment is not stableMajoramv2, test
HBASE-21143Update findbugs-maven-plugin to 3.0.4Majorpom
HBASE-21171[amv2] Tool to parse a directory of MasterProcWALs standaloneMajoramv2, test
HBASE-21052After restoring a snapshot, table.jsp page for the table gets stuckMajorsnapshots
HBASE-21001ReplicationObserver fails to load in HBase 2.0.0Major.
HBASE-20741Split of a region with replicas creates all daughter regions and its replica in same serverMajorread replicas
HBASE-21127TableRecordReader need to handle cursor result tooMajor.
HBASE-20892[UI] Start / End keys are empty on table.jspMajor.
HBASE-21136NPE in MetricsTableSourceImpl.updateFlushTimeMajormetrics
HBASE-21132return wrong result in rest multigetMajor.
HBASE-21128TestAsyncRegionAdminApi.testAssignRegionAndUnassignRegion is brokenMajortest
HBASE-20940HStore.cansplit should not allow split to happen if it has referencesMajor.
HBASE-21084When cloning a snapshot including a split parent region, the split parent region of the cloned table will be onlineMajorsnapshots
HBASE-20968list_procedures_test fails due to no matching regexMajorshell, test
HBASE-21030Correct javadoc for append operationMinordocumentation
HBASE-21088HStoreFile should be closed in HStore#hasReferencesMajor.
HBASE-20890PE filterScan seems to be stuck foreverMinor.
HBASE-20772Controlled shutdown fills Master log with the disturbing message "No matching procedure found for rit=OPEN, location=ZZZZ, table=YYYYY, region=XXXX transition to CLOSEDMajorlogging
HBASE-20978[amv2] Worker terminating UNNATURALLY during MoveRegionProcedureCriticalamv2
HBASE-21078[amv2] CODE-BUG NPE in RTP doing UnassignMajoramv2
HBASE-21113Apply the branch-2 version of HBASE-21095, The timeout retry logic for several procedures are broken after master restartsMajoramv2
HBASE-21101Remove the waitUntilAllRegionsAssigned call after split in TestTruncateTableProcedureMajortest
HBASE-19008Add missing equals or hashCode method(s) to stock Filter implementationsMajor.
HBASE-20614REST scan API with incorrect filter text file throws HTTP 503 Service Unavailable errorMinorREST
HBASE-21041Memstore's heap size will be decreased to minus zero after flushMajor.
HBASE-21031Memory leak if replay edits failed during region openingMajor.
HBASE-20666Unsuccessful table creation leaves entry in hbase:rsgroup tableMinor.
HBASE-21032ScanResponses contain only one cell eachMajorPerformance, Scanners
HBASE-20705Having RPC Quota on a table prevents Space quota to be recreated/removedMajor.
HBASE-21058Nightly tests for branches 1 fail to build ref guideMajordocumentation
HBASE-21074JDK7 branches need to pass “-Dhttps.protocols=TLSv1.2” to maven when buildingMajorbuild, community, test
HBASE-21062WALFactory has misleading notion of “default”Majorwal
HBASE-21047Object creation of StoreFileScanner thru constructor and close may leave refCount to -1Major.
HBASE-21005Maven site configuration causes downstream projects to get a directory named ${project.basedir}Minorbuild
HBASE-21007Memory leak in HBase rest serverCriticalREST
HBASE-20794CreateTable operation does not log its landing at the master nor the initiator at INFO levelMajorlogging
HBASE-20538Upgrade our hadoop versions to 2.7.7 and 3.0.3Criticaljava, security
HBASE-20927RSGroupAdminEndpoint doesn't handle clearing dead servers if they are not processed yet.Major.
HBASE-20932Effective MemStoreSize::hashCode()Major.
HBASE-20928Rewrite calculation of midpoint in binarySearch functions to prevent overflowMinorio
HBASE-20565ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result since 1.4MajorFilters
HBASE-20908Infinite loop on regionserver if region replica are reducedMajorread replicas
HBASE-19893restore_snapshot is broken in master branch when region splitsCriticalsnapshots
HBASE-20870Wrong HBase root dir in ITBLL's Search ToolMinorintegration tests
HBASE-20901Reducing region replica has no effectMajor.
HBASE-6028Implement a cancel for in-progress compactionsMinorregionserver
HBASE-20869Endpoint-based Export use incorrect user to write to destinationMajorCoprocessors
HBASE-20879Compacting memstore config should handle lower caseMajor.
HBASE-20865CreateTableProcedure is stuck in retry loop in CREATE_TABLE_WRITE_FS_LAYOUT stateMajoramv2
HBASE-19572RegionMover should use the configured default port number and not the one from HConstantsMajor.
HBASE-20697Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()Majormeta
HBASE-20791RSGroupBasedLoadBalancer#setClusterMetrics should pass ClusterMetrics to its internalBalancerMajorBalancer, rsgroup
HBASE-20770WAL cleaner logs way too much; gets clogged when lots of work to doCriticallogging

TESTS:

JIRASummaryPriorityComponent
HBASE-21963Add a script for building and verifying release candidateMinorcommunity, scripts
HBASE-21756Backport HBASE-21279 (Split TestAdminShell into several tests) to branch-2Major.
HBASE-20136TestKeyValue misses ClassRule and Category annotationsMinor.
HBASE-21261Add log4j.properties for hbase-rsgroup testsTrivial.
HBASE-21258Add resetting of flags for RS Group pre/post hooks in TestRSGroupsMajor.
HBASE-21097Flush pressure assertion may fail in testFlushThroughputTuningMajorregionserver
HBASE-21138Close HRegion instance at the end of every test in TestHRegionMajor.
HBASE-21161Enable the test added in HBASE-20741 that was removed accidentallyMinor.
HBASE-21076TestTableResource fails with NPEMajorREST, test
HBASE-20907Fix Intermittent failure on TestProcedurePriorityMajor.
HBASE-20838Include hbase-server in precommit test if CommonFSUtils is changedMajor.

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-21970Document that how to upgrade from 2.0 or 2.1 to 2.2+Major.
HBASE-22357Fix remaining Checkstyle issues in hbase-replicationTrivialReplication
HBASE-22554Upgrade to surefire 2.22.2Majortest
HBASE-22500Modify pom and jenkins jobs for hadoop versionsBlockerbuild, hadoop2, hadoop3
HBASE-22316Record the stack trace for current thread in FutureUtils.getMajorasyncclient, Client
HBASE-22326Fix Checkstyle errors in hbase-examplesMinor.
HBASE-22327Fix remaining Checkstyle issues in hbase-hadoop-compatTrivial.
HBASE-22478Add jackson dependency for hbase-http moduleMajorbuild, dependencies
HBASE-22445Add file info when throw exceptions in HFileReaderImplMajor.
HBASE-22447Check refCount before free block in BucketCacheMajorBucketCache
HBASE-22400Remove the adapter code in async fs implementation for hadoop-2.7.xMajorwal
HBASE-22430hbase-vote should tee build and test output to consoleTrivial.
HBASE-22429hbase-vote download step requires URL to end with ‘/’Trivial.
HBASE-22405Update Ref Guide for EOL of Hadoop 2.7Majorcommunity, documentation
HBASE-22325AsyncRpcRetryingCaller will not schedule retry if we hit a NotServingRegionException but there is no TableName providedMajorasyncclient, Client
HBASE-22322Use special pause for CallQueueTooBigExceptionMajorasyncclient, Client
HBASE-22317Support reading from meta replicasMajorasyncclient, read replicas
HBASE-22261Make use of ClusterStatusListener for async clientMajorasyncclient
HBASE-22267Implement client push back for async clientMajorasyncclient
HBASE-19763Fix Checkstyle errors in hbase-procedureMinor.
HBASE-22244Make use of MetricsConnection in async clientMajorasyncclient, metrics
HBASE-22196Split TestRestartClusterMajortest
HBASE-22117Move hasPermission/checkPermissions from region server to masterMajor.
HBASE-21886Run ITBLL for branch-2.2Major.
HBASE-22155Move 2.2.0 on to hbase-thirdparty-2.2.0Majorthirdparty
HBASE-22153Fix the flaky TestRestartClusterMajortest
HBASE-22152Create a jenkins file for yetus to processing GitHub PRMajorbuild
HBASE-22158RawAsyncHBaseAdmin.getTableSplits should filter out none default replicasMajorAdmin
HBASE-22157Include the cause when constructing RestoreSnapshotException in restoreSnapshotMajorAdmin
HBASE-22141Fix TestAsyncDecommissionAdminApiMajortest
HBASE-22135AsyncAdmin will not refresh master addressMajorAdmin, asyncclient, Client
HBASE-22101AsyncAdmin.isTableAvailable should not throw TableNotFoundExceptionMajorAdmin, asyncclient, Client
HBASE-22094Throw TableNotFoundException if table not exists in AsyncAdmin.compactMajorAdmin
HBASE-21911Move getUserPermissions from regionserver to masterMajor.
HBASE-22015UserPermission should be annotated as InterfaceAudience.PublicBlocker.
HBASE-22066Add markers to CHANGES.md and RELEASENOTES.mdMajor.
HBASE-22040Add mergeRegionsAsync with a List of region names method in AsyncAdminMajorAdmin, asyncclient, Client
HBASE-22039Should add the synchronous parameter for the XXXSwitch method in AsyncAdminMajorAdmin, asyncclient, Client
HBASE-22022nightly fails rat check down in the dev-support/hbase_nightly_source-artifact.sh checkMajor.
HBASE-22025RAT check fails in nightlies; fails on (old) test data files.Major.
HBASE-21977Skip replay WAL and update seqid when open regions restored from snapshotMajorRegion Assignment, snapshots
HBASE-21999[DEBUG] Exit if git returns empty revision!Majorbuild
HBASE-22000Deprecated isTableAvailable with splitKeysMajorasyncclient, Client
HBASE-21949Fix flaky test TestHBaseTestingUtility.testMiniZooKeeperWithMultipleClientPortsMajor.
HBASE-21993Set version as 2.2.0 in branch-2.2 in prep for first RCMajor.
HBASE-21997Fix hbase-rest findbugs ST_WRITE_TO_STATIC_FROM_INSTANCE_METHOD complaintMajorREST
HBASE-21986Generate CHANGES.md and RELEASENOTES.md for 2.2.0Major.
HBASE-21972Copy master doc into branch-2.2 and edit to make it suit 2.2.0Major.
HBASE-15728Add remaining per-table region / store / flush / compaction related metricsMajormetrics
HBASE-21934RemoteProcedureDispatcher should track the ongoing dispatched callsBlockerproc-v2
HBASE-21588Procedure v2 wal splitting implementationMajor.
HBASE-21729Extract ProcedureCoordinatorRpcs and ProcedureMemberRpcs from CoordinatedStateManagerMajor.
HBASE-21094Remove the explicit timeout config for TestTruncateTableProcedureMajortest
HBASE-21093Move TestCreateTableProcedure.testMRegions to a separated fileMajortest
HBASE-18201add UT and docs for DataBlockEncodingToolMinortooling
HBASE-21978Should close AsyncRegistry if we fail to get cluster id when creating AsyncConnectionMajorasyncclient, Client
HBASE-21974Change Admin#grant/revoke parameter from UserPermission to user and PermissionMajor.
HBASE-21976Deal with RetryImmediatelyException for batching requestMajorasyncclient, Client
HBASE-21820Implement CLUSTER quota scopeMajor.
HBASE-21962Filters do not work in ThriftTableMajorThrift
HBASE-21927Always fail the locate request when error occurMajorasyncclient, Client
HBASE-21944Validate put for batch operationMajorasyncclient, Client
HBASE-21945Maintain the original order when sending batch requestMajorasyncclient, Client
HBASE-21783Support exceed user/table/ns throttle quota if region server has available quotaMajor.
HBASE-21930Deal with ScannerResetException when opening region scannerMajorasyncclient, Client
HBASE-21907Should set priority for rpc requestMajorasyncclient, Client
HBASE-21909Validate the put instance before executing in AsyncTable.put methodMajorasyncclient, Client
HBASE-21814Remove the TODO in AccessControlLists#addUserPermissionMajor.
HBASE-19889Revert Workaround: Purge User API building from branch-2 so can make a beta-1Majorwebsite
HBASE-21838Create a special ReplicationEndpoint just for verifying the WAL entries are fineMajorReplication, wal
HBASE-21829Use FutureUtils.addListener instead of calling whenComplete directlyMajorasyncclient, Client
HBASE-21828Make sure we do not return CompletionException when locating regionMajorasyncclient, Client
HBASE-21764Size of in-memory compaction thread pool should be configurableMajorCompaction, in-memory-compaction
HBASE-21809Add retry thrift client for ThriftTable/AdminMajor.
HBASE-21739Move grant/revoke from regionserver to masterMajor.
HBASE-21798Cut branch-2.2Major.
HBASE-20542Better heap utilization for IMC with MSLABsMajorin-memory-compaction
HBASE-21713Support set region server throttle quotaMajor.
HBASE-21761Align the methods in RegionLocator and AsyncTableRegionLocatorMajorasyncclient, Client
HBASE-17370Fix or provide shell scripts to drain and decommission region serverMajor.
HBASE-21750Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimizedMajor.
HBASE-21734Some optimization in FilterListWithORMajor.
HBASE-21738Remove all the CSLM#size operation in our memstore because it's an quite time consuming.CriticalPerformance
HBASE-21034Add new throttle type: read/write capacity unitMajor.
HBASE-21726Add getAllRegionLocations method to AsyncTableRegionLocatorMajorasyncclient, Client
HBASE-19695Handle disabled table for async clientMajorasyncclient, Client
HBASE-21711Remove references to git.apache.org/hbase.gitCritical.
HBASE-21647Add status track for splitting WAL tasksMajorOperability
HBASE-21705Should treat meta table specially for some methods in AsyncAdminMajorAdmin, asyncclient, Client
HBASE-21663Add replica scan supportMajorasyncclient, Client, read replicas
HBASE-21580Support getting Hbck instance from AsyncConnectionMajorasyncclient, Client, hbck2
HBASE-21652Refactor ThriftServer making thrift2 server inherited from thrift1 serverMajor.
HBASE-21661Provide Thrift2 implementation of Table/AdminMajor.
HBASE-21682Support getting from specific replicaMajorread replicas
HBASE-21159Add shell command to switch throttle on or offMajor.
HBASE-21362Disable printing of stack-trace in shell when quotas are violatedMinorshell
HBASE-21361Disable printing of stack-trace in shell when quotas are not enabledMinorshell
HBASE-17356Add replica get supportMajorClient
HBASE-21650Add DDL operation and some other miscellaneous to thrift2MajorThrift
HBASE-21401Sanity check when constructing the KeyValueCriticalregionserver
HBASE-21578Fix wrong throttling exception for capacity unitMajor.
HBASE-21570Add write buffer periodic flush support for AsyncBufferedMutatorMajorasyncclient, Client
HBASE-21465Retry on reportRegionStateTransition can lead to unexpected errorsMajoramv2
HBASE-21508Ignore the reportRegionStateTransition call from a dead serverMajoramv2
HBASE-21490WALProcedure may remove proc wal files still with active proceduresMajorproc-v2
HBASE-21377Add debug log for procedure stack id related operationsMajorproc-v2
HBASE-21472Should not persist the dispatched field for RegionRemoteProcedureBaseMajoramv2
HBASE-21473RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tagsMajor.
HBASE-21463The checkOnlineRegionsReport can accidentally complete a TRSPCriticalamv2
HBASE-21376Add some verbose log to MasterProcedureSchedulerMajorlogging, proc-v2
HBASE-21443[hbase-connectors] Purge hbase-* modules from core now they've been moved to hbase-connectorsMajorhbase-connectors, spark
HBASE-21421Do not kill RS if reportOnlineRegions failsMajor.
HBASE-21314The implementation of BitSetNode is not efficientMajorproc-v2
HBASE-21351The force update thread may have race with PE worker when the procedure is rolling backCriticalproc-v2
HBASE-21191Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).Majoramv2
HBASE-21322Add a scheduleServerCrashProcedure() API to HbckServiceCriticalhbck2
HBASE-21375Revisit the lock and queue implementation in MasterProcedureSchedulerMajorproc-v2
HBASE-20973ArrayIndexOutOfBoundsException when rolling back procedureCriticalamv2
HBASE-21384Procedure with holdlock=false should not be restored lock when restartsBlocker.
HBASE-21364Procedure holds the lock should put to front of the queue after restartBlocker.
HBASE-21215Figure how to invoke hbck2; make it easy to findMajoramv2, hbck2
HBASE-21372Set hbase.assignment.maximum.attempts to Long.MAXMajoramv2
HBASE-21363Rewrite the buildingHoldCleanupTracker method in WALProcedureStoreMajorproc-v2
HBASE-21338[balancer] If balancer is an ill-fit for cluster size, it gives little indicationMajorBalancer, Operability
HBASE-21192Add HOW-TO repair damaged AMv2.Majoramv2
HBASE-21073“Maintenance mode” masterMajoramv2, hbck2, master
HBASE-21354Procedure may be deleted improperly during master restarts resulting in ‘Corrupt’Major.
HBASE-21336Simplify the implementation of WALProcedureMapMajorproc-v2
HBASE-21323Should not skip force updating for a sub procedure even if it has been finishedMajorproc-v2
HBASE-21269Forward-port to branch-2 " HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign"Majoramv2
HBASE-20716Unsafe access cleanupCriticalPerformance
HBASE-21330ReopenTableRegionsProcedure will enter an infinite loop if we schedule a TRSP at the same timeMajoramv2
HBASE-21310Split TestCloneSnapshotFromClientMajortest
HBASE-21311Split TestRestoreSnapshotFromClientMajortest
HBASE-21315The getActiveMinProcId and getActiveMaxProcId of BitSetNode are incorrect if there are no active procedureMajor.
HBASE-21278Do not rollback successful sub procedures when rolling back a procedureCriticalproc-v2
HBASE-21309Increase the waiting timeout for TestProcedurePriorityMajortest
HBASE-21254Need to find a way to limit the number of proc wal filesCriticalproc-v2
HBASE-21250Refactor WALProcedureStore and add more comments for better understanding the implementationMajorproc-v2
HBASE-19275TestSnapshotFileCache never worked properlyMajor.
HBASE-21249Add jitter for ProcedureUtil.getBackoffTimeMsMajorproc-v2
HBASE-21244Skip persistence when retrying for assignment related proceduresMajoramv2, Performance, proc-v2
HBASE-21233Allow the procedure implementation to skip persistence of the state after a executionMajorPerformance, proc-v2
HBASE-21227Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217Majoramv2, regionserver
HBASE-21217Revisit the executeProcedure method for open/close regionCriticalamv2, proc-v2
HBASE-21214[hbck2] setTableState just sets hbase:meta state, not in-memory stateMajoramv2, hbck2
HBASE-21023Add bypassProcedureToCompletion() API to HbckServiceMajorhbck2
HBASE-21156[hbck2] Queue an assign of hbase:meta and bulk assign/unassignCriticalhbck2
HBASE-21169Initiate hbck2 tool in hbase-operator-tools repoMajorhbck2
HBASE-21172Reimplement the retry backoff logic for ReopenTableRegionsProcedureMajoramv2, proc-v2
HBASE-21189flaky job should gather machine statsMinortest
HBASE-21190Log files and count of entries in each as we load from the MasterProcWAL storeMajoramv2
HBASE-21083Introduce a mechanism to bypass the execution of a stuck procedureMajoramv2
HBASE-21017Revisit the expected states for open/closeMajoramv2
HBASE-20941Create and implement HbckService in masterMajor.
HBASE-21072Block out HBCK1 in hbase2Majorhbck
HBASE-21095The timeout retry logic for several procedures are broken after master restartsCriticalamv2, proc-v2
HBASE-20975Lock may not be taken or released while rolling back procedureMajoramv2
HBASE-21025Add cache for TableStateManagerMajor.
HBASE-21012Revert the change of serializing TimeRangeTrackerCritical.
HBASE-20813Remove RPC quotas when the associated table/Namespace is dropped offMinor.
HBASE-20885Remove entry for RPC quota from hbase:quota when RPC quota is removed.Minor.
HBASE-20893Data loss if splitting region while ServerCrashProcedure executingMajor.
HBASE-20950Helper method to configure secure DFS cluster for testsMajortest
HBASE-19369HBase Should use Builder Pattern to Create Log Files while using WAL on Erasure CodingMajor.
HBASE-20939There will be race when we call suspendIfNotReady and then throw ProcedureSuspendedExceptionCriticalamv2
HBASE-20921Possible NPE in ReopenTableRegionsProcedureMajoramv2
HBASE-20867RS may get killed while master restartsMajor.
HBASE-20878Data loss if merging regions while ServerCrashProcedure executingCriticalamv2
HBASE-20846Restore procedure locks when master restartsMajor.
HBASE-20914Trim Master memory usageMajorBalancer, master
HBASE-20853Polish “Add defaults to Table Interface so Implementors don't have to”MajorAPI
HBASE-20875MemStoreLABImp::copyIntoCell uses 7% CPU when writingMajorPerformance
HBASE-20860Merged region's RIT state may not be cleaned after master restartMajor.
HBASE-20847The parent procedure of RegionTransitionProcedure may not have the table lockMajorproc-v2, Region Assignment
HBASE-20776Update branch-2 version to 2.2.0-SNAPSHOTMajorbuild

OTHER:

JIRASummaryPriorityComponent
HBASE-21612Add developer debug options in HBase Config for REST serverMinorOperability, REST, scripts
HBASE-18735Provide a fast mechanism for shutting down mini clusterMajor.
HBASE-21489TestShell is brokenMajorshell
HBASE-20152[AMv2] DisableTableProcedure versus ServerCrashProcedureMajoramv2
HBASE-20540[umbrella] Hadoop 3 compatibilityMajor.
HBASE-21536Fix completebulkload usage instructionsTrivialdocumentation, mapreduce
HBASE-22449https everywhere in Maven metadataMinor.
HBASE-22406skip generating rdoc when building gems in our docker image for running yetusCriticalbuild, test
HBASE-22375Promote AccessChecker to LimitedPrivate(Coprocessor)MinorCoprocessors, security
HBASE-21714Deprecated isTableAvailableWithSplit method in thrift moduleMajorThrift
HBASE-22359Backport of HBASE-21371 misses activation-api license informationMinorbuild, community
HBASE-22174Remove error prone from our precommit javac checkMajorbuild
HBASE-22231Remove unused and * importsMinor.
HBASE-22304Fix remaining Checkstyle issues in hbase-endpointTrivial.
HBASE-22020upgrade to yetus 0.9.0Majorbuild, community
HBASE-22187Remove usage of deprecated ClusterConnection.clearRegionCacheTrivialClient
HBASE-22203Reformat DemoClient.javaTrivial.
HBASE-22189Remove usage of StoreFile.getModificationTimeStampTrivial.
HBASE-22108Avoid passing null in Admin methodsMajorAdmin
HBASE-22007Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdminMajorAdmin, asyncclient, Client
HBASE-22131Delete the patches in hbase-protocol-shaded moduleMajorbuild, Protobufs
HBASE-22099Backport HBASE-21895 “Error prone upgrade” to branch-2Majorbuild
HBASE-22052pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specificationsMajor.
HBASE-22065Add listTableDescriptors(List<TableName>) method in AsyncAdminMajorAdmin
HBASE-22042Missing @Override annotation for RawAsyncTableImpl.scanMajorasyncclient, Client
HBASE-21057upgrade to latest spotbugsMinorcommunity, test
HBASE-21888Add a isClosed method to AsyncConnectionMajorasyncclient, Client
HBASE-21884Fix box/unbox findbugs warning in secure bulk loadMinor.
HBASE-21859Add clearRegionLocationCache method for AsyncConnectionMajorasyncclient, Client
HBASE-21853update copyright notices to 2019Majordocumentation
HBASE-21791Upgrade thrift dependency to 0.12.0BlockerThrift
HBASE-21710Add quota related methods to the Admin interfaceMajor.
HBASE-21782LoadIncrementalHFiles should not be IA.PublicMajormapreduce
HBASE-21762Move some methods in ClusterConnection to ConnectionMajorClient
HBASE-21715Do not throw UnsupportedOperationException in ProcedureFuture.getMajorClient
HBASE-21716Add toStringCustomizedValues to TableDescriptorMajor.
HBASE-21731Do not need to use ClusterConnection in IntegrationTestBigLinkedListWithVisibilityMajor.
HBASE-21685Change repository urls to GitboxCritical.
HBASE-21534TestAssignmentManager is flakeyMajortest
HBASE-21541Move MetaTableLocator.verifyRegionLocation to hbase-rsgroup moduleMajor.
HBASE-21265Split up TestRSGroupsMinorrsgroup, test
HBASE-21517Move the getTableRegionForRow method from HMaster to TestMasterMajortest
HBASE-21281Update bouncycastle dependency.Majordependencies, test
HBASE-21198Exclude dependency on net.minidev:json-smartMajor.
HBASE-21282Upgrade to latest jetty 9.2 and 9.3 versionsMajordependencies
HBASE-21287JVMClusterUtil Master initialization wait time not configurableMajortest
HBASE-21168BloomFilterUtil uses hardcoded randomnessTrivial.
HBASE-20482Print a link to the ref guide chapter for the shell during startupMinordocumentation, shell
HBASE-20942Improve RpcServer TRACE loggingMajorOperability
HBASE-20989Minor, miscellaneous logging fixesTriviallogging