HBASE Changelog

Release 2.4.12 - Unreleased (as of 2022-04-30)

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-26961cache region locations when getAllRegionLocations() for branch-2.4+MinorClient
HBASE-26860Backport “HBASE-25681 Add a switch for server/table queryMeter” to branch-2.4Major.
HBASE-26980Update javadoc of BucketCache.javaTrivialdocumentation
HBASE-26581Add metrics around failed replication editsMinormetrics, Replication
HBASE-26971SnapshotInfo --snapshot param is marked as required even when trying to list all snapshotsMinor.
HBASE-26618Involving primary meta region in meta scan with CatalogReplicaLoadBalanceSimpleSelectorMinormeta replicas
HBASE-26885The TRSP should not go on when it get a bogus server name from AMMajorproc-v2
HBASE-26872Load rate calculator for cost functions should be more preciseMajorBalancer
HBASE-26832Avoid repeated releasing of flushed wal entries in AsyncFSWAL#syncCompletedMajorwal
HBASE-26878TableInputFormatBase should cache RegionSizeCalculatorMinor.
HBASE-26175MetricsHBaseServer should record all kinds of ExceptionsMinormetrics
HBASE-26858Refactor TestMasterRegionOnTwoFileSystems to avoid dead loopMajortest
HBASE-26848Set java.io.tmpdir on mvn command when running jenkins jobMajorjenkins, test
HBASE-26680Close and do not write trailer for the broken WAL writerMajorwal
HBASE-26720ExportSnapshot should validate the source snapshot before copying filesMajorsnapshots
HBASE-26275update error message when executing deleteall with ROWPREFIXFILTER in meta tableMinorshell

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26917Do not add --threads when running ‘mvn site’Majorbuild, scripts
HBASE-26941LocalHBaseCluster.waitOnRegionServer should not call join while interruptedCriticaltest
HBASE-26944Possible resource leak while creating new region scannerMajor.
HBASE-26895on hbase shell, ‘delete/deleteall’ for a columnfamily is not workingMajorshell
HBASE-26901delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is onMajorDeletes, Scanners
HBASE-26880Misspelling commands in hbase shell will crash the shellMinorshell
HBASE-26924[Documentation] Fix log parameter error and spelling errorTriviallogging
HBASE-26811Secondary replica may be disabled for read incorrectly foreverMajorread replicas
HBASE-26812ShortCircuitingClusterConnection fails to close RegionScanners when making short-circuited callsCritical.
HBASE-26838Junit jar is not included in the hbase tar ball, causing issues for some hbase tools that do rely on itMajorintegration tests, tooling
HBASE-26871shaded mapreduce and shaded byo-hadoop client artifacts contains no classesBlockerintegration tests, jenkins, mapreduce
HBASE-26896list_quota_snapshots fails with ‘ERROR NameError: uninitialized constant Shell::Commands::ListQuotaSnapshots::TABLE’Majorshell
HBASE-26718HFileArchiver can remove referenced StoreFiles from the archiveMajorCompaction, HFile, snapshots
HBASE-26864SplitTableRegionProcedure calls openParentRegions() at a wrong state during rollback.MajorRegion Assignment
HBASE-26876Use toStringBinary for rowkey in RegionServerCallable error stringMinor.
HBASE-26875RpcRetryingCallerImpl translateException ignores return value of recursive callMinor.
HBASE-26869RSRpcServices.scan should deep clone cells when RpcCallContext is nullMajorregionserver

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-26932Skip generating ref guide when running ‘mvn site’ on branch other than masterMajorbuild, pom
HBASE-26928Fix several indentation problemsMajor.
HBASE-26922Fix LineLength warnings as much as possible if it can not be fixed by spotlessMajor.
HBASE-26929Upgrade surefire plugin to 3.0.0-M6Majorpom, test
HBASE-26916Fix missing braces warnings in DefaultVisibilityExpressionResolverMajor.
HBASE-26919Rewrite the counting rows part in TestFromClientSide4Majortest
HBASE-26920Fix missing braces warnings in TestProcedureMemberMajortest
HBASE-26921Rewrite the counting cells part in TestMultiVersionsMajortest

OTHER:

JIRASummaryPriorityComponent
HBASE-26882Backport “HBASE-26810 Add dynamic configuration support for system coprocessors” to branch-2MajorCoprocessors, master, regionserver
HBASE-26903Bump httpclient from 4.5.3 to 4.5.13Minor.
HBASE-26902Bump bcprov-jdk15on from 1.60 to 1.67Minor.
HBASE-26834Adapt ConnectionRule for both sync and async connectionsMajortest
HBASE-26861Fix flaky TestSnapshotFromMaster.testSnapshotHFileArchivingMajorsnapshots, test

Release 2.4.11 - 2022-03-21

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-26828Increase the concurrency when running UTs in pre commit jobMajorjenkins, test
HBASE-26833Avoid waiting to clear buffer usage of ReplicationSourceShipper when aborting the RSMajorregionserver, Replication
HBASE-26835Rewrite TestLruAdaptiveBlockCache to make it more stableMajortest
HBASE-26830Rewrite TestLruBlockCache to make it more stableMajortest
HBASE-26552Introduce retry to logroller to avoid abortMajorwal
HBASE-26792Implement ScanInfo#toStringMinorregionserver
HBASE-26789Automatically add default security headers to http/rest if SSL enabledMajorREST, UI
HBASE-23303Add security headers to REST server/info pageMajorREST

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26840Fix NPE in the retry of logrollerMinorwal
HBASE-26670HFileLinkCleaner should be added even if snapshot is disabledCriticalsnapshots
HBASE-26761TestMobStoreScanner (testGetMassive) can OOMEMinormob, test
HBASE-26816Fix CME in ReplicationSourceManagerMinorReplication
HBASE-26715Blocked on SyncFuture in AsyncProtobufLogWriter#writeMajor.
HBASE-26815TestFanOutOneBlockAsyncDFSOutput is flakeyMajortest
HBASE-26783ScannerCallable doubly clears meta cache on retriesMajor.
HBASE-25709Close region may stuck when region is compacting and skipped most cells readMajorCompaction
HBASE-26777BufferedDataBlockEncoder$OffheapDecodedExtendedCell.deepClone throws UnsupportedOperationExceptionMajorregionserver
HBASE-26745MetricsStochasticBalancerSource metrics don't render in /jmx endpointMinor.
HBASE-26776RpcServer failure to SASL handshake always logs user “unknown” to audit logMajorsecurity
HBASE-26772Shell suspended in backgroundMinorshell

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-26603Cherry pick HBASE-26537 to branch-2.4Major.
HBASE-26824TestHBaseTestingUtil.testResolvePortConflict failing after HBASE-26582Major.
HBASE-26582Prune use of Random and SecureRandom objectsMinor.

OTHER:

JIRASummaryPriorityComponent
HBASE-26839Fix compatibility issues in 2.4.11RC0Minor.
HBASE-26817Mark RpcExecutor as IA.LimitedPrivate COPROC and PHOENIXMajorcompatibility
HBASE-26760LICENSE handling should not allow non-aggregated “apache-2.0”Minorcommunity
HBASE-26691Replacing log4j with reload4j for branch-2.xCriticallogging
HBASE-26788Disable Checks API callback from test results in PRsMajorbuild
HBASE-26622Update to error-prone 2.10Major.

Release 2.4.10 - 2022-03-04

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-26576Allow Pluggable Queue to belong to FastPath or normal Balanced ExecutorMinorregionserver, rpc

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-26702Make ageOfLastShip, ageOfLastApplied extend TimeHistogram instead of plain histogram.Minormetrics, Replication
HBASE-26657ProfileServlet should move the output location to hbase specific directoryMinor.
HBASE-26590Hbase-client Meta lookup performance regression between hbase-1 and hbase-2Majormeta
HBASE-26629Add expiration for long time vacant scanners in Thrift2MajorPerformance, Thrift
HBASE-26609Round the size to MB or KB at the end of calculation in HRegionServer.createRegionLoadMajorregionserver
HBASE-26598Fix excessive connections in MajorCompactorMajorCompaction, tooling
HBASE-26579Set storage policy of recovered edits when wal storage type is configuredMajorRecovery

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26767Rest server should not use a large Header Cache.MajorREST
HBASE-26546hbase-shaded-client missing required thirdparty classes under hadoop 3.3.1MajorClient, hadoop3, shading
HBASE-26712Balancer encounters NPE in rare caseMajor.
HBASE-26742Comparator of NOT_EQUAL NULL is invalid for checkAndMutateMajor.
HBASE-26688Threads shared EMPTY_RESULT may lead to unexpected client job down.MajorClient
HBASE-26741Incorrect exception handling in shellCriticalshell
HBASE-26729Backport “HBASE-26714 Introduce path configuration for system coprocessors” to branch-2MajorCoprocessors
HBASE-26713Increments submitted by 1.x clients will be stored with timestamp 0 on 2.x+ clustersMajor.
HBASE-26679Wait on the future returned by FanOutOneBlockAsyncDFSOutput.flush would stuckCriticalwal
HBASE-26662User.createUserForTesting should not reset UserProvider.groups every time if hbase.group.service.for.test.only is trueMajor.
HBASE-26671Misspellings of hbck usageMinorhbck
HBASE-26469correct HBase shell exit behavior to match code passed to exitCriticalshell
HBASE-26643LoadBalancer should not return empty mapCriticalproc-v2, Region Assignment, test
HBASE-26646WALPlayer should obtain token from filesystemMinor.
HBASE-26625ExportSnapshot tool failed to copy data files for tables with merge regionMinor.
HBASE-26615Snapshot referenced data files are deleted when delete a table with merge regionsMajor.
HBASE-26613The logic of the method incrementIV in Encryption class has problemMajorPerformance, security
HBASE-26488Memory leak when MemStore retry flushingMajorregionserver
HBASE-26340TableSplit returns false size under 1MBMajormapreduce, regionserver

TESTS:

JIRASummaryPriorityComponent
HBASE-26689Backport HBASE-24443 Refactor TestCustomSaslAuthenticationProviderMinortest

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-26434Compact L0 files for cold regions using StripeCompactionPolicyMajor.
HBASE-26749Migrate HBase main pre commit job to ci-hbaseMajor.
HBASE-26697Migrate HBase Nightly HBase-Flaky-Tests and HBase-Find-Flaky-Tests to ci-hbaseMajorjenkins
HBASE-26747Use python2 instead of python in our python scriptsMajorjenkins

OTHER:

JIRASummaryPriorityComponent
HBASE-26616Refactor code related to ZooKeeper authenticationMajorZookeeper
HBASE-26631Upgrade junit to 4.13.2Majorsecurity, test
HBASE-26580The message of StoreTooBusy is confusedTriviallogging, regionserver

Release 2.4.9 - 2021-12-23

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-26601maven-gpg-plugin failing with “Inappropriate ioctl for device”Majorbuild
HBASE-26556IT and Chaos Monkey improvementsMinorintegration tests
HBASE-26525Use unique thread name for group WALsMajorwal
HBASE-26517Add auth method information to AccessChecker audit logTrivialsecurity
HBASE-26512Make timestamp format configurable in HBase shell scan outputMajorshell
HBASE-26485Introduce a method to clean restore directory after Snapshot ScanMinorsnapshots
HBASE-26475The flush and compact methods in HTU should skip processing secondary replicasMajortest
HBASE-26267Master initialization fails if Master Region WAL dir is missingMajormaster
HBASE-26337Optimization for weighted random generatorsMajorBalancer
HBASE-26309Balancer tends to move regions to the server at the end of listMajorBalancer

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26541hbase-protocol-shaded not buildable on M1 MacOSXMajor.
HBASE-26527ArrayIndexOutOfBoundsException in KeyValueUtil.copyToNewKeyValue()Majorwal
HBASE-26462Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedureCriticalproc-v2, snapshots
HBASE-26533KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore()Minor.
HBASE-26482HMaster may clean wals that is replicating in rare casesCriticalReplication
HBASE-26468Region Server doesn't exit cleanly incase it crashes.Majorregionserver
HBASE-25905Shutdown of WAL stuck at waitForSafePointBlockerregionserver, wal
HBASE-26450Server configuration will overwrite HStore configuration after using shell command ‘update_config’MinorCompaction, conf, regionserver
HBASE-26476Make DefaultMemStore extensible for HStore.memstoreMajorregionserver
HBASE-26465MemStoreLAB may be released early when its SegmentScanner is scanningCriticalregionserver
HBASE-26467Wrong Cell Generated by MemStoreLABImpl.forceCopyOfBigCellInto when Cell size bigger than data chunk sizeCriticalin-memory-compaction
HBASE-26463Unreadable table names after HBASE-24605TrivialUI
HBASE-26438Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSizeMajortest
HBASE-26311Balancer gets stuck in cohosted replica distributionMajorBalancer
HBASE-26384Segment already flushed to hfile may still be remained in CompactingMemStoreMajorin-memory-compaction
HBASE-26410Fix HBase TestCanaryTool for Java17Majorjava
HBASE-26429HeapMemoryManager fails memstore flushes with NPE if enabledMajorOperability, regionserver
HBASE-25322Redundant Reference file in bottom region of splitMinor.
HBASE-26406Can not add peer replicating to non-HBaseMajorReplication
HBASE-26404Update javadoc for CellUtil#createCell with tags methods.Major.
HBASE-26398CellCounter fails for large tables filling up local diskMinormapreduce

TESTS:

JIRASummaryPriorityComponent
HBASE-26542Apply a `package` to test protobuf filesMinorProtobufs, test

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-24870Ignore TestAsyncTableRSCrashPublishMajor.
HBASE-26470Use openlabtesting protoc on linux arm64 in HBASE 2.xMajorbuild
HBASE-26327Replicas cohosted on a rack shouldn't keep triggering BalancerMajorBalancer
HBASE-26308Sum of multiplier of cost functions is not populated properly when we have a shortcut for triggerCriticalBalancer
HBASE-26319Make flaky find job track more buildsMajorflakies, jenkins

OTHER:

JIRASummaryPriorityComponent
HBASE-26549hbaseprotoc plugin should initialize mavenMajorjenkins
HBASE-26444BucketCacheWriter should log only the BucketAllocatorException message, not the full stack traceMajorlogging, Operability
HBASE-26443Some BaseLoadBalancer log lines should be at DEBUG levelMajorlogging, Operability

Release 2.4.8 - 2021-11-05

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-26284Add HBase Thrift API to get all table names along with whether it is enabled or notMajorThrift

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-25773TestSnapshotScannerHDFSAclController.setupBeforeClass is flakyMajor.

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26190High rate logging of BucketAllocatorException: Allocation too bigMajorBucketCache, Operability
HBASE-26392Update ClassSize.BYTE_BUFFER for JDK17Majorjava, util
HBASE-26394Cache in RSRpcServices.executeProcedures does not take effectMajor.
HBASE-26385Clear CellScanner when replayMajorregionserver, rpc
HBASE-26383HBCK incorrectly reports inconsistencies for recently split regions following a master failoverCriticalmaster
HBASE-26371Prioritize meta region move over other region moves in region_moverMajor.
HBASE-26364TestThriftServer is failing 100% in our flaky test jobMajortest, Thrift
HBASE-26350Missing server side debugging on failed SASL handshakeMinor.
HBASE-26344Fix Bug for MultiByteBuff.put(int, byte)Major.
HBASE-26312Shell scan fails with timestampMajorshell, test

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-26390Upload src tarball to nightlies for nightly jobsMajorjenkins, scripts
HBASE-26382Use gen_redirect_html for linking flaky test logsMajorjenkins, scripts, test
HBASE-26362Upload mvn site artifacts for nightly build to nightliesMajorjenkins, scripts
HBASE-26360Use gen_redirect_html for linking test logsMajorjenkins, scripts
HBASE-26341Upload dashboard html for flaky find job to nightliesMajorflakies, jenkins, scripts
HBASE-26339SshPublisher will skip uploading artifacts if the build is failureMajorjenkins, scripts

OTHER:

JIRASummaryPriorityComponent
HBASE-26329Upgrade commons-io to 2.11.0Majordependencies
HBASE-26186jenkins script for caching artifacts should verify cached file before relying on itMajorbuild, integration tests

Release 2.4.7 - 2021-10-15

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-26270Provide getConfiguration method for Region and Store interfaceMinor.
HBASE-26273TableSnapshotInputFormat/TableSnapshotInputFormatImpl should use ReadType.STREAM for scanning HFilesMajormapreduce
HBASE-26276Allow HashTable/SyncTable to perform rawScan when comparing cellsMajor.
HBASE-26255Add an option to use region location from meta table in TableSnapshotInputFormatMajormapreduce
HBASE-26243Fix typo for file ‘hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java’Trivial.

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26295BucketCache could not free BucketEntry which restored from persistence fileMajorBucketCache
HBASE-26289Hbase scan setMaxResultsPerColumnFamily not giving right resultsMajorregionserver
HBASE-26238OOME in VerifyReplication for the table contains rows with 10M+ cellsMajorClient, Replication
HBASE-26297Balancer run is improperly triggered by accuracy error of double comparisonMajorBalancer
HBASE-26274Create an option to reintroduce BlockCache to mapreduce jobMajorBlockCache, HFile, mapreduce
HBASE-26261Store configuration loss when use update_configMinor.
HBASE-26281DBB got from BucketCache would be freed unexpectedly before RPC completedCriticalBucketCache
HBASE-26197Fix some obvious bugs in MultiByteBuff.putMajor.

TESTS:

JIRASummaryPriorityComponent
HBASE-26272TestTableMapReduceUtil failure in branch-2Majortest

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-26317Publish the test logs for pre commit jenkins job to nightliesMajorjenkins, scripts
HBASE-26313Publish the test logs for our nightly jobs to nightlies.apache.orgMajorjenkins, scripts
HBASE-26318Publish test logs for flaky jobs to nightliesMajorflakies, jenkins

Release 2.4.6 - 2021-09-10

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-6908Pluggable Call BlockingQueue for HBaseServerMajorIPC/RPC

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-25642Fix or stop warning about already cached blockMajorBlockCache, Operability, regionserver
HBASE-24652master-status UI make date type fields sortableMinormaster, Operability, UI, Usability
HBASE-25680Non-idempotent test in TestReplicationHFileCleanerMinortest
HBASE-26179TestRequestTooBigException spends too much time to finishMajortest
HBASE-26160Configurable disallowlist for live editing of loglevelsMinor.
HBASE-25469Add detailed RIT info in JSON format for consumption as metricsMinormaster
HBASE-26154Provide exception metric for quota exceeded and throttlingMinor.
HBASE-26105Rectify the expired TODO comment in CombinedBCTrivialBlockCache
HBASE-26146Allow custom opts for hbck in hbase binMinor.

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26106AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory.Criticalwal
HBASE-26205TableMRUtil#initCredentialsForCluster should use specified conf for UserProviderMajormapreduce
HBASE-26210HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStoreCriticalin-memory-compaction
HBASE-26244Avoid trim the error stack trace when running UT with mavenMajor.
HBASE-25588Excessive logging of “hbase.zookeeper.useMulti is deprecated. Default to true always.”Minorlogging, Operability, Replication
HBASE-26232SEEK_NEXT_USING_HINT is ignored on reversed ScansCriticalFilters, scan
HBASE-26204VerifyReplication should obtain token for peerQuorumAddress tooMajor.
HBASE-26219Negative time is logged while waiting on regionserversTrivial.
HBASE-26087JVM crash when displaying RPC params by MonitoredRPCHandlerMajorUI
HBASE-24570connection#close throws NPEMinorClient
HBASE-26200Undo ‘HBASE-25165 Change ‘State time’ in UI so sorts (#2508)’ in favor of HBASE-24652MajorUI
HBASE-26196Support configuration override for remote cluster of HFileOutputFormat locality sensitiveMajormapreduce
HBASE-26026HBase Write may be stuck forever when using CompactingMemStoreCriticalin-memory-compaction
HBASE-26155JVM crash when scanMajorScanners
HBASE-26176Correct regex in hbase-personality.shMinorbuild
HBASE-26170handleTooBigRequest in NettyRpcServer didn't skip enough bytesMajor.
HBASE-26142NullPointerException when set ‘hbase.hregion.memstore.mslab.indexchunksize.percent’ to zeroCritical.
HBASE-26166table list in master ui has a minor bugMinorUI

TESTS:

JIRASummaryPriorityComponent
HBASE-26185Fix TestMaster#testMoveRegionWhenNotInitialized with hbase.min.version.move.system.tablesMinor.

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-26189Reduce log level of CompactionProgress notice to DEBUGMinorCompaction
HBASE-26227Forward port HBASE-26223 test code to branch-2.4+Majortest

OTHER:

JIRASummaryPriorityComponent
HBASE-26152Exclude javax.servlet:servlet-api in hbase-shaded-testing-utilMajor.

Release 2.4.5 - 2021-07-31

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-26108add option to disable scanMetrics in TableSnapshotInputFormatMajor.
HBASE-26025Add a flag to mark if the IOError can be solved by retry in thrift IOErrorMajorThrift
HBASE-25986Expose the NORMALIZARION_ENABLED table descriptor through a property in hbase-siteMinorNormalizer
HBASE-26012Improve logging and dequeue logic in DelayQueueMinor.
HBASE-26020Split TestWALEntryStream.testDifferentCounts outMajorReplication, test
HBASE-25937Clarify UnknownRegionExceptionMinorClient
HBASE-25998Revisit synchronization in SyncFutureMajorPerformance, regionserver, wal
HBASE-26000Optimize the display of ZK dump in the master web UIMinor.
HBASE-25995Change the method name for DoubleArrayCost.setCostsMajorBalancer
HBASE-26002MultiRowMutationEndpoint should return the result of the conditional updateMajorCoprocessors
HBASE-25993Make excluded SSL cipher suites configurable for all Web UIsMajor.
HBASE-25987Make SSL keystore type configurable for HBase ThriftServerMajorThrift

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26120New replication gets stuck or data loss when multiwal groups more than 10CriticalReplication
HBASE-26001When turn on access control, the cell level TTL of Increment and Append operations is invalid.MinorCoprocessors
HBASE-24984WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used with multi operationCriticalrpc, wal
HBASE-26088conn.getBufferedMutator(tableName) leaks thread executors and other problemsCriticalClient
HBASE-25973Balancer should explain progress in a better way in logMajorBalancer
HBASE-26083L1 miss metric is incorrect when using CombinedBlockCacheMinorBlockCache
HBASE-26086TestHRegionReplayEvents do not pass in branch-2 and throws NullPointerExceptionMinor.
HBASE-26036DBB released too early and dirty data for some operationsCriticalrpc
HBASE-26068The last assertion in TestHStore.testRefreshStoreFilesNotChanged is wrongMajortest
HBASE-22923hbase:meta is assigned to localhost when we downgrade the hbase versionMajor.
HBASE-26030hbase-cleanup.sh did not clean the wal dir if hbase.wal.dir configured individuallyMajorscripts
HBASE-26035Redundant null check in the compareTo functionMinormetrics, Performance
HBASE-25902Add missing CFs in meta during HBase 1 to 2.3+ UpgradeCriticalmeta, Operability
HBASE-26028The view as json page shows exception when using TinyLfuBlockCacheMajorUI
HBASE-26039TestReplicationKillRS is useless after HBASE-23956MajorReplication, test
HBASE-25980Master table.jsp pointed at meta throws 500 when no all replicas are onlineMajormaster, meta replicas, UI
HBASE-26013Get operations readRows metrics becomes zero after HBASE-25677Minormetrics
HBASE-25877Add access check for compactionSwitchMajorsecurity
HBASE-25698Persistent IllegalReferenceCountException at scanner open when using TinyLfuBlockCacheMajorBucketCache, HFile, Scanners
HBASE-25984FSHLog WAL lockup with sync future reuse [RS deadlock]Criticalregionserver, wal
HBASE-25997NettyRpcFrameDecoder decode request header wrong when handleTooBigRequestMajorrpc
HBASE-25967The readRequestsCount does not calculate when the outResults is emptyMajormetrics
HBASE-25981JVM crash when displaying regionserver UIMajorrpc, UI

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-26093Replication is stuck due to zero length wal file in oldWALs directory [master/branch-2]Major.
HBASE-24734RegionInfo#containsRange should support check meta tableMajorHFile, MTTR
HBASE-25739TableSkewCostFunction need to use aggregated deviationMajorBalancer, master
HBASE-25992Polish the ReplicationSourceWALReader code for 2.x after HBASE-25596MajorReplication
HBASE-25989FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+Major.
HBASE-25947Backport ‘HBASE-25894 Improve the performance for region load and region count related cost functions’ to branch-2.4 and branch-2.3MajorBalancer, Performance
HBASE-25969Cleanup netty-all transitive includesMajor.

OTHER:

JIRASummaryPriorityComponent
HBASE-25934Add username for RegionScannerHolderMinor.
HBASE-26123Restore fields dropped by HBASE-25986 to public interfacesMajor.
HBASE-25521Change ChoreService and ScheduledChore to IA.PrivateMajorutil
HBASE-26015Should implement getRegionServers(boolean) method in AsyncAdminMajorAdmin, Client
HBASE-25918Upgrade hbase-thirdparty dependency to 3.5.1Criticaldependencies

Release 2.4.4 - 2021-06-14

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-25666Explain why balancer is skipping runsMajorBalancer, master, UI
HBASE-25942Get rid of null regioninfo in wrapped connection exceptionsTriviallogging
HBASE-25908Exclude jakarta.activation-apiMajorhadoop3, shading
HBASE-25933Log trace raw exception, instead of cause message in NettyRpcServerRequestDecoderMinor.
HBASE-25906UI of master-status to show recent history of balancer desicionMajorBalancer, master, UI

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-25930Thrift does not support requests in Kerberos environmentMajorThrift
HBASE-25929RegionServer JVM crash when compactionCriticalCompaction
HBASE-25924Seeing a spike in uncleanlyClosedWALs metric.MajorReplication, wal
HBASE-25932TestWALEntryStream#testCleanClosedWALs test is failing.Majormetrics, Replication, wal
HBASE-25903ReadOnlyZKClient APIs - CompletableFuture.get() calls can cause threads to hang forver when ZK client create throws Non IOExceptionMajor.
HBASE-25927Fix the log messages by not stringifying the exceptions in logMinorlogging
HBASE-25938The SnapshotOfRegionAssignmentFromMeta.initialize call in FavoredNodeLoadBalancer is just a dummy oneMajorBalancer, FavoredNodes
HBASE-25898RS getting aborted due to NPE in Replication WALEntryStreamCriticalReplication
HBASE-25875RegionServer failed to start due to IllegalThreadStateException in AuthenticationTokenSecretManager.startMajor.
HBASE-25892‘False’ should be ‘True’ in auditlog of listLabelsMajorlogging, security
HBASE-25817Memory leak from thrift server hashMapMinorThrift
HBASE-25848Add flexibility to backup replication in case replication filter throws an exceptionMajor.
HBASE-25827Per Cell TTL tags get duplicated with increments causing tags length overflowCriticalregionserver

TESTS:

JIRASummaryPriorityComponent
HBASE-25910Fix TestClusterPortAssignment.testClusterPortAssignment test and re-enable it.Minorflakies, test

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-25963HBaseCluster should be marked as IA.PublicMajorAPI
HBASE-25941TestRESTServerSSL fails because of jdk bugMajortest
HBASE-25940Update Compression/TestCompressionTest: LZ4, SNAPPY, LZOMajor.
HBASE-25791UI of master-status to show a recent history of that why balancer was rejected to runMajorBalancer, master, UI

Release 2.4.3 - 2021-05-21

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-25751Add writable TimeToPurgeDeletes to ScanOptionsMajor.
HBASE-25587[hbck2] Schedule SCP for all unknown serversMajorhbase-operator-tools, hbck2

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-25860Add metric for successful wal roll requests.Majormetrics, wal
HBASE-25754StripeCompactionPolicy should support compacting cold regionsMinorCompaction
HBASE-25766Introduce RegionSplitRestriction that restricts the pattern of the split pointMajor.
HBASE-25798typo in MetricsAssertHelperMinor.
HBASE-25770Http InfoServers should honor gzip encoding when requestedMajorUI
HBASE-25776Use Class.asSubclass to fix the warning in StochasticLoadBalancer.loadCustomCostFunctionsMinorBalancer
HBASE-25767CandidateGenerator.getRandomIterationOrder is too slow on large clusterMajorBalancer, Performance
HBASE-25762Improvement for some debug-logging guardsMinorlogging, Performance
HBASE-25653Add units and round off region size to 2 digits after decimalMajormaster, Normalizer
HBASE-25759The master services field in LocalityBasedCostFunction is never usedMajorBalancer
HBASE-25747Remove unused getWriteAvailable method in OperationQuotaMinorQuotas
HBASE-25558Adding audit log for execMasterServiceMajor.
HBASE-25703Support conditional update in MultiRowMutationEndpointMajorCoprocessors
HBASE-25627HBase replication should have a metric to represent if the source is stuck getting initializedMajorReplication
HBASE-25688Use CustomRequestLog instead of Slf4jRequestLog for jettyMajorlogging, UI
HBASE-25678Support nonce operations for Increment/Append in RowMutations and CheckAndMutateMajor.
HBASE-25679Size of log queue metric is incorrect in branch-1/branch-2Major.
HBASE-25518Support separate child regions to different region serversMajor.
HBASE-25621Balancer should check region plan source to avoid misplace region groupsMajorBalancer
HBASE-25374Make REST Client connection and socket time out configurableMinorREST
HBASE-25597Add row info in Exception when cell size exceeds maxCellSizeMinor.
HBASE-25660Print split policy in use on Region open (as well as split policy vitals)Trivial.
HBASE-25635CandidateGenerator may miss some region balance actionsMajorBalancer
HBASE-25636Expose HBCK report as metricsMinormetrics
HBASE-25548Optionally allow snapshots to preserve cluster's max filesize config by setting it into table descriptorMajor.

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-25867Extra doc around ITBLLMinordocumentation
HBASE-25859Reference class incorrectly parses the protobuf magic markerMinorregionserver
HBASE-25774ServerManager.getOnlineServer may miss some region servers when refreshing state in some procedure implementationsCriticalReplication
HBASE-25825RSGroupBasedLoadBalancer.onConfigurationChange should chain the request to internal balancerMajorBalancer
HBASE-25792Filter out o.a.hadoop.thirdparty building shaded jarsMajorshading
HBASE-25806Backport the region location finder initialization fix in HBASE-25802MajorBalancer
HBASE-25735Add target Region to connection exceptionsMajorrpc
HBASE-25717RegionServer aborted due to ClassCastExceptionMajor.
HBASE-25743Retry REQUESTTIMEOUT KeeperExceptions from ZKMajorZookeeper
HBASE-25726MoveCostFunction is not included in the list of cost functions for StochasticLoadBalancerMajorBalancer
HBASE-25692Failure to instantiate WALCellCodec leaks socket in replicationMajorReplication
HBASE-25568Upgrade Thrift jar to fix CVE-2020-13949CriticalThrift
HBASE-25562ReplicationSourceWALReader log and handle exception immediately without retryingMajorReplication
HBASE-25693NPE getting metrics from standby masters (MetricsMasterWrapperImpl.getMergePlanCount)Majormaster
HBASE-25685asyncprofiler2.0 no longer supports svg; wants htmlMajor.
HBASE-25594graceful_stop.sh fails to unload regions when ran at localhostMinor.
HBASE-25674RegionInfo.parseFrom(DataInputStream) sometimes fails to read the protobuf magic markerMinorClient
HBASE-25595TestLruBlockCache.testBackgroundEvictionThread is flakyMajor.
HBASE-25662Fix spotbugs warning in RoundRobinTableInputFormatMajorfindbugs
HBASE-25657Fix spotbugs warnings after upgrading spotbugs to 4.xMajorfindbugs
HBASE-25646Possible Resource Leak in CatalogJanitorMajormaster

TESTS:

JIRASummaryPriorityComponent
HBASE-25691Test failure: TestVerifyBucketCacheFile.testRetrieveFromFileMajortest

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-25876Add retry if we fail to read all bytes of the protobuf magic markerTrivialio
HBASE-25790NamedQueue ‘BalancerRejection’ for recent history of balancer skippingMajorBalancer, master
HBASE-25854Remove redundant AM in-memory state changes in CatalogJanitorMajor.
HBASE-25847More DEBUG and TRACE level logging in CatalogJanitor and HbckChoreMinor.
HBASE-25838Use double instead of Double in StochasticLoadBalancerMajorBalancer, Performance
HBASE-25835Ignore duplicate split requests from regionserver reportsMajor.
HBASE-25836RegionStates#getAssignmentsForBalancer should only care about OPEN or OPENING regionsMajor.
HBASE-25840CatalogJanitor warns about skipping gc of regions during RIT, but does not actually skipMinor.
HBASE-25775Use a special balancer to deal with maintenance modeMajorBalancer
HBASE-25199Remove HStore#getStoreHomedirMinor.
HBASE-25696Need to initialize SLF4JBridgeHandler in jul-to-slf4j for redirecting jul to slf4jMajorlogging
HBASE-25695Link to the filter on hbase:meta from user tables panel on master pageMajorUI
HBASE-25629Reimplement TestCurrentHourProvider to not depend on unstable TZsMajortest
HBASE-25671Backport HBASE-25608 to branch-2Major.
HBASE-25677Server+table counters on each scan #nextRaw invocation becomes a bottleneck when heavy loadMajormetrics
HBASE-25667Remove RSGroup test addition made in parent; depends on functionality not in old branchesMajor.

OTHER:

JIRASummaryPriorityComponent
HBASE-25884NPE while getting Balancer decisionsMajor.
HBASE-25755Exclude tomcat-embed-core from libthriftCriticaldependencies, Thrift
HBASE-25750Upgrade RpcControllerFactory and HBaseRpcController from Private to LimitedPrivate(COPROC,PHOENIX)MajorCoprocessors, phoenix, rpc
HBASE-25734Backport HBASE-24305 to branch-2.4Minor.
HBASE-25604Upgrade spotbugs to 4.xMajorbuild, findbugs
HBASE-24305Handle deprecations in ServerNameMinor.

Release 2.4.2 - Unreleased (as of 2021-03-08)

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-25460Expose drainingServers as cluster metricMajormetrics
HBASE-25496add get_namespace_rsgroup commandMajor.

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-23578[UI] Master UI shows long stack traces when table is brokenMinormaster, UI
HBASE-25492Create table with rsgroup info in branch-2Majorrsgroup
HBASE-25539Add metric for age of oldest wal.Majormetrics, regionserver
HBASE-25574Revisit put/delete/increment/append related RegionObserver methodsMajorCoprocessors
HBASE-25541In WALEntryStream, set the current path to null while dequeing the logMajor.
HBASE-23887New L1 cache : AdaptiveLRUMajorBlockCache, Performance
HBASE-25534Honor TableDescriptor settings earlier in normalizationMajorNormalizer
HBASE-25507Leak of ESTABLISHED sockets when compaction encountered “java.io.IOException: Invalid HFile block magic”MajorCompaction
HBASE-25542Add client detail to scan name so when lease expires, we have clue on who was scanningMajorscan
HBASE-25528Dedicated merge dispatch threadpool on masterMinormaster
HBASE-25536Remove 0 length wal file from logQueue if it belongs to old sources.MajorReplication
HBASE-25482Improve SimpleRegionNormalizer#getAverageRegionSizeMbMinorNormalizer

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-25626Possible Resource Leak in HeterogeneousRegionCountCostFunctionMajor.
HBASE-25644Scan#setSmall blindly sets ReadType as PREADCritical.
HBASE-25609There is a problem with the SPLITS_FILE in the HBase shell statementMinor.
HBASE-25385TestCurrentHourProvider fails if the latest timezone changes are not presentBlocker.
HBASE-25596Fix NPE in ReplicationSourceManager as well as avoid permanently unreplicated data due to EOFException from WALCritical.
HBASE-25367Sort broken after Change ‘State time’ in UIMajorUI
HBASE-25421There is no limit on the column family length when creating a tableMajorClient
HBASE-25371When openRegion fails during initial verification(before initializing and setting seq num), exception is observed during region close.MajorRegion Assignment
HBASE-25611ExportSnapshot chmod flag uses value as decimalMajor.
HBASE-25586Fix HBASE-22492 on branch-2 (SASL GapToken)Majorrpc
HBASE-25598TestFromClientSide5.testScanMetrics is flakyMajor.
HBASE-25556Frequent replication “Encountered a malformed edit” warningsMinorOperability, Replication
HBASE-25575Should validate Puts in RowMutationsMinorClient
HBASE-25559Terminate threads of oldsources while RS is closingMajor.
HBASE-25543When configuration “hadoop.security.authorization” is set to false, the system will still try to authorize an RPC and raise AccessDeniedExceptionMinorIPC/RPC
HBASE-25554NPE when init RegionMoverMajor.
HBASE-25523Region normalizer chore thread is getting killedMajorNormalizer
HBASE-25533The metadata of the table and family should not be an empty stringMajor.
HBASE-25478Implement retries when enabling tables in TestRegionReplicaReplicationEndpointMinor.
HBASE-25513When the table is turned on normalize, the first region may not be merged even the size is 0MajorNormalizer
HBASE-25497move_namespaces_rsgroup should change hbase.rsgroup.name config in NamespaceDescriptorMajor.

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-24900Make retain assignment configurable during SCPMajoramv2
HBASE-25509ChoreService.cancelChore will not call ScheduledChore.cleanup which may lead to resource leakMajorutil

OTHER:

JIRASummaryPriorityComponent
HBASE-25553It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of StringMajor.
HBASE-25620Increase timeout value for pre commitMajorbuild, test
HBASE-25615Upgrade java version in pre commit docker fileMajorbuild
HBASE-25601Remove search hadoop references in bookMajordocumentation

Release 2.4.1 - 2021-01-18

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-24620Add a ClusterManager which submits command to ZooKeeper and its Agent which picks and execute those Commands.Majorintegration tests

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-25329Dump region hashes in logs for the regions that are stuck in transition for more than a configured amount of timeMinor.
HBASE-25475Improve unit test for HBASE-25445 : SplitWALRemoteProcedure failed to archive split WALMinorwal
HBASE-25249Adding StoreContextMajor.
HBASE-25449‘dfs.client.read.shortcircuit’ should not be set in hbase-default.xmlMajorconf
HBASE-25476Enable error prone check in pre commitMajorbuild
HBASE-25211Rack awareness in region_moverMajor.
HBASE-25483set the loadMeta log level to debug.MajorMTTR, Region Assignment
HBASE-25435Slow metric value can be configuredMinormetrics
HBASE-25318Configure where IntegrationTestImportTsv generates HFilesMinorintegration tests
HBASE-24850CellComparator perf improvementCriticalPerformance, scan
HBASE-25425Some notes on RawCellTrivial.
HBASE-25420Some minor improvements in rpc implementationMinorrpc
HBASE-25246Backup/Restore hbase cell tags.Majorbackup&restore
HBASE-25328Add builder method to create Tags.Minor.

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-25356HBaseAdmin#getRegion() needs to filter out non-regionName and non-encodedRegionNameMajorshell
HBASE-25279Non-daemon thread in ZKWatcherCriticalZookeeper
HBASE-25504[branch-2.4] Restore method removed by HBASE-25277 to LP(CONFIG) coprocessorsMajorcompatibility, Coprocessors, security
HBASE-25503HBase code download is failing on windows with invalid path errorMajor.
HBASE-24813ReplicationSource should clear buffer usage on ReplicationSourceManager upon terminationMajorReplication
HBASE-25459WAL can't be cleaned in some scenesMajor.
HBASE-25434SlowDelete & SlowPut metric value should use updateDelete & updatePutMajorregionserver
HBASE-25441add security check for some APIs in RSRpcServicesCritical.
HBASE-25432we should add security checks for setTableStateInMeta and fixMetaBlocker.
HBASE-25445Old WALs archive fails in procedure based WAL splitCriticalwal
HBASE-25287Forgetting to unbuffer streams results in many CLOSE_WAIT sockets when loading filesMajor.
HBASE-25447remoteProc is suspended due to OOM ERRORMajorproc-v2
HBASE-24755[LOG][RSGroup]Error message is confusing while adding a offline RS to rsgroupMajorrsgroup
HBASE-25463Fix comment errorMinorshell
HBASE-25457Possible race in AsyncConnectionImpl between getChoreService and closeMajorClient
HBASE-25456setRegionStateInMeta need security checkCritical.
HBASE-25383HBase doesn't update and remove the peer config from hbase.replication.source.custom.walentryfilters if the config is already set on the peer.Major.
HBASE-25404Procedures table Id under master web UI gets word break to single characterMinorUI
HBASE-25277postScannerFilterRow impacts Scan performance a lot in HBase 2.xCriticalCoprocessors, scan
HBASE-25365The log in move_servers_rsgroup is incorrectMinor.
HBASE-25372Fix typo in ban-jersey section of the enforcer plugin in pom.xmlMajorbuild
HBASE-25361[Flakey Tests] branch-2 TestMetaRegionLocationCache.testStandByMetaLocationsMajorflakies

TESTS:

JIRASummaryPriorityComponent
HBASE-25502IntegrationTestMTTR fails with TableNotFoundExceptionMajorintegration tests
HBASE-25334TestRSGroupsFallback.testFallback is flakyMajor.
HBASE-25370Fix flaky test TestClassFinder#testClassFinderDefaultsToOwnPackageMajortest

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-25293Followup jira to address the client handling issue when chaning from meta replica to non-meta-replica at the server side.Minor.
HBASE-25353[Flakey Tests] branch-2 TestShutdownBackupMasterMajorflakies

OTHER:

JIRASummaryPriorityComponent
HBASE-25333Add maven enforcer rule to ban VisibleForTesting importsMajorbuild, pom
HBASE-25452Use MatcherAssert.assertThat instead of org.junit.Assert.assertThatMajortest
HBASE-25400[Flakey Tests] branch-2 TestRegionMoveAndAbandonMajor.
HBASE-25389[Flakey Tests] branch-2 TestMetaShutdownHandlerMajorflakies

Release 2.4.0 - Unreleased (as of 2020-12-03)

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-25242Add Increment/Append support to RowMutationsCriticalClient, regionserver
HBASE-25278Add option to toggle CACHE_BLOCKS in count.rbMinorshell
HBASE-18070Enable memstore replication for meta replicaCritical.
HBASE-24528Improve balancer decision observabilityMajorAdmin, Balancer, Operability, shell, UI
HBASE-24776[hbtop] Support Batch modeMajorhbtop
HBASE-24602Add Increment and Append support to CheckAndMutateMajor.
HBASE-24760Add a config hbase.rsgroup.fallback.enable for RSGroup fallback featureMajorrsgroup
HBASE-24694Support flush a single column family of tableMajor.
HBASE-24289Heterogeneous Storage for Date Tiered CompactionMajorCompaction
HBASE-24038Add a metric to show the locality of ssd in table.jspMajormetrics
HBASE-8458Support for batch version of checkAndMutate()MajorClient, regionserver

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-25339Method parameter and member variable are duplicated in checkSplittable() of SplitTableRegionProcedureMinor.
HBASE-25237‘hbase master stop’ shuts down the cluster, not the master onlyMajor.
HBASE-25324Remove unnecessary array to list conversion in SplitLogManagerMinor.
HBASE-25263Change encryption key generation algorithm used in the HBase shellMajorencryption, shell
HBASE-25323Fix potential NPE when the zookeeper path of RegionServerTracker does not exist when startMinor.
HBASE-25281Bulkload split hfile too many times due to unreasonable split pointMinortooling
HBASE-25325Remove unused class ClusterSchemaExceptionMinor.
HBASE-25213Should request Compaction when bulkLoadHFiles is doneMinor.
HBASE-24877Add option to avoid aborting RS process upon uncaught exceptions happen on replication sourceMajorReplication
HBASE-24664Some changing of split region by overall region size rather than only one store sizeMajorregionserver
HBASE-25026Create a metric to track full region scans RPCsMinor.
HBASE-25289[testing] Clean up resources after tests in rsgroup_shell_test.rbMajorrsgroup, test
HBASE-25261Upgrade Bootstrap to 3.4.1Majorsecurity, UI
HBASE-25272Support scan on a specific replicaCriticalClient, scan
HBASE-25267Add SSL keystore type and truststore related configs for HBase RESTServerMajorREST
HBASE-25181Add options for disabling column family encryption and choosing hash algorithm for wrapped encryption keys.Majorencryption
HBASE-25254Rewrite TestMultiLogThreshold to remove the LogDelegate in RSRpcServicesMajorlogging, test
HBASE-25252Move HMaster inner classes outMinormaster
HBASE-25240gson format of RpcServer.logResponse is abnormalMinor.
HBASE-25210RegionInfo.isOffline is now a duplication with RegionInfo.isSplitMajormeta
HBASE-25212Optionally abort requests in progress after deciding a region should closeMajorregionserver
HBASE-24859Optimize in-memory representation of mapreduce TableSplit objectsMajormapreduce
HBASE-24967The table.jsp cost long time to load if the table include closed regionsMajorUI
HBASE-25167Normalizer support for hot config reloadingMajormaster, Normalizer
HBASE-24419Normalizer merge plans should consider more than 2 regions when possibleMajormaster, Normalizer
HBASE-25224Maximize sleep for checking meta and namespace regions availabilityMajormaster
HBASE-25223Use try-with-resources statement in snapshot packageMinor.
HBASE-25201YouAreDeadException should be moved to hbase-server moduleMajorClient
HBASE-25193Add support for row prefix and type in the WAL Pretty Printer and some minor fixesMinorwal
HBASE-25128RSGroupInfo's toString() and hashCode() does not take into account configuration map.Minorrsgroup
HBASE-24628Region normalizer now respects a rate limitMajorNormalizer
HBASE-25179Assert format is incorrect in HFilePerformanceEvaluation class.MinorPerformance, test
HBASE-25065WAL archival to be done by a separate threadMajorwal
HBASE-14067bundle ruby files for hbase shell into a jar.Majorshell
HBASE-24875Remove the force param for unassign since it dose not take effect any moreMajorClient
HBASE-24025Improve performance of move_servers_rsgroup and move_tables_rsgroup by using async region move APIMajorrsgroup
HBASE-25160Refactor AccessController and VisibilityControllerMajor.
HBASE-25146Add extra logging at info level to HFileCorruptionChecker in order to report progressMajorhbck, hbck2
HBASE-24054The Jetty's version number leak occurred while using the thrift serviceMinor.
HBASE-25091Move LogComparator from ReplicationSource to AbstractFSWALProvider#.WALsStartTimeComparatorMinor.
HBASE-24981Enable table replication fails from 1.x to 2.x if table already exist at peer.MajorReplication
HBASE-25109Add MR Counters to WALPlayer; currently hard to tell if it is doing anythingMajor.
HBASE-25082Per table WAL metrics: appendCount and appendSizeMajormetrics
HBASE-25079Upgrade Bootstrap to 3.3.7Majorsecurity, UI
HBASE-24976REST Server failes to start without any error messageMajorREST
HBASE-25066Use FutureUtils.rethrow in AsyncTableResultScanner to better catch the stack traceMajorClient, Scanners
HBASE-25069Display region name instead of encoded region name in HBCK report page.Minorhbck
HBASE-24991Replace MovedRegionsCleaner with guava cacheMinor.
HBASE-25057Fix typo “memeber”Trivialdocumentation
HBASE-24764Add support of adding base peer configs via hbase-site.xml for all replication peers.MinorReplication
HBASE-25037Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting downMajor.
HBASE-24831Avoid invoke Counter using reflection in SnapshotInputFormatMajor.
HBASE-25002Create simple pattern matching query for retrieving metrics matching the patternMajor.
HBASE-25022Remove ‘hbase.testing.nocluster’ configMajortest
HBASE-25006Make the cost functions optional for StochastoicBalancerMajor.
HBASE-24974Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinterMinorwal
HBASE-24994Add hedgedReadOpsInCurThread metricMinormetrics
HBASE-25005Refactor CatalogJanitorMajormaster, meta
HBASE-24992log after Generator success when running ITBLLTrivial.
HBASE-24937table.rb use LocalDateTime to replace InstantMinorshell
HBASE-24940runCatalogJanitor() API should return -1 to indicate already running statusMajor.
HBASE-24973Remove read point parameter in method StoreFlush#performFlush and StoreFlush#createScannerMinor.
HBASE-24569Get hostAndWeights in addition using localhost if it is null in local modeMinorregionserver
HBASE-24949Optimize FSTableDescriptors.get to not always go to fs when cache missMajormaster
HBASE-24898Use EnvironmentEdge.currentTime() instead of System.currentTimeMillis() in CurrentHourProviderMajortooling
HBASE-24942MergeTableRegionsProcedure should not call clean merge regionMajorproc-v2, Region Assignment
HBASE-24811Use class access static field or methodMinor.
HBASE-24686[LOG] Log improvement in Connection#closeMajorClient, logging
HBASE-24912Enlarge MemstoreFlusherChore/CompactionChecker period for unit testMajor.
HBASE-24627Normalize one table at a timeMajorNormalizer
HBASE-24872refactor valueOf PoolTypeMinorClient
HBASE-24854Correct the help content of assign and unassign commands in hbase shellMinorshell
HBASE-24750All executor service should start using guava ThreadFactoryMajor.
HBASE-24709Support MoveCostFunction use a lower multiplier in offpeak hoursMajorBalancer
HBASE-24824Add more stats in PE for read replicaMinorPE, read replicas
HBASE-21721FSHLog : reduce write#syncs() timesMajor.
HBASE-24404Support flush a single column family of regionMajorshell
HBASE-24826Add some comments for processlist in hbase shellMinorshell
HBASE-24659Calculate FIXED_OVERHEAD automaticallyMajor.
HBASE-24827BackPort HBASE-11554 Remove Reusable poolmap Rpc client type.MajorClient
HBASE-24823Port HBASE-22762 Print the delta between phases in the split/merge/compact/flush transaction journals to master branchMinor.
HBASE-24795RegionMover should deal with unknown (split/merged) regionsMajor.
HBASE-24821Simplify the logic of getRegionInfo in TestFlushFromClient to reduce redundancy codeMinortest
HBASE-24704Make the Table Schema easier to view even there are multiple familiesMajorUI
HBASE-24695FSHLog - close the current WAL file in a background threadMajor.
HBASE-24803Unify hbase-shell ::Shell::Commands::Command#help behaviorMinorshell
HBASE-11686Shell code should create a binding / irb workspace instead of polluting the root namespaceMinorshell
HBASE-20226Performance Improvement Taking Large Snapshots In Remote FilesystemsMinorsnapshots
HBASE-24669Logging of ppid should be consistent across all occurrencesMinorOperability, proc-v2
HBASE-24757ReplicationSink should limit the batch rowcount for batch mutations based on hbase.rpc.rows.warning.thresholdMajor.
HBASE-24777InfoServer support ipv6 host and portMinorUI
HBASE-24758Avoid flooding replication source RSes logs when no sinks are availableMajorReplication
HBASE-24743Reject to add a peer which replicate to itself earlierMajor.
HBASE-24696Include JVM information on Web UI under “Software Attributes”MinorUI
HBASE-24747Log an ERROR if HBaseSaslRpcServer initialisation fails with an uncaught exceptionMajor.
HBASE-24586Add table level locality in table.jspMajorUI
HBASE-24663Add procedure process time statistics UIMajor.
HBASE-24653Show snapshot owner on Master WebUIMajor.
HBASE-24431RSGroupInfo add configuration map to store something extraMajorrsgroup
HBASE-24671Add excludefile and designatedfile options to graceful_stop.shMajor.
HBASE-24560Add a new option of designatedfile in RegionMoverMajor.
HBASE-24382Flush partial stores of region filtered by seqId when archive wal due to too many walsMajorwal
HBASE-24208Remove RS entry from zk draining servers node after RS been stoppedMajor.
HBASE-24456Immutable Scan as unmodifiable subclass or wrapper of ScanMajor.
HBASE-24471The way we bootstrap meta table is confusingMajormaster, meta, proc-v2
HBASE-24350HBase table level replication metrics for shippedBytes are always 0MajorReplication
HBASE-24311Add more details in MultiVersionConcurrencyControl STUCK log messageMajor.

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-25355[Documentation] Fix spelling errorTrivialdocumentation
HBASE-25230Embedded zookeeper server not clean up the old dataMinorZookeeper
HBASE-25349[Flakey Tests] branch-2 TestRefreshRecoveredReplication.testReplicationRefreshSource:141 Waiting timed out after [60,000] msecMajorflakies
HBASE-25332one NPEMajorZookeeper
HBASE-25345[Flakey Tests] branch-2 TestReadReplicas#testVerifySecondaryAbilityToReadWithOnFilesMajortest
HBASE-25307ThreadLocal pooling leads to NullPointerExceptionMajorClient
HBASE-25341Fix ErrorProne error which causes nightly to failMajortest
HBASE-25330RSGroupInfoManagerImpl#moveServers return is not set of servers movedMajorrsgroup
HBASE-25321The sort icons not shown after Upgrade JQuery to 3.5.1MajorUI
HBASE-24268REST and Thrift server do not handle the “doAs” parameter case insensitivelyMinorREST, Thrift
HBASE-25050We initialize Filesystems more than once.Minor.
HBASE-25311ui throws NPEMajor.
HBASE-25306The log in SimpleLoadBalancer#onConfigurationChange is wrongMajor.
HBASE-25300‘Unknown table hbase:quota’ happens when desc table in shell if quota disabledMajorshell
HBASE-25255Master fails to initialize when creating rs group tableCriticalmaster, rsgroup
HBASE-25275Upgrade asciidoctorBlockerwebsite
HBASE-25276Need to throw the original exception in HRegion#openHRegionMajor.
HBASE-20598Upgrade to JRuby 9.2Majordependencies, shell
HBASE-25216The client zk syncer should deal with meta replica count changeMajormaster, Zookeeper
HBASE-25238Upgrading HBase from 2.2.0 to 2.3.x fails because of “Message missing required fields: state”Critical.
HBASE-25234[Upgrade]Incompatibility in reading RS report from 2.1 RS when Master is upgraded to a version containing HBASE-21406Major.
HBASE-25053WAL replay should ignore 0-length filesMajormaster, regionserver
HBASE-25090CompactionConfiguration logs unrealistic store file sizesMinorCompaction
HBASE-24977Meta table shouldn't be modified as read onlyMajormeta
HBASE-25176MasterStoppedException should be moved to hbase-client moduleMajorClient
HBASE-25206Data loss can happen if a cloned table loses original split region(delete table)Majorproc-v2, Region Assignment, snapshots
HBASE-25207Revisit the implementation and usage of RegionStates.includeMajorRegion Assignment
HBASE-25186TestMasterRegionOnTwoFileSystems is failing after HBASE-25065Blockermaster
HBASE-25204Nightly job failed as the name of jdk and maven changedMajor.
HBASE-25093the RSGroupBasedLoadBalancer#retainAssignment throws NPEMajorrsgroup
HBASE-25117ReplicationSourceShipper thread can not be finishedMajor.
HBASE-25168Unify WAL name timestamp parsersMajor.
HBASE-23834HBase fails to run on Hadoop 3.3.0/3.2.2/3.1.4 due to jetty version mismatchMajordependencies
HBASE-25165Change ‘State time’ in UI so sortsMinorUI
HBASE-25048[HBCK2] Bypassed parent procedures are not updated in storeMajorhbck2, proc-v2
HBASE-25147Should store the regionNames field in state data for ReopenTableRegionsProcedureMajorproc-v2
HBASE-25115HFilePrettyPrinter can't seek to the row which is the first row of a hfileMajorHFile, tooling
HBASE-25135Convert the internal seperator while emitting the memstore read metrics to #Minor.
HBASE-24665MultiWAL : Avoid rolling of ALL WALs when one of the WAL needs a rollMajorwal
HBASE-25096WAL size in RegionServer UI is wrongMajor.
HBASE-25077hbck.jsp page loading fails, logs NPE in master log.Majorhbck
HBASE-25088CatalogFamilyFormat/MetaTableAccessor.parseRegionInfoFromRegionName incorrectly setEndKey to regionIdCriticalmeta
HBASE-25097Wrong RIT page number in Master UIMinorUI
HBASE-24896‘Stuck’ in static initialization creating RegionInfo instanceMajor.
HBASE-24956ConnectionManager#locateRegionInMeta waits for user region lock indefinitely.MajorClient
HBASE-24481HBase Rest: Request for region detail of a table which doesn't exits is success(200 success code) instead of 404Minor.
HBASE-25047WAL split edits number is negative in RegionServerUIMinorUI, wal
HBASE-25021Nightly job should skip hadoop-2 integration test for masterMajorbuild, scripts
HBASE-25012HBASE-24359 causes replication missed log of some RemoteExceptionMajorReplication
HBASE-25009Hbck chore logs wrong message when loading regions from RS reportMinor.
HBASE-25014ScheduledChore is never triggered when initalDelay > 1.5*periodMajor.
HBASE-25016Should close ResultScanner in MetaTableAccessor.scanByRegionEncodedNameCriticalmaster, meta
HBASE-24958CompactingMemStore.timeOfOldestEdit error updateCriticalregionserver
HBASE-24995MetaFixer fails to fix overlaps when multiple tables have overlapsMajorhbck2
HBASE-24719Renaming invalid rsgroup throws NPE instead of proper error messageMajor.
HBASE-19352Port HADOOP-10379: Protect authentication cookies with the HttpOnly and Secure flagsMajor.
HBASE-24971Upgrade JQuery to 3.5.1Majorsecurity, UI
HBASE-24968One of static initializers of CellComparatorImpl referring to subclass MetaCellComparatorMajor.
HBASE-24916Region hole contains wrong regions pair when hole is created by first region deletionMajorhbck2
HBASE-24885STUCK RIT by hbck2 assignsMajorhbck2, Region Assignment
HBASE-24926Should call setFailure in MergeTableRegionsProcedure when isMergeable returns falseMajormaster, proc-v2
HBASE-24884BulkLoadHFilesTool/LoadIncrementalHFiles should accept -D options from command line parametersMinor.
HBASE-24583Normalizer can't actually merge empty regions when neighbor is larger than average sizeMajormaster, Normalizer
HBASE-24844Exception on standalone (master) shutdownMinorZookeeper
HBASE-24856Fix error prone error in FlushTableSubprocedureMajor.
HBASE-24838The pre commit job fails to archive surefire reportsCriticalbuild, scripts
HBASE-23157WAL unflushed seqId tracking may wrong when Durability.ASYNC_WAL is usedMajorregionserver, wal
HBASE-24625AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length.CriticalReplication, wal
HBASE-24830Some tests involving RS crash fail with NullPointerException after HBASE-24632 in branch-2Major.
HBASE-24788Fix the connection leaks on getting hbase admin from unclosed connectionMajormapreduce
HBASE-24805HBaseTestingUtility.getConnection should be threadsafeMajortest
HBASE-24808skip empty log cleaner delegate class names (WAS => cleaner.CleanerChore: Can NOT create CleanerDelegate= ClassNotFoundException)Trivial.
HBASE-24767Change default to false for HBASE-15519 per-user metricsMajormetrics
HBASE-24713RS startup with FSHLog throws NPE after HBASE-21751Minorwal
HBASE-24794hbase.rowlock.wait.duration should not be <= 0Minorregionserver
HBASE-24797Move log code out of loopMinorNormalizer
HBASE-24752NPE/500 accessing webui on master startupMinormaster
HBASE-24766Document Remote Procedure ExecutionMajordocumentation
HBASE-11676Scan FORMATTER is not applied for columns using non-printable name in shellMinorshell
HBASE-24738[Shell] processlist command fails with ERROR: Unexpected end of file from server when SSL enabledMajorshell
HBASE-24675On Master restart all servers are assigned to default rsgroup.Majorrsgroup
HBASE-22146SpaceQuotaViolationPolicy Disable is not working in Namespace levelMajor.
HBASE-24742Improve performance of SKIP vs SEEK logicMajorPerformance, regionserver
HBASE-24710Incorrect checksum calculation in saveVersion.shMajorscripts
HBASE-24714Error message is displayed in the UI of table's compaction state if any region of that table is not open.MajorCompaction, UI
HBASE-24748Add hbase.master.balancer.stochastic.moveCost.offpeak to doc as support dynamically changeMinordocumentation
HBASE-24746The sort icons overlap the col name in master UIMajorUI
HBASE-24721rename_rsgroup overwriting the existing rsgroup.Major.
HBASE-24615MutableRangeHistogram#updateSnapshotRangeMetrics doesn't calculate the distribution for last bucket.Majormetrics
HBASE-24705MetaFixer#fixHoles() does not include the case for read replicas (i.e, replica regions are not created)Majorread replicas
HBASE-24720Meta replicas not cleaned when disabledMinorread replicas
HBASE-24693regioninfo#isLast() has a logic errorMinor.
HBASE-23744FastPathBalancedQueueRpcExecutor should enforce queue length of 0Minor.
HBASE-22738Fallback to default group to choose RS when there are no RS in current groupMajorrsgroup
HBASE-23126IntegrationTestRSGroup is useless nowMajorrsgroup
HBASE-24518waitForNamespaceOnline() should return false if any region is offlineMajor.
HBASE-24564Make RS abort call idempotentMajorregionserver
HBASE-24340PerformanceEvaluation options should not mandate any specific orderMinor.
HBASE-24130rat plugin complains about having an unlicensed file.Minor.
HBASE-24017Turn down flakey rerun rate on all but hot branchesMajor.

TESTS:

JIRASummaryPriorityComponent
HBASE-24015Coverage for Assign and Unassign of Regions on RegionServer on failureMajoramv2
HBASE-25156TestMasterFailover.testSimpleMasterFailover is flakyMajortest
HBASE-24979Include batch mutatations in client operation timeout testsMajor.
HBASE-24894[Flakey Test] TestStochasticLoadBalancer.testMoveCostMultiplierMajorBalancer, master, test

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-25127Enhance PerformanceEvaluation to profile meta replica performance.Major.
HBASE-25284Check-in “Enable memstore replication...” designMajor.
HBASE-25126Add load balance logic in hbase-client to distribute read load over meta replica regions.Major.
HBASE-25291Document how to enable the meta replica load balance mode for the client and clean up around hbase:meta read replicasMajor.
HBASE-25253Deprecated master carrys regions related methods and configsMajorBalancer, master
HBASE-25203Change the reference url to flaky list in our jenkins jobsMajorflakies, jenkins
HBASE-25194Do not publish workspace in flaky find jobMajorjenkins
HBASE-25169Update documentation about meta region replicaMajordocumentation
HBASE-25164Make ModifyTableProcedure support changing meta replica countMajormeta, read replicas
HBASE-25162Make flaky tests run more aggressivelyMajorjenkins, scripts, test
HBASE-25163Increase the timeout value for nightly jobsMajorjenkins, scripts, test
HBASE-22976[HBCK2] Add RecoveredEditsPlayerMajorhbck2, walplayer
HBASE-25124Support changing region replica count without disabling tableMajormeta, proc-v2
HBASE-23959Fix javadoc for JDK11Major.
HBASE-25151warmupRegion frustrates registering WALs on the catalog replicationsourceMajorread replicas
HBASE-25154Set java.io.tmpdir to project build directory to avoid writing std*deferred files to /tmpMajorbuild, test
HBASE-25121Refactor MetaTableAccessor.addRegionsToMeta and its usage placesMajormeta
HBASE-25055Add ReplicationSource for meta WALs; add enable/disable when hbase:meta assigned to RSMajor.
HBASE-25133Migrate HBase Nightly jenkins job from Hadoop to hbaseMajorjenkins, scripts
HBASE-25132Migrate flaky test jenkins job from Hadoop to hbaseMajorjenkins, scripts
HBASE-25103Remove ZNodePaths.metaReplicaZNodesMajor.
HBASE-25107Migrate flaky reporting jenkins job from Hadoop to hbaseMajorjenkins, scripts
HBASE-25068Pass WALFactory to Replication so it knows of all WALProviders, not just default/user-spaceMinor.
HBASE-25067Edit of log messages around async WAL Replication; checkstyle fixes; and a bugfixMajor.
HBASE-24857Fix several problems when starting webUIMinorcanary, UI
HBASE-24964Remove MetaTableAccessor.tableExistsMajormeta
HBASE-24765Dynamic master discoveryMajorClient
HBASE-24945Remove MetaTableAccessor.getRegionCountMajormapreduce, meta
HBASE-24944Remove MetaTableAccessor.getTableRegionsAndLocations in hbase-rest moduleMajormeta, REST
HBASE-24918Make RegionInfo#UNDEFINED IA.PrivateMajor.
HBASE-24806Small Updates to Functionality of Shell IRB WorkspaceMajorshell
HBASE-24876Fix the flaky job url in hbase-personality.shMajor.
HBASE-24841Change the jenkins job urls in our jenkinsfileMajorbuild, scripts
HBASE-24680Refactor the checkAndMutate code on the server sideMajor.
HBASE-24817Allow configuring WALEntry filters on ReplicationSourceMajorReplication, wal
HBASE-24632Enable procedure-based log splitting as default in hbase3Majorwal
HBASE-24718Generic NamedQueue framework for recent in-memory history (refactor slowlog)Major.
HBASE-24698Turn OFF Canary WebUI as defaultMajorcanary
HBASE-24650Change the return types of the new checkAndMutate methods introduced in HBASE-8458MajorClient
HBASE-24013Bump branch-2 version to 2.4.0-SNAPSHOTMajor.

OTHER:

JIRASummaryPriorityComponent
HBASE-25099Change meta replica count by altering meta table descriptorMajormeta, read replicas
HBASE-25320Upgrade hbase-thirdparty dependency to 3.4.1Blockerdependencies
HBASE-24640Purge use of VisibleForTestingMajorcommunity
HBASE-24081Provide documentation for running Yetus with HBaseMajordocumentation
HBASE-24667Rename configs that support atypical DNS set ups to put them in hbase.unsafeMajorconf, Operability
HBASE-25228Delete dev-support/jenkins_precommit_jira_yetus.shMinorbuild
HBASE-24200Upgrade to Yetus 0.12.0Minorbuild
HBASE-25120Remove the deprecated annotation for MetaTableAccessor.getScanForTableNameMajormeta
HBASE-25073Should not use XXXService.Interface.class.getSimpleName as stub key prefix in AsyncConnectionImplMajorClient
HBASE-25072Remove the unnecessary System.out.println in MasterRegistryMinorClient
HBASE-25004Log RegionTooBusyException detailsMajor.
HBASE-24993Remove OfflineMetaRebuildTestCoreMajortest
HBASE-24809Yetus IA Javadoc links are no longer availableMinor.
HBASE-14847Add FIFO compaction section to HBase bookMajordocumentation
HBASE-24843Sort the constants in `hbase_constants.rb`Minorshell
HBASE-24835Normalizer should log a successful run at INFO levelMinorNormalizer
HBASE-24779Improve insight into replication WAL readers hung on checkQuotaMinorReplication
HBASE-24662Update DumpClusterStatusAction to notice changes in region server countMajorintegration tests
HBASE-24658Update PolicyBasedChaosMonkey to handle uncaught exceptionsMinorintegration tests
HBASE-24648Remove the legacy ‘forceSplit’ related code at region server sideMajorregionserver
HBASE-24492ProtobufLogReader.readNext does not need loopingMinorReplication, wal
HBASE-22033Update to maven-javadoc-plugin 3.2.0 and switch to non-forking aggregate goalsMajorbuild, website

Release 2.3.0

CHANGES.md at rel/2.3.0 (e0e1382)

Release 2.2.0

CHANGES.md at rel/2.2.0 (3ec6932)

Release 2.1.0

CHANGES.md at rel/2.1.0 (e1673bb)

Release 2.0.0

CHANGES.md at rel/2.0.0 (7483b11)

Release 1.0.0

CHANGES.txt at rel/1.0.0 (6c98bff)