HBASE Changelog

Release hbase-connectors-1.0.1 - Unreleased (as of 2023-10-18)

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-28152Replace scala.util.parsing.json with org.json4s.jackson which used in Spark tooMajorspark
HBASE-28137Add scala-parser-combinators dependency to connectors for Spark 3.4Majorspark
HBASE-27397Spark-hbase support for ‘startWith’ predicate.Minorhbase-connectors

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-27625Bump commons-lang3 to 3.12.0, surefire to 3.0.0 and dependency manage reload4j to 1.2.25 to support jdk11Majorhbase-connectors, spark
HBASE-27705Respect SparkContext hadoop configurationMajorspark
HBASE-27639Support hbase-connectors compilation with HBase 2.5.3, Hadoop 3.2.4 and Spark 3.2.3Majorhbase-connectors, spark
HBASE-26534Update dependencies in hbase-connectors: HBase version to 2.4.8, and make Hadoop 3 and Spark 3 defaultsMinorhadoop3, hbase-connectors, spark
HBASE-25684Dependency manage log4j in hbase-connectorsMinorhbase-connectors
HBASE-25326Allow hbase-connector to be used with Apache Spark 3.0Minor.
HBASE-23606Remove external deprecations in hbase-connectorsMinor.
HBASE-24230Support user-defined version timestamp when bulk load dataMinorhbase-connectors
HBASE-23608Remove redundant groupId from spark module in hbase-connectorsTrivial.
HBASE-23592Refactor tests in hbase-kafka-proxy in hbase-connectorsTrivial.
HBASE-24110Move to Apache parent POM version 23 for connectorsMinorhbase-connectors
HBASE-23603Update Apache POM to version 21 for hbase-connectorsTrivial.
HBASE-23607Update Maven plugins in hbase-connectorsMinor.
HBASE-23579Fix Checkstyle errors in hbase-connectorsMinor.
HBASE-23586Use StandardCharsets instead of String in TestQualifierMatching in hbase-connectorsTrivial.
HBASE-23580Refactor TestRouteRules in hbase-connectorsTrivial.
HBASE-23576Bump Checkstyle from 8.11 to 8.18 in hbase-connectorsMinor.
HBASE-22817Use hbase-shaded dependencies in hbase-sparkMajorhbase-connectors
HBASE-23075Upgrade jackson to version 2.9.10 due to CVE-2019-16335 and CVE-2019-14540Majordependencies, hbase-connectors, REST, security

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-26863Rowkey pushdown does not work with complex conditionsMajorhbase-connectors
HBASE-27488[hbase-connectors] Duplicate result when searching HBase by SparkMajorhbase-connectors
HBASE-27656Make sure the close method of the SmartSonnection is calledMajorspark
HBASE-27176[hbase-connectors] Fail to build hbase-connectors because of checkstyle errorMajorbuild, hbase-connectors
HBASE-27801Remove redundant avro.version property from Kafka connectorMinorhbase-connectors, kafka
HBASE-27630hbase-spark bulkload stage directory limited to hdfs onlyMajorspark
HBASE-27624Cannot Specify Namespace via the hbase.table Option in Spark ConnectorMajorhbase-connectors, spark
HBASE-22338LICENSE file only contains Apache 2.0Criticalhbase-connectors
HBASE-26211[hbase-connectors] Pushdown filters in Spark do not work correctly with long typesMajorhbase-connectors
HBASE-25236[hbase-connectors] Run package phase on spark modulesMajorhbase-connectors
HBASE-24276hbase spark connector doesn't support writing to table not in default namespaceMajorhbase-connectors, spark
HBASE-24088Solve the ambiguous reference for scala 2.12Minorhbase-connectors
HBASE-23295hbase-connectors HBaseContext should use most recent delegation tokenMajorhbase-connectors
HBASE-23351Updating hbase version to 2.2.2Majorhbase-connectors
HBASE-23348Spark's createTable method throws an exception while the table is being splitMajorhbase-connectors
HBASE-23346Import ReturnCode in SparkSQLPushDownFilterMajorhbase-connectors
HBASE-23327Add missing maven functions for hb_mavenCriticalhbase-connectors
HBASE-23059Run mvn install for root in precommitMajorhbase-connectors
HBASE-22711Spark connector doesn't use the given mapping when inserting dataMajorhbase-connectors
HBASE-22674precommit docker image installs JRE over JDK (multiple repos)Criticalbuild, hbase-connectors
HBASE-22336Add CHANGELOG, README and RELEASENOTES to binary tarballCriticalhbase-connectors
HBASE-22329Fix for warning The parameter forkMode is deprecated since version in hbase-spark-itMinorhbase-connectors
HBASE-22320hbase-connectors personality skips non-scaladoc testsCritical.
HBASE-22319Fix for warning The assembly descriptor contains a filesystem-root relative referenceMinorhbase-connectors

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-28054[hbase-connectors] Add spotless in hbase-connectors pre commit checkMajorbuild, community, hbase-connectors, jenkins
HBASE-28006[hbase-connectors] Run spotless:apply on code baseMajorbuild, hbase-connectors
HBASE-27178[hbase-connectors] Add spotless plugin to format code (including scala code)Majorbuild, hbase-connectors
HBASE-25136Migrate HBase-Connectors-PreCommit jenkins job from Hadoop to hbaseMajorhbase-connectors, jenkins

OTHER:

JIRASummaryPriorityComponent
HBASE-27114Upgrade scalatest maven plugin for thread-safetyMajorbuild, spark
HBASE-27883[hbase-connectors] Use log4j2 instead of log4j for loggingBlockerhbase-connectors
HBASE-27679Bump junit to 4.13.2 in hbase-connectorsMajorhbase-connectors
HBASE-27680Bump hbase, hbase-thirdparty, hadoop and spark for hbase-connectorsMajorhbase-connectors
HBASE-27678Update checkstyle in hbase-connectorsMajorhbase-connectors
HBASE-27285Fix sonar report pathsMinorhbase-connectors
HBASE-27272Enable code coverage reporting to SonarQube in hbase-connectorsMinorhbase-connectors
HBASE-26664HBASE-26664 hbase-connector upgrades extra-enforcer-rules to 1.5.1Majorhbase-connectors
HBASE-26334Upgrade commons-io to 2.11.0 in hbase-connectorsMajorhbase-connectors
HBASE-26314Upgrade commons-io to 2.8.0 in hbase-connectorsMajorhbase-connectors
HBASE-25579HBase Connectors pom should include nexus staging repo managementMajorcommunity, hbase-connectors
HBASE-25479[connectors] Purge use of VisibleForTestingMajorhbase-connectors
HBASE-25388Replacing Producer implementation with an extension of MockProducer on testing side in hbase-connectorsMajorhbase-connectors
HBASE-24883Migrate hbase-connectors testing to ci-hadoopMajorbuild, hbase-connectors
HBASE-24261Redo all of our github notification integrations on new ASF infra featureMajorcommunity, hbase-connectors
HBASE-23565Execute tests in hbase-connectors precommitCriticalhbase-connectors
HBASE-23032Upgrade to Curator 4.2.0Major.
HBASE-22599Let hbase-connectors compile against HBase 2.2.0Majorhbase-connectors
HBASE-22698[hbase-connectors] Add license header to README.mdMajorhbase-connectors
HBASE-22636hbase spark module README is in txt format.Trivialhbase-connectors
HBASE-22318Fix for warning The POM for org.glassfish:javax.el:jar is missingMinorhbase-connectors

Release connector-1.0.0 - Unreleased (as of 2019-04-26)

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-13992Integrate SparkOnHBase into HBaseMajorhbase-connectors, spark
HBASE-14150Add BulkLoad functionality to HBase-Spark ModuleMajorhbase-connectors, spark
HBASE-14181Add Spark DataFrame DataSource to HBase-Spark ModuleMinorhbase-connectors, spark
HBASE-14340Add second bulk load option to Spark Bulk Load to send puts as the valueMinorhbase-connectors, spark
HBASE-14849Add option to set block cache to false on SparkSQL executionsMajorhbase-connectors, spark
HBASE-15572Adding optional timestamp semantics to HBase-SparkMajorhbase-connectors, spark
HBASE-17933[hbase-spark] Support Java api for bulkloadMajorhbase-connectors, spark
HBASE-15320HBase connector for Kafka ConnectMajorhbase-connectors, Replication

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-14515Allow spark module unit tests to be skipped with a profileMinorbuild, hbase-connectors, spark
HBASE-14158Add documentation for Initial Release for HBase-Spark Module integrationMajordocumentation, hbase-connectors, spark
HBASE-14159Resolve warning introduced by HBase-Spark moduleMinorbuild, hbase-connectors, spark
HBASE-15434[findbugs] Exclude scala generated source and protobuf generated code in hbase-spark moduleMajorhbase-connectors, spark
HBASE-16638Reduce the number of Connection's created in classes of hbase-spark moduleCriticalhbase-connectors, spark
HBASE-16823Add examples in HBase Spark moduleMajorhbase-connectors, spark
HBASE-17549HBase-Spark Module : Incorrect log at println and unwanted comment codeMajorhbase-connectors, spark
HBASE-18176add enforcer rule to make sure hbase-spark / scala aren't dependencies of unexpected modulesMajorbuild, hbase-connectors, spark
HBASE-21491[hbase-connectors] Edit on spark connector READMETrivialhbase-connectors
HBASE-21841Allow inserting null values throw DataSource APIMajorspark
HBASE-21880[hbase-connectors] clean up site targetMinorhbase-connectors
HBASE-21842Properly use flatten-maven-plugin in hbase-connectorsMajorhbase-connectors
HBASE-21931[hbase-connectors] Bump surefire versionMajorhbase-connectors
HBASE-14789Enhance the current spark-hbase connectorMajorhbase-connectors, spark

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-14377JavaHBaseContextSuite not being runCriticalhbase-connectors, spark
HBASE-14406The dataframe datasource filter is wrong, and will result in data loss or unexpected behaviorBlockerhbase-connectors, spark
HBASE-15184SparkSQL Scan operation doesn't work on kerberos clusterCriticalhbase-connectors, spark
HBASE-16804JavaHBaseContext.streamBulkGet is void but should be JavaDStreamMajorhbase-connectors, spark
HBASE-17547HBase-Spark Module : TableCatelog doesn't support multiple columns from Single Column familyMajorhbase-connectors, spark
HBASE-17574Clean up how to run tests under hbase-spark moduleMajorhbase-connectors, spark
HBASE-15597Clean up configuration keys used in hbase-spark moduleCriticalhbase-connectors, spark
HBASE-17909Redundant exclusion of jruby-complete in pom of hbase-sparkMinorhbase-connectors, spark
HBASE-17546Incorrect syntax at HBase-Spark Module ExamplesMinorhbase-connectors, spark
HBASE-19387HBase-spark snappy.SnappyError on Arm64Minorhbase-connectors, spark, test
HBASE-16179Fix compilation errors when building hbase-spark against Spark 2.0Criticalhbase-connectors, spark
HBASE-20124Make hbase-spark module work with hadoop3Majordependencies, hadoop3, hbase-connectors, spark
HBASE-20177Fix warning: Class org.apache.hadoop.minikdc.MiniKdc not found in hbase-sparkMinorhbase-connectors
HBASE-20375Remove use of getCurrentUserCredentials in hbase-spark moduleMajorhbase-connectors, spark
HBASE-20880Fix for warning It would fail on the following input in hbase-sparkMinorhbase-connectors
HBASE-21038SAXParseException when hbase.spark.use.hbasecontext=falseMajorhbase-connectors
HBASE-20175hbase-spark needs scala dependency converganceMajordependencies, hbase-connectors, spark
HBASE-21429[hbase-connectors] pom refactoring adding kafka dir intermediaryMinorhbase-connectors, kafka
HBASE-21431[hbase-connectors] Fix build and test issuesBlockerhbase-connectors
HBASE-21434[hbase-connectors] Cleanup of kafka dependencies; clarify hadoop versionMajorhbase-connectors, kafka
HBASE-21446[hbase-connectors] Update spark and scala versions; add some doc on how to generate artifacts with different versionsMajorhbase-connectors, spark
HBASE-21448[hbase-connectors] Make compile/tests pass on scala 2.10 AND 2.11Majorhbase-connectors, spark
HBASE-21878[hbase-connectors] Fix hbase-checkstyle version referenceCriticalhbase-connectors
HBASE-21923[hbase-connectors] Make apache-rat passCriticalhbase-connectors
HBASE-21450[documentation] Point spark doc at hbase-connectors sparkMajordocumentation, hbase-connectors, spark

TESTS:

JIRASummaryPriorityComponent
HBASE-18175Add hbase-spark integration test into hbase-spark-itCriticalhbase-connectors, spark
HBASE-20176Fix warnings about Logging import in hbase-spark test codeMinorhbase-connectors

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-15336Support Dataframe writer to the spark connectorMajorhbase-connectors, spark
HBASE-15333[hbase-spark] Enhance dataframe filters to handle naively encoded short, integer, long, float and doubleMajorhbase-connectors, spark
HBASE-15473Documentation for the usage of hbase dataframe user api (JSON, Avro, etc)Blockerdocumentation, hbase-connectors, spark
HBASE-19482Fix Checkstyle errors in hbase-spark-itMinorhbase-connectors
HBASE-19597Fix Checkstyle errors in hbase-sparkMinorhbase-connectors, spark
HBASE-21002Create assembly and scripts to start Kafka ProxyMinorhbase-connectors
HBASE-21435[hbase-connectors] Cleanup of kafka dependencies; clarify hadoop version; addendumMinorhbase-connectors, kafka

OTHER:

JIRASummaryPriorityComponent
HBASE-14184Fix indention and typo in JavaHBaseContextMinorhbase-connectors, spark
HBASE-21022Review kafka-connection repo's POMsMajorhbase-connectors, kafka
HBASE-20257hbase-spark should not depend on com.google.code.findbugs.jsr305Minorbuild, hbase-connectors, spark
HBASE-21273Move classes out of org.apache.spark namespaceMajorhbase-connectors, spark
HBASE-21432[hbase-connectors] Add Apache Yetus integration for hbase-connectors repositoryMajorbuild, hbase-connectors
HBASE-22221Extend kafka-proxy documentation with required hbase settingsMajorhbase-connectors
HBASE-22210Fix hbase-connectors-assembly to include every jarMajorhbase-connectors
HBASE-22266Add yetus personality to connectors to avoid scaladoc issuesMajorhbase-connectors
HBASE-22257Remove json4s and jackson dependency from hbase spark connectorMajorhbase-connectors