HBase Changelog

Release connector-1.0.0 - Unreleased (as of 2019-04-26)

NEW FEATURES:

JIRASummaryPriorityComponent
HBASE-13992Integrate SparkOnHBase into HBaseMajorhbase-connectors, spark
HBASE-14150Add BulkLoad functionality to HBase-Spark ModuleMajorhbase-connectors, spark
HBASE-14181Add Spark DataFrame DataSource to HBase-Spark ModuleMinorhbase-connectors, spark
HBASE-14340Add second bulk load option to Spark Bulk Load to send puts as the valueMinorhbase-connectors, spark
HBASE-14849Add option to set block cache to false on SparkSQL executionsMajorhbase-connectors, spark
HBASE-15572Adding optional timestamp semantics to HBase-SparkMajorhbase-connectors, spark
HBASE-17933[hbase-spark] Support Java api for bulkloadMajorhbase-connectors, spark
HBASE-15320HBase connector for Kafka ConnectMajorhbase-connectors, Replication

IMPROVEMENTS:

JIRASummaryPriorityComponent
HBASE-14515Allow spark module unit tests to be skipped with a profileMinorbuild, hbase-connectors, spark
HBASE-14158Add documentation for Initial Release for HBase-Spark Module integrationMajordocumentation, hbase-connectors, spark
HBASE-14159Resolve warning introduced by HBase-Spark moduleMinorbuild, hbase-connectors, spark
HBASE-15434[findbugs] Exclude scala generated source and protobuf generated code in hbase-spark moduleMajorhbase-connectors, spark
HBASE-16638Reduce the number of Connection's created in classes of hbase-spark moduleCriticalhbase-connectors, spark
HBASE-16823Add examples in HBase Spark moduleMajorhbase-connectors, spark
HBASE-17549HBase-Spark Module : Incorrect log at println and unwanted comment codeMajorhbase-connectors, spark
HBASE-18176add enforcer rule to make sure hbase-spark / scala aren't dependencies of unexpected modulesMajorbuild, hbase-connectors, spark
HBASE-21491[hbase-connectors] Edit on spark connector READMETrivialhbase-connectors
HBASE-21841Allow inserting null values throw DataSource APIMajorspark
HBASE-21880[hbase-connectors] clean up site targetMinorhbase-connectors
HBASE-21842Properly use flatten-maven-plugin in hbase-connectorsMajorhbase-connectors
HBASE-21931[hbase-connectors] Bump surefire versionMajorhbase-connectors
HBASE-14789Enhance the current spark-hbase connectorMajorhbase-connectors, spark

BUG FIXES:

JIRASummaryPriorityComponent
HBASE-14377JavaHBaseContextSuite not being runCriticalhbase-connectors, spark
HBASE-14406The dataframe datasource filter is wrong, and will result in data loss or unexpected behaviorBlockerhbase-connectors, spark
HBASE-15184SparkSQL Scan operation doesn't work on kerberos clusterCriticalhbase-connectors, spark
HBASE-16804JavaHBaseContext.streamBulkGet is void but should be JavaDStreamMajorhbase-connectors, spark
HBASE-17547HBase-Spark Module : TableCatelog doesn't support multiple columns from Single Column familyMajorhbase-connectors, spark
HBASE-17574Clean up how to run tests under hbase-spark moduleMajorhbase-connectors, spark
HBASE-15597Clean up configuration keys used in hbase-spark moduleCriticalhbase-connectors, spark
HBASE-17909Redundant exclusion of jruby-complete in pom of hbase-sparkMinorhbase-connectors, spark
HBASE-17546Incorrect syntax at HBase-Spark Module ExamplesMinorhbase-connectors, spark
HBASE-19387HBase-spark snappy.SnappyError on Arm64Minorhbase-connectors, spark, test
HBASE-16179Fix compilation errors when building hbase-spark against Spark 2.0Criticalhbase-connectors, spark
HBASE-20124Make hbase-spark module work with hadoop3Majordependencies, hadoop3, hbase-connectors, spark
HBASE-20177Fix warning: Class org.apache.hadoop.minikdc.MiniKdc not found in hbase-sparkMinorhbase-connectors
HBASE-20375Remove use of getCurrentUserCredentials in hbase-spark moduleMajorhbase-connectors, spark
HBASE-20880Fix for warning It would fail on the following input in hbase-sparkMinorhbase-connectors
HBASE-21038SAXParseException when hbase.spark.use.hbasecontext=falseMajorhbase-connectors
HBASE-20175hbase-spark needs scala dependency converganceMajordependencies, hbase-connectors, spark
HBASE-21429[hbase-connectors] pom refactoring adding kafka dir intermediaryMinorhbase-connectors, kafka
HBASE-21431[hbase-connectors] Fix build and test issuesBlockerhbase-connectors
HBASE-21434[hbase-connectors] Cleanup of kafka dependencies; clarify hadoop versionMajorhbase-connectors, kafka
HBASE-21446[hbase-connectors] Update spark and scala versions; add some doc on how to generate artifacts with different versionsMajorhbase-connectors, spark
HBASE-21448[hbase-connectors] Make compile/tests pass on scala 2.10 AND 2.11Majorhbase-connectors, spark
HBASE-21878[hbase-connectors] Fix hbase-checkstyle version referenceCriticalhbase-connectors
HBASE-21923[hbase-connectors] Make apache-rat passCriticalhbase-connectors
HBASE-21450[documentation] Point spark doc at hbase-connectors sparkMajordocumentation, hbase-connectors, spark

TESTS:

JIRASummaryPriorityComponent
HBASE-18175Add hbase-spark integration test into hbase-spark-itCriticalhbase-connectors, spark
HBASE-20176Fix warnings about Logging import in hbase-spark test codeMinorhbase-connectors

SUB-TASKS:

JIRASummaryPriorityComponent
HBASE-15336Support Dataframe writer to the spark connectorMajorhbase-connectors, spark
HBASE-15333[hbase-spark] Enhance dataframe filters to handle naively encoded short, integer, long, float and doubleMajorhbase-connectors, spark
HBASE-15473Documentation for the usage of hbase dataframe user api (JSON, Avro, etc)Blockerdocumentation, hbase-connectors, spark
HBASE-19482Fix Checkstyle errors in hbase-spark-itMinorhbase-connectors
HBASE-19597Fix Checkstyle errors in hbase-sparkMinorhbase-connectors, spark
HBASE-21002Create assembly and scripts to start Kafka ProxyMinorhbase-connectors
HBASE-21435[hbase-connectors] Cleanup of kafka dependencies; clarify hadoop version; addendumMinorhbase-connectors, kafka

OTHER:

JIRASummaryPriorityComponent
HBASE-14184Fix indention and typo in JavaHBaseContextMinorhbase-connectors, spark
HBASE-21022Review kafka-connection repo's POMsMajorhbase-connectors, kafka
HBASE-20257hbase-spark should not depend on com.google.code.findbugs.jsr305Minorbuild, hbase-connectors, spark
HBASE-21273Move classes out of org.apache.spark namespaceMajorhbase-connectors, spark
HBASE-21432[hbase-connectors] Add Apache Yetus integration for hbase-connectors repositoryMajorbuild, hbase-connectors
HBASE-22221Extend kafka-proxy documentation with required hbase settingsMajorhbase-connectors
HBASE-22210Fix hbase-connectors-assembly to include every jarMajorhbase-connectors
HBASE-22266Add yetus personality to connectors to avoid scaladoc issuesMajorhbase-connectors
HBASE-22257Remove json4s and jackson dependency from hbase spark connectorMajorhbase-connectors