Sketch adaptors for Hive.

Clone this repo:
  1. 030290b Fix typos. by Lee Rhodes · 4 weeks ago master
  2. 31d66b6 Release Process: Change pom version to 1.2.0-incubating-SNAPSHOT. by Lee Rhodes · 8 weeks ago
  3. c827e37 Added license to new file log4j2.xml by Lee Rhodes · 8 weeks ago
  4. a1850e6 Changed POM and added log4j2.xml config to eliminate compiler warnings. by Lee Rhodes · 8 weeks ago
  5. 3840c79 Minor fixes to gitignore, travis.yml, SketchesCheckstyle.xml, package-info. by Lee Rhodes · 8 weeks ago

Build Status Maven Central Language grade: Java Total alerts Coverage Status

=================

DataSketches Java UDF/UDAF Adaptors for Apache Hive

Please visit the main DataSketches website for more information.

If you are interested in making contributions to this site please see our Community page for how to contact us.


Hadoop Hive UDFs/UDAFs

See relevant sections under the different sketch types in Java Core Documentation.

Build Instructions

NOTE: This component accesses resource files for testing. As a result, the directory elements of the full absolute path of the target installation directory must qualify as Java identifiers. In other words, the directory elements must not have any space characters (or non-Java identifier characters) in any of the path elements. This is required by the Oracle Java Specification in order to ensure location-independent access to resources: See Oracle Location-Independent Access to Resources

JDK8 is required to compile

This DataSketches component is pure Java and you must compile using JDK 8.

Recommended Build Tool

This DataSketches component is structured as a Maven project and Maven is the recommended Build Tool.

There are two types of tests: normal unit tests and tests run by the strict profile.

To run normal unit tests:

$ mvn clean test

To run the strict profile tests:

$ mvn clean test -P strict

To install jars built from the downloaded source:

$ mvn clean install -DskipTests=true

This will create the following jars:

  • datasketches-hive-X.Y.Z-incubating.jar The compiled main class files.
  • datasketches-hive-X.Y.Z-incubating-tests.jar The compiled test class files.
  • datasketches-hive-X.Y.Z-incubating-sources.jar The main source files.
  • datasketches-hive-X.Y.Z-incubating-test-sources.jar The test source files
  • datasketches-hive-X.Y.Z-incubating-javadoc.jar The compressed Javadocs.

Dependencies

Run-time

This has the following top-level dependencies:

  • org.apache.datasketches : datasketches-java
  • org.apache.hive : hive-exec
  • org.apache.hadoop : hadoop-common
  • org.apache.hadoop : hadoop-mapreduce-client-core

Testing

See the pom.xml file for test dependencies.


Disclaimer: Apache DataSketches is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.