The latest version of Iceberg is 0.10.0.
To use Iceberg in Spark, download the runtime Jar and add it to the jars folder of your Spark install. Use iceberg-spark3-runtime for Spark 3, and iceberg-spark-runtime for Spark 2.4.
To use Iceberg in Hive, download the iceberg-hive-runtime Jar and add it to Hive using ADD JAR
.
To add a dependency on Iceberg in Gradle, add the following to build.gradle
:
dependencies { compile 'org.apache.iceberg:iceberg-core:0.10.0' }
You may also want to include iceberg-parquet
for Parquet file support.
To add a dependency on Iceberg in Maven, add the following to your pom.xml
:
<dependencies> ... <dependency> <groupId>org.apache.iceberg</groupId> <artifactId>iceberg-core</artifactId> <version>0.10.0</version> </dependency> ... </dependencies>
High-level features:
MERGE INTO
) in processing enginesImportant bug fixes:
notIn
and notEqual
to match null valuesExpressions.notNull
returning an isNull
predicate; API only, method was not used by processing enginesIllegalArgumentException
in vectorized Spark reads with negative decimal valuesOther notable changes:
iceberg-hive
module has been renamed to iceberg-hive-metastore
to avoid confusionLocationProvider
A more exhaustive list of changes is available under the 0.10.0 release milestone.