commit | ae48ecbe232eb55267d1a138baeec13baa1fb249 | [log] [tgz] |
---|---|---|
author | Balaji Varadarajan <varadarb@uber.com> | Wed Jun 03 00:35:14 2020 -0700 |
committer | Sivabalan Narayanan <sivabala@uber.com> | Sun Jun 07 14:36:28 2020 -0400 |
tree | 8e3bc6ec1a95f9c783e0315571cca8fd2e8d428c | |
parent | 6dcd0a3524fe7be0bbbd3e673ed7e1d4b035e0cb [diff] |
[HUDI-990] Timeline API : filterCompletedAndCompactionInstants needs to handle requested state correctly. Also ensure timeline gets reloaded after we revert committed transactions
Apache Hudi (pronounced Hoodie) stands for Hadoop Upserts Deletes and Incrementals
. Hudi manages the storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage).
Hudi supports three types of queries:
Learn more about Hudi at https://hudi.apache.org
Prerequisites for building Apache Hudi:
# Checkout code and build git clone https://github.com/apache/hudi.git && cd hudi mvn clean package -DskipTests -DskipITs
To build the Javadoc for all Java and Scala classes:
# Javadoc generated under target/site/apidocs mvn clean javadoc:aggregate -Pjavadocs
The default Scala version supported is 2.11. To build for Scala 2.12 version, build using scala-2.12
profile
mvn clean package -DskipTests -DskipITs -Dscala-2.12
Please visit https://hudi.apache.org/docs/quick-start-guide.html to quickly explore Hudi's capabilities using spark-shell.