Apache Hudi

Clone this repo:
  1. ed745df [HUDI-40] Add parquet support for the Delta Streamer (#949) by YanJia-Gary-Li · 2 days ago master
  2. 7381b66 [HUDI-121] Fix issues in release scripts by Balaji Varadarajan · 3 days ago
  3. 603df66 Update RELEASE Notes in master by Balaji Varadarajan · 3 days ago
  4. 77f4e73 [HUDI-121] Fix licensing issues found during RC voting by general incubator group by Balaji Varadarajan · 7 days ago
  5. 8c13340 Shade and relocate Avro dependency in hadoop-mr-bundle by Mehrotra · 4 weeks ago

Hudi

Apache Hudi (incubating) (pronounced Hoodie) stands for Hadoop Upserts anD Incrementals. Hudi manages the storage of large analytical datasets on DFS (Cloud stores, HDFS or any Hadoop FileSystem compatible storage) and provides the ability to query them via three types of views

  • Read Optimized View - Provides excellent query performance via purely columnar storage (e.g. Parquet)
  • Incremental View - Provides a change stream with records inserted or updated after a point in time.
  • Real-time View - Provides queries on real-time data, using a combination of columnar & row-based storage (e.g Parquet + Avro)

For more, head over here