Apache DataFusion Comet Native Code

This project contains the following crates:

  • common: Common types shared across crates
  • core: Native code used by the Comet Spark plugin
  • jni-bridge: JNI interaction layer used across the native crates
  • operators: Native execution operators that need nothing else from core
  • proto: Comet protocol buffer definition for query plans
  • shuffle: Shuffle writer and reader
  • spark-expr: Spark-compatible DataFusion operators and expressions