Google Git
Sign in
apache / datafusion-comet / HEAD
  1. 23f9194 chore: Refactor `CometScanRule` to improve scan selection and fallback logic (#2978) by Andy Grove · 25 hours ago main
  2. af3bd81 perf: Improve criterion benchmarks for cast string to int (#3049) by Andy Grove · 26 hours ago
  3. 77899ee chore: Add checks to microbenchmarks for plan running natively in Comet (#3045) by Andy Grove · 2 days ago
  4. 91f0f7b fix: reduce granularity of metrics updates in IcebergFileStream. (#3050) by Matt Butrovich · 2 days ago
  5. edec461 Chore: to_json unit/benchmark tests (#3011) by Kazantsev Maksim · 2 days ago
  6. 069681a perf: Improve performance of CAST from string to int (#3017) by B Vadlamani · 2 days ago
  7. 092d88c perf: Add microbenchmark for hash expressions (#3028) by Andy Grove · 2 days ago
  8. 89ebbd7 perf: Implement more microbenchmarks for cast expressions (#3031) by Andy Grove · 2 days ago
  9. 1e525a4 perf: Add microbenchmark for comparison expressions (#3026) by Andy Grove · 2 days ago
  10. 4dac745 feat: Improve performance of date truncate (#2997) by Andy Grove · 2 days ago
  11. e041a1e perf: Improve conditional expression microbenchmarks (#3024) by Andy Grove · 2 days ago
  12. 01a586f perf: Improve aggregate expression microbenchmarks (#3021) by Andy Grove · 2 days ago
  13. af6d335 perf: Improve date/time microbenchmarks to avoid redundant/duplicate benchmarks (#3020) by Andy Grove · 2 days ago
  14. c08a3ac perf: Improve string expression microbenchmarks (#3012) by Andy Grove · 2 days ago
  15. 394eb5d chore(deps): bump actions/cache from 4 to 5 (#3037) by dependabot[bot] · 3 days ago
  16. 10021fa chore(deps): bump libc from 0.2.178 to 0.2.179 in /native (#3038) by dependabot[bot] · 3 days ago
  17. be05e24 chore(deps): bump tokio from 1.48.0 to 1.49.0 in /native (#3039) by dependabot[bot] · 3 days ago
  18. 726c4b7 fix: format decimal to string when casting decimal with overflow (#2916) by Manu Zhang · 4 days ago
  19. 37cb5c9 chore: Improve microbenchmark for string expressions (#2964) by Andy Grove · 5 days ago
  20. 2738f06 skip more workflows on benchmark PRs (#3034) by Andy Grove · 6 days ago
  21. 2f19551 chore: Skip some CI workflows for benchmark changes (#3030) by Andy Grove · 6 days ago
  22. 6ec70ae perf: Improve performance of normalize_nan (#2999) by Andy Grove · 6 days ago
  23. 937619f chore: Add microbenchmark for casting string to numeric (#2979) by Andy Grove · 6 days ago
  24. aefb3b6 feat: Add support for remote Parquet HDFS writer with openDAL (#2929) by Oleks V · 10 days ago
  25. 26344c8 chore(deps): bump serde_json from 1.0.145 to 1.0.148 in /native (#3010) by dependabot[bot] · 10 days ago
  26. 3a68703 chore(deps): bump tempfile from 3.23.0 to 3.24.0 in /native (#3006) by dependabot[bot] · 10 days ago
  27. a3d9a92 chore(deps): bump reqwest from 0.12.26 to 0.12.28 in /native (#3009) by dependabot[bot] · 10 days ago
  28. 2bf2835 feat: Support ANSI mode avg expr (int inputs) (#2817) by B Vadlamani · 10 days ago
  29. bce61f5 Fix CometShuffleManager hang by deferring SparkEnv access (#3002) by Shekhar Prasad Rajak · 10 days ago
  30. dca45ea chore: Add microbenchmark for casting string to temporal types (#2980) by Andy Grove · 13 days ago
  31. fc122e8 build: Set thread thresholds envs for spark test on macOS (#2987) by Zhen Wang · 13 days ago
  32. 0ae6515 Avoid duplicated writer nodes when AQE enabled (#2982) by Oleks V · 2 weeks ago
  33. a951da9 feat: Support casting string float types (#2835) by B Vadlamani · 2 weeks ago
  34. f232887 feat: Support ANSI mode sum expr (int inputs) (#2600) by B Vadlamani · 2 weeks ago
  35. b5e4290 perf: Optimize lpad/rpad to remove unnecessary memory allocations per element (#2963) by Andy Grove · 2 weeks ago
  36. a122a14 feat: Initial implementation of size for array inputs (#2862) by Andy Grove · 2 weeks ago
  37. 97dd7bc skip test (#2966) by Andy Grove · 2 weeks ago
  38. 237929d fix: Remove fallback for maps containing complex types (#2943) by Andy Grove · 2 weeks ago
  39. bba98c7 feat: Remove unnecessary transition for native writes (#2960) by Oleks V · 2 weeks ago
  40. a9d0c2b fix merge conflict (#2962) by Andy Grove · 2 weeks ago
  41. f458088 minor: Refactor expression microbenchmarks to remove duplicate code (#2956) by Andy Grove · 2 weeks ago
  42. a6cfadb feat: Improve compatibility of string to decimal cast (#2925) by B Vadlamani · 2 weeks ago
  43. 1076f35 chore(deps): bump assertables from 9.8.2 to 9.8.3 in /native (#2953) by dependabot[bot] · 2 weeks ago
  44. 614fe13 fix: enable cast tests for Spark 4.0 (#2919) by Manu Zhang · 2 weeks ago
  45. 40be5cf chore(deps): bump cc from 1.2.49 to 1.2.50 in /native (#2954) by dependabot[bot] · 2 weeks ago
  46. 9960982 chore(deps): bump reqwest from 0.12.25 to 0.12.26 in /native (#2952) by dependabot[bot] · 2 weeks ago
  47. 77e0f71 build: Reinstate macOS CI builds of Comet with Spark 4.0 (#2950) by Manu Zhang · 2 weeks ago
  48. c2ce72a feat: Create microbenchmarks for Comet `cast` expression (#2932) by B Vadlamani · 2 weeks ago
  49. 0556f5e skip hive-1 test for spark 4 (#2947) by Andy Grove · 3 weeks ago
  50. fd53edb feat: Add partial support for `from_json` (#2934) by Andy Grove · 3 weeks ago
  51. 3dcd9ad chore: Remove low-level ffi/jvm timers from native `ScanExec` (#2939) by Andy Grove · 3 weeks ago
  52. b9fd050 chore: Reduce timer overhead in native shuffle writer (#2941) by Andy Grove · 3 weeks ago
  53. 60c0f1e chore: Add shuffle benchmark for deeply nested schemas (#2902) by Andy Grove · 3 weeks ago
  54. 6ab58cc Reduce syscall overhead in metrics updates (#2940) by Andy Grove · 3 weeks ago
  55. 618a440 refactor executePlan to try to avoid constantly entering tokio runtime. (#2938) by Matt Butrovich · 3 weeks ago
  56. 7ff3cbe perf: Use await instead of block_on in native shuffle writer (#2937) by Matt Butrovich · 3 weeks ago
  57. 53e4092 perf: [iceberg] Deduplicate serialized metadata for Iceberg native scan (#2933) by Matt Butrovich · 3 weeks ago
  58. 89a3c5f chore: move string function handling to new expression registry (#2931) by Andy Grove · 3 weeks ago
  59. 2a455c3 fix: Mark CometIcebergNativeScanExec's nativeIcebergScanMetadata @transient (#2930) by Matt Butrovich · 3 weeks ago
  60. 638c2c3 chore: Remove `row_step` from `process_sorted_row_partition` (#2920) by Andy Grove · 3 weeks ago
  61. b51a65d fix: Modulus on decimal data type mismatch (#2922) by Andy Grove · 3 weeks ago
  62. 8b041a9 chore: use fixed seed in RNG in tests (#2917) by Andy Grove · 3 weeks ago
  63. 619f368 chore: use datafusion impl of hex function (#2915) by Kazantsev Maksim · 3 weeks ago
  64. 5ec12d4 feat: Make shuffle writer buffer size configurable (#2899) by Andy Grove · 3 weeks ago
  65. e594aa3 feat: Pass S3 session token to Iceberg native scan (#2913) by hsiang-c · 3 weeks ago
  66. a51b281 feat: [iceberg] REST catalog support for CometNativeIcebergScan (#2895) by Matt Butrovich · 3 weeks ago
  67. ca7e728 chore(deps): bump actions/download-artifact from 6 to 7 (#2908) by dependabot[bot] · 3 weeks ago
  68. 330a7b4 chore: Refactor string benchmarks (~10x reduction in LOC) (#2907) by Andy Grove · 3 weeks ago
  69. 18aba10 chore(deps): bump actions/upload-artifact from 5 to 6 (#2910) by dependabot[bot] · 3 weeks ago
  70. f886106 chore(deps): bump actions/cache from 4 to 5 (#2909) by dependabot[bot] · 3 weeks ago
  71. 41d690a fix: modify CometNativeScan to generate the file partitions without instantiating RDD (#2891) by Matt Butrovich · 4 weeks ago
  72. ecbaa7f Add ANSI support to aggregate microbenchmarks (#2901) by B Vadlamani · 4 weeks ago
  73. 9095c86 chore: Refactor bit_not (#2896) by Kazantsev Maksim · 4 weeks ago
  74. 7282d57 feat: Enable bucket pruning with native_datafusion scans (#2888) by Matt Butrovich · 4 weeks ago
  75. 6d8b8c5 chore: `ScanExec::new` no longer fetches data (#2881) by Andy Grove · 4 weeks ago
  76. 24e4c12 feat: Improve fallback reporting for `native_datafusion` scan (#2879) by Andy Grove · 4 weeks ago
  77. 2d3172d chore: Enable plan stability suite for `native_datafusion` scans (#2877) by Andy Grove · 4 weeks ago
  78. 97767c2 deps: upgrade DataFusion to 51, Arrow to 57, Iceberg to latest, MSRV to 1.88 (#2729) by Matt Butrovich · 4 weeks ago
  79. be1524b feat: Implement native operator registry (#2875) by Andy Grove · 4 weeks ago
  80. bf1f3a2 minor: Pedantic refactoring to move some methods from `CometSparkSessionExtensions` to `CometScanRule` and `CometExecRule` (#2873) by Andy Grove · 4 weeks ago
  81. 58060e2 fix: Normalize s3 paths for PME key retriever (#2874) by Matt Butrovich · 4 weeks ago
  82. a7cf6cf fix: Fall back to Spark for MakeDecimal with unsupported input type (#2815) by Andy Grove · 4 weeks ago
  83. abcb499 chore: Add unit tests for `CometScanRule` (#2867) by Andy Grove · 4 weeks ago
  84. 86f8976 feat: Add expression registry to native planner (#2851) by Andy Grove · 4 weeks ago
  85. 81e19be chore: Add unit tests for `CometExecRule` (#2863) by Andy Grove · 4 weeks ago
  86. 0fec0f5 docs: add documentation for fully-native Iceberg scans (#2868) by Matt Butrovich · 4 weeks ago
  87. 5040a58 fix: Correct link to tracing guide in CometConf (#2866) by Manu Zhang · 4 weeks ago
  88. 95c8c7d minor: Small refactor in `CometExecRule` to remove confusing code and fix more fallback reporting (#2860) by Andy Grove · 4 weeks ago
  89. 60f420e chore: update actions/checkout from v4 to v6 in setup-iceberg and setup-spark builders (#2857) by Bjørn Jørgensen · 4 weeks ago
  90. ecaa4ae chore: Refactor `CometExecRule` handling of `BroadcastHashJoin` and fix fallback reporting (#2856) by Andy Grove · 4 weeks ago
  91. b5c4b33 chore(deps): bump cc from 1.2.48 to 1.2.49 in /native (#2858) by dependabot[bot] · 4 weeks ago
  92. a23eb48 chore: remove coverage file auto generator (#2854) by Oleks V · 5 weeks ago
  93. 5c6a027 minor: Move shuffle logic from `CometExecRule` to `CometShuffleExchangeExec` serde implementation (#2853) by Andy Grove · 5 weeks ago
  94. fd0ab64 feat: Support ANSI mode SUM (Decimal types) (#2826) by B Vadlamani · 5 weeks ago
  95. 0bda9d2 feat: Add support for `explode` and `explode_outer` for array inputs (#2836) by Andy Grove · 5 weeks ago
  96. 769d76e fix: NativeScan count assert firing for no reason (#2850) by Emily Matheys · 5 weeks ago
  97. 361e0bd deps: bump lz4_flex, downgrade prost from yanked version (#2847) by Matt Butrovich · 5 weeks ago
  98. ad17997 chore: Refactor some of the scan and sink handling in `CometExecRule` to reduce duplicate code (#2844) by Andy Grove · 5 weeks ago
  99. fe49e40 feat: CometNativeWriteExec support with native scan as a child (#2839) by Matt Butrovich · 5 weeks ago
  100. 9d82669 chore: fix broken link to Apache DataFusion Comet Overview in README (#2846) by Wonseok Yang · 5 weeks ago