Google Git
Sign in
apache/datafusion-comet/HEAD
  1. 367ca64 fix: ignore reader-side parquet.hadoop.vectored.io.enabled in Iceberg native-write detection (#5410) by Steve Vaughan · 9 hours ago main
  2. 356f33c perf: improve ArrowWriter performance for fixed-length vectors (#5046) by Peter Lee · 10 hours ago
  3. f8f9b33 chore(deps): bump actions/checkout from 6 to 7 (#5406) by dependabot[bot] · 13 hours ago
  4. e24d4cd test: strengthen signed-zero SQL assertions (#5404) by Chao Sun · 13 hours ago
  5. 682ebf4 chore(deps): bump the codeql-actions group with 2 updates (#5405) by dependabot[bot] · 13 hours ago
  6. 1bddcff fix: format NativeMemoryConsumer id in toString (#5398) by Wei Yan · 14 hours ago
  7. 92954d7 chore: fix clippy warnings for Rust 1.98 (#5400) by Wei Yan · 25 hours ago
  8. 91f9fbe test: fix vacuous signed-zero coverage in SQL file tests (#5393) by sam-1112 · 33 hours ago
  9. 7e0e5d2 fix: Native shuffle fails with a 2GB task serialization OOM on jobs with many partitions (#5392) by Parth Chandra · 2 days ago
  10. 05a3083 fix: report native shuffle write metrics accurately (#5370) by Chao Sun · 2 days ago
  11. 2b35fb8 perf: vectorize Map in spark_size via offset buffer (#5395) by ChenChen Lai · 2 days ago
  12. 0d66cc3 chore(deps): bump the all-other-cargo-deps group (#5360) by dependabot[bot] · 2 days ago
  13. c2f6c2a feat: Support native scans with unprojected Spark 4 VARIANT columns (#5377) by Chao Sun · 2 days ago
  14. 6716318 feat: build gate + inert wiring for contrib Delta scans [Delta contrib split, part 2] (#4952) by Scott Schenkein · 2 days ago
  15. bdd2e13 fix: canonicalize NaN in flat arrays_overlap float keys (#5376) by Chao Sun · 3 days ago
  16. a28ac34 fix: preserve Spark semantics for dictionary-encoded Parquet inputs and reject dictionary targets (#5234) by Peter Lee · 3 days ago
  17. 36caf8e fix: guard against silent fail_on_error loss in scalar wiring (#5074) (#5359) by sam-1112 · 3 days ago
  18. e4ec630 fix: preserve Catalyst nullability and field IDs in native Parquet writes (#5369) by Chao Sun · 3 days ago
  19. 857696d feat: add micro benchmark runner and EC2 guide (#5374) by Andy Grove · 3 days ago
  20. 4752f5b perf: make CometShuffleBenchmark completable and fast (#5388) by Andy Grove · 4 days ago
  21. ce602ac feat: remove native cast from boolean to decimal (#5185) by Andy Grove · 4 days ago
  22. 4b60dca test: make expression benchmark harness fair and reproducible (#5371) by Andy Grove · 6 days ago
  23. a74839c fix: match Spark whitespace trimming in to_time and try_to_time (#5364) by Chao Sun · 6 days ago
  24. e095586 docs: add suggest-native-expression skill for assessing native expression candidates (#5348) by Andy Grove · 8 days ago
  25. fbdc267 chore: respect Cargo parallelism settings for native release builds (#5344) by Ping Zhang · 8 days ago
  26. f058bf9 feat: detect Iceberg V2 writes and emit fall-back reasons (#5298) by Jordan Epstein · 8 days ago
  27. cb36aa5f chore(deps): bump opendal from 0.57.0 to 0.58.1 in /native (#5324) by Manu Zhang · 9 days ago
  28. 68cbde1 test: cover the narrowing direction of cast_and_stamp_schema (#5285) by Andy Grove · 10 days ago
  29. 6db6b52 Revert "chore(deps): bump object_store_opendal from 0.57.0 to 0.58.0 in /nati…" (#5332) by Bhargava Vadlamani · 10 days ago
  30. 2a9873e chore(deps): bump the codeql-actions group with 2 updates (#5286) by dependabot[bot] · 10 days ago
  31. a09bb2b chore(deps): bump object_store_opendal from 0.57.0 to 0.58.0 in /native (#5289) by dependabot[bot] · 11 days ago
  32. fbf3bfc chore(deps): bump reqsign-core (#5287) by dependabot[bot] · 11 days ago
  33. bdd2aeb docs: correct Spark 4.2 version and CI test status in installation guide (#5315) by Andy Grove · 12 days ago
  34. c706360 fix: avoid duplicate CheckOverflow evaluation for decimal division (#5225) by Peter Lee · 2 weeks ago
  35. 003f608 fix: propagate the Spark task ClassLoader to JVM UDF calls (#5282) by Andy Grove · 2 weeks ago
  36. 93e0d7f docs: add 1.0.0 changelog (#5243) (#5263) by Andy Grove · 2 weeks ago
  37. 4ad15fe chore: update documentation links for 1.0.0 release (#5290) by Andy Grove · 2 weeks ago
  38. 3598d55 feat: Optionally split the Iceberg V2 write operator into distinct writer and committer operations (#4658) by Jordan Epstein · 2 weeks ago
  39. cd4d0e2 fix: normalize nested field nullability in ShuffleScanExec and ExpandExec (#5138) by Andy Grove · 2 weeks ago
  40. ef60197 fix: surface next_day and make_date ANSI errors as Spark exceptions (#5167) by Peter Lee · 2 weeks ago
  41. 73ef55f docs: add 1.0.0 TPC-DS benchmark results, remove TPC-H (#5284) by Matt Butrovich · 2 weeks ago
  42. 5783793 fix: skip null slots when checking overflow in unary negation (#5162) by Han-Yin Chang · 2 weeks ago
  43. 268849c feat: add `make_interval` support (codegen dispatch + native) (#5039) by Peter Lee · 2 weeks ago
  44. b54d9dc test: add guard for Iceberg version on Variant fallback test (#5278) by Matt Butrovich · 2 weeks ago
  45. f22d9f1 refactor: use arity helper for Int to Decimal128 reinterpretation (#5193) by ChenChen Lai · 2 weeks ago
  46. 1feef7a perf: compute spark_size list lengths with Arrow length kernel (#5233) by ChenChen Lai · 2 weeks ago
  47. d3b1072 test: rename CometCastSuite to CometNativeCastSuite (#5268) by Andy Grove · 2 weeks ago
  48. f262b13 feat: support _metadata constant columns in native Parquet scan (#5237) by Matt Butrovich · 2 weeks ago
  49. 4cfd073 perf: vectorize integer-to-decimal cast (#4939) by Andy Grove · 2 weeks ago
  50. 0fe9b38 feat: support timestampadd and timestampdiff via codegen dispatch (#5030) by Andy Grove · 2 weeks ago
  51. 07307b5 perf: cache Iceberg reflection lookups on the planning path (#5222) by Andy Grove · 2 weeks ago
  52. 5b8a45e refactor: replace hand-coded rollup of expression fallback reasons onto operators (#5236) by Andy Grove · 2 weeks ago
  53. 2af9cec feat: support `explode_outer` (#5192) by Oleks V · 2 weeks ago
  54. 8983598 add docs about run-iceberg-tests. (#5247) by Matt Butrovich · 3 weeks ago
  55. 2cba02f perf: optimize `spark_floor` (up to 4x faster) (#4911) by Andy Grove · 3 weeks ago
  56. 0eb72fb chore: start 1.1.0 development (#5242) by Andy Grove · 3 weeks ago
  57. 38de369 perf: optimize spark_base64 in spark-expr (#4885) by Andy Grove · 3 weeks ago
  58. af534e0 docs: document ReusedExchange caveat and both CometSparkToColumnar names in operator-count exclusions (#5240) by Andy Grove · 3 weeks ago
  59. ee974a1 fix: count ReusedSubquery and CometSubqueryBroadcast correctly in extended explain (#5206) by Andy Grove · 3 weeks ago
  60. f13cc97 fix: codegen dispatcher null short-circuit swallowed ANSI errors, plus two latent TIME-type gaps (#5219) by Andy Grove · 3 weeks ago
  61. 6acfe7d feat: report native vs codegen-dispatch expression coverage in extended explain (#5201) by Andy Grove · 3 weeks ago
  62. 42528db docs: drop compatibility notes for bugs that are now fixed (#5154) by Andy Grove · 3 weeks ago
  63. 1008e63 chore: cargo update for 1.0 release (#5226) by Matt Butrovich · 3 weeks ago
  64. 41d887d perf: avoid rebuilding untouched operators in PlanDataInjector.injectPlanData (#5220) by Andy Grove · 3 weeks ago
  65. 936794d refactor: rename pyarrowUdf config to pyarrowUDF and fix stale config docs (#5197) by Andy Grove · 3 weeks ago
  66. 42a48bb chore: remove unused spark.comet.exceptionOnDatetimeRebase config (#5221) by Andy Grove · 3 weeks ago
  67. 3df58d5 perf: intern QueryContext SQL text into a per-plan pool (up to 20x smaller serialized plans for TPC-DS) (#5204) by Andy Grove · 3 weeks ago
  68. 671a8dd fix: make native cast from float/double to decimal compatible with Spark (#5136) by Andy Grove · 3 weeks ago
  69. 2fa6461 chore: bump Spark 4.0 to 4.0.4 (#5182) by Andy Grove · 3 weeks ago
  70. ba21f02 perf: use Arrow comparator for nested array equality (#5176) by Peter Lee · 3 weeks ago
  71. 47f395c fix: use per-expression eval mode for decimal promotion (#5171) by Peter Lee · 3 weeks ago
  72. 064dcf6 chore: bump Spark 4.1 to 4.1.3 (#5183) by Andy Grove · 3 weeks ago
  73. 60413eb feat: support Iceberg metadata columns _pos, _spec, _file, and _partition (#4752) by Parth Chandra · 3 weeks ago
  74. 0abe966 chore: bump Spark 3.5 to 3.5.9 (#5181) by Andy Grove · 3 weeks ago
  75. 1ce9df1 feat: native uuid() implementation compatible with Spark (#5034) by Andy Grove · 3 weeks ago
  76. 285a803 chore: drop deprecated .toIterable from protobuf builder calls (#5173) by Andy Grove · 3 weeks ago
  77. d2a61bd fix: disambiguate Iceberg scans that share a metadata_location (#5180) by Matt Butrovich · 3 weeks ago
  78. cda9d29 fix: match Spark's whitespace trim semantics for casts from string to boolean, integral, float/double and decimal (#5150) by Andy Grove · 3 weeks ago
  79. e0de582 fix: round on Int64 with scale <= -19 now overflows correctly (#5082) by Andy Grove · 3 weeks ago
  80. c4074f0 refactor: drop redundant concat layer in single-partition shuffle (#5004) by Andy Grove · 3 weeks ago
  81. 87f7070 chore: clean up Scala compiler warnings (#5141) by Andy Grove · 3 weeks ago
  82. bfc5799 chore: supply explicit empty argument lists for 2.13 (#5175) by Andy Grove · 3 weeks ago
  83. 2707f21 chore: remove Array -> Seq round trips flagged by the 2.13 copy deprecation (#5170) by Andy Grove · 3 weeks ago
  84. a0a5d29 chore(deps): bump actions/stale from 10.4.0 to 11.0.0 (#5163) by dependabot[bot] · 3 weeks ago
  85. cfd8f1f test: cover ArrayExists three-valued logic config (#5000) by Manu Zhang · 3 weeks ago
  86. dba2ce4 chore: replace deprecated symbol literals with $"col" in tests (#5168) by Andy Grove · 3 weeks ago
  87. 2732fe5 adjust logging levels on frequent callsites (#5155) by Matt Butrovich · 3 weeks ago
  88. 8782d95 fix: raise REMAINDER_BY_ZERO for Float/Double under ANSI mode (#5081) by Andy Grove · 3 weeks ago
  89. 0b2a506 fix: seed native Parquet scan reader options from session config (#5107) by Matt Butrovich · 3 weeks ago
  90. 3c830f4 feat: expose Comet version as spark.comet.version runtime config (#5049) by Andy Grove · 3 weeks ago
  91. 4c3f048 feat: disable native columnar-to-row conversion by default (#5114) by Andy Grove · 3 weeks ago
  92. 4b091ac feat: support SampleExec natively for sampling without replacement (#5110) by Andy Grove · 3 weeks ago
  93. 38c3f8b fix: throw ARITHMETIC_OVERFLOW for Long.MinValue div -1 under ANSI mode (#5084) by Andy Grove · 3 weeks ago
  94. 61b61de chore: stop enabling incompatible casts in plan stability suite (#5139) by Andy Grove · 3 weeks ago
  95. cde6052 fix: work around DataFusion 54.1.0 Parquet page-index regression (#5132) by Matt Butrovich · 3 weeks ago
  96. a1b022b fix: honor fail_on_error in native make_decimal (#5080) by Andy Grove · 3 weeks ago
  97. 76b9d2e feat: add codegen dispatch fallback for CometCast incompatible/unsupported cases (including legacy config paths) (#5079) by Oleks V · 3 weeks ago
  98. 038fd6e fix: honour Spark's legacy `null IN ()` behavior (#5127) by Andy Grove · 3 weeks ago
  99. e344f74 docs: update post 1.0.0 roadmap (#5064) by Matt Butrovich · 3 weeks ago
  100. ce84a24 docs: document known correctness issues in the compatibility guide (#5085) by Andy Grove · 3 weeks ago