Google Git
Sign in
apache/datafusion-comet/HEAD
  1. ce84a24 docs: document known correctness issues in the compatibility guide (#5085) by Andy Grove · 14 hours ago main
  2. 1db954d fix: resolve Comet jar without hardcoding the SNAPSHOT qualifier (#5108) by Andy Grove · 15 hours ago
  3. cf81ab3 test: add isolated and small-batch benchmarks for columnar-to-row conversion (#5113) by Andy Grove · 15 hours ago
  4. 880cecf docs: expand tuning guide with performance and memory configs (#4908) by Andy Grove · 20 hours ago
  5. aebe70b docs: define post-1.0 versioning policy and legacy config process (#5056) by Andy Grove · 21 hours ago
  6. 5fd68c2 docs: fix references to configuration keys that do not exist (#5063) by Andy Grove · 21 hours ago
  7. f4ae9e0 refactor: unify shuffle configs under `spark.comet.shuffle.*` prefix (#4986) by Andy Grove · 22 hours ago
  8. 9e9e3b8 fix: make native pow implementation compatible with Spark (#5033) by Andy Grove · 23 hours ago
  9. 6bfd545 fix: materialize ConstantColumnVector on Comet's serialize/export paths (#4532) by Scott Schenkein · 23 hours ago
  10. c27eed3 docs: refresh stale issue references and normalize issue link format (#5062) by Andy Grove · 25 hours ago
  11. 2c05a15 refactor: group orphan `spark.comet.explain.*` configs under one prefix (#5026) by Andy Grove · 25 hours ago
  12. 1d3044f feat: support interval codegen dispatch for nested values and native shuffle (#4976) by Peter Lee · 2 days ago
  13. 82180b8 docs: avoid "not a blocker" comments in reviews for review skill (#5057) by Matt Butrovich · 2 days ago
  14. 41cb698 docs: add blog posts and talks page (#5043) by Andy Grove · 2 days ago
  15. 8a9473c feat: native randstr implementation compatible with Spark (#5035) by Andy Grove · 3 days ago
  16. 69df0f1 feat: add CalendarIntervalType support (#4898) by Peter Lee · 4 days ago
  17. c765774 fix: raise CAST_INVALID_INPUT for invalid calendar dates in ANSI cast to date (#5014) by Andy Grove · 4 days ago
  18. 376676c docs: show implementation kind for each expression (#5028) by Andy Grove · 5 days ago
  19. 2e907e5 feat: native collect_list / array_agg aggregate (#4720) by Andy Grove · 5 days ago
  20. 756ddd7 feat: Support Spark levenshtein expression in native execution (#4105) by Myx778 · 5 days ago
  21. 8324fe9 fix: apply 1.11 Iceberg diff changes from #4991 to other versions (#5020) by Matt Butrovich · 5 days ago
  22. 8c50487 chore(deps): bump actions/checkout from 6 to 7 (#4881) by dependabot[bot] · 5 days ago
  23. 02054c4 chore(deps): bump actions/cache from 5 to 6 (#4882) by dependabot[bot] · 5 days ago
  24. a27d430 chore(deps): bump the codeql-actions group with 2 updates (#5016) by dependabot[bot] · 5 days ago
  25. 3755def chore(deps): bump actions/setup-python from 6 to 7 (#5017) by dependabot[bot] · 5 days ago
  26. f86cc96 chore(deps): bump base64 from 0.22.1 to 0.23.0 in /native (#5018) by dependabot[bot] · 5 days ago
  27. 0986e4a chore(deps): bump actions/stale from 10.3.0 to 10.4.0 (#4879) by dependabot[bot] · 5 days ago
  28. 68489a7 perf: encode shuffle IPC schema once per writer instead of per block (#5006) by Andy Grove · 5 days ago
  29. 7123be7 feat: support multiply_dt_interval with codegen dispatch (#4900) by Peter Lee · 5 days ago
  30. b75c570 perf: bypass shuffle BatchCoalescer for already-sized batches (#5003) by Andy Grove · 6 days ago
  31. 406e182 perf: optimize `spark_ceil` (3x faster) (#4926) by Andy Grove · 6 days ago
  32. bc53ad5 feat: Iceberg table format V3: native table decryption, fall back for other V3 features (#4991) by Matt Butrovich · 6 days ago
  33. 0761e54 perf: dedupe Iceberg residuals and delete files in native scan serde (#4982) by Matt Butrovich · 6 days ago
  34. f06aa31 feat: support approx_count_distinct aggregate expression (#4819) by Andy Grove · 6 days ago
  35. d075ab3 docs: document Spark version adoption and support-lifetime policy (#4977) by Andy Grove · 6 days ago
  36. 6934ef8 perf: optimize `spark_cast_float64_to_utf8` (~40% faster) (#4918) by Andy Grove · 6 days ago
  37. 56405e0 perf: optimize `date_trunc` (>2x faster) (#4915) by Andy Grove · 6 days ago
  38. 52140f3 perf: optimize cast_decimal128_to_utf8 in datafusion-comet-spark-expr (#4924) by Andy Grove · 7 days ago
  39. c7f9a1f perf: optimize `date_parser` / cast string to date (up to 2x faster) (#4917) by Andy Grove · 7 days ago
  40. e2f5df6 chor: remove legacy use.lazyMaterialization (#4998) by KAZUYUKI TANIMURA · 7 days ago
  41. 7979527 chore: use DF `array_repeat` and `array_compact` (#4741) by Oleks V · 7 days ago
  42. 81c2a84 perf: optimize `parse_string_to_decimal` (30-40% faster) (#4916) by Andy Grove · 7 days ago
  43. 7b00c40 perf: optimize `cast_binary_to_string` binary-format styles (up to 27x faster) (#4912) by Andy Grove · 7 days ago
  44. 5ef4bd7 fix: widen local table scan child nullability to match native kernels (#4843) by Andy Grove · 7 days ago
  45. 1981091 feat: add spark.comet.shuffle.maxBufferBytes to cap native shuffle writer memory (#4989) by Andy Grove · 7 days ago
  46. e3363e2 deps: bump to datafusion 54.1.0 and latest iceberg-rust (#4996) by Matt Butrovich · 8 days ago
  47. 32e2d7c refactor: remove untested async columnar shuffle (#4985) by Andy Grove · 8 days ago
  48. 957886d feat: add withAlternative alias mechanism for CometConf (#4979) by Andy Grove · 9 days ago
  49. b016555 chore: remove dead Parquet parallel-IO configs (#4981) by Andy Grove · 9 days ago
  50. f46719b test: promote `try_to_date`/`try_to_timestamp` SQL tests to native coverage (#4973) by kid · 9 days ago
  51. 9483db4 perf: vectorize `spark_unscaled_value` (9x faster) (#4972) by kid · 9 days ago
  52. 415421b chore(deps): bump the codeql-actions group with 2 updates (#4970) by dependabot[bot] · 11 days ago
  53. 92f0f33 feat: fall back to Spark for collated predicate operands (#4948) by Oleks V · 12 days ago
  54. cb71d70 chore: codeql dependabot fix (#4962) by Oleks V · 12 days ago
  55. f480db1 docs: add 0.17.1 changelog (#4961) by Matt Butrovich · 12 days ago
  56. c151a57 chore(deps): bump lz4_flex from 0.13.1 to 0.14.0 in /native (#4958) by dependabot[bot] · 12 days ago
  57. c998e6f chore(deps): bump the all-other-cargo-deps group across 1 directory with 6 updates (#4956) by dependabot[bot] · 12 days ago
  58. 884e0a6 chore: bump spark-4.2 profile to the released 4.2.0 (#4960) by Andy Grove · 12 days ago
  59. bc84171 chore(deps): bump actions/setup-node from 6 to 7 (#4955) by dependabot[bot] · 12 days ago
  60. a469fc6 Report unsupported scalar serde cases in support level (#4745) by Peter Lee · 12 days ago
  61. bf18cec feat: Implement TimeType support - Infrastructure - shuffle (#4398) by Bolin Lin · 12 days ago
  62. 83339d8 feat: hint at native pyarrow UDF path when the feature is disabled (#4892) by Andy Grove · 12 days ago
  63. e36a410 feat: support size() for MapType input (#4580) by Zaki · 12 days ago
  64. c65a5ee feat: support gzip compression in native Parquet writes (#4930) by Andy Grove · 12 days ago
  65. df01cdd perf: optimize spark_regexp_extract in datafusion-comet-spark-expr (#4894) by Andy Grove · 13 days ago
  66. eb24be1 perf: optimize `spark_get_json_object` (4x faster) (#4907) by Andy Grove · 13 days ago
  67. 59c453b perf: vectorize floating-point-to-decimal cast (#4940) by Andy Grove · 13 days ago
  68. e743a47 perf: skip the null-masking pass in `DecimalRescaleCheckOverflow` when nothing overflows (#4938) by Andy Grove · 13 days ago
  69. 2e49b61 perf: optimize `CheckOverflow` with a shared no-overflow fast path (ANSI and non-ANSI) (#4937) by Andy Grove · 13 days ago
  70. 2fd3960 chore: Support native writer `Overwrite` and `ErrorIfExists` modes (#4946) by Oleks V · 14 days ago
  71. 4c6f5d4 perf: optimize spark_lpad in datafusion-comet-spark-expr (#4919) by Andy Grove · 14 days ago
  72. 88039f1 chore: use Datafusion `substring` (#4161) by Oleks V · 14 days ago
  73. 8523039 doc: Document scan tuning for `spark.sql.files.maxPartitionBytes` (#4931) by Oleks V · 14 days ago
  74. 7e6cc08 test: add version check on an Iceberg test for Variant type (#4935) by Matt Butrovich · 14 days ago
  75. faf9445 fix: decode CAST(binary AS string) JVM-compatibly instead of unsafe reinterpret (#4763) by Andy Grove · 14 days ago
  76. 5008edd perf: optimize spark_arrays_overlap in datafusion-comet-spark-expr (#4906) by Andy Grove · 14 days ago
  77. 02170ec docs: add scalar expression optimization guide, skill, and performance audits (#4933) by Andy Grove · 14 days ago
  78. 078fed3 perf: optimize try_arithmetic_kernel in datafusion-comet-spark-expr (#4910) by Andy Grove · 14 days ago
  79. 275d2ae fix: suppress spurious "WriteFilesExec is not supported" fallback (#4928) by Andy Grove · 2 weeks ago
  80. 0af2977 perf: optimize spark_cast_int_to_int in datafusion-comet-spark-expr (#4920) by Andy Grove · 2 weeks ago
  81. 32caa13 chore: Codegen fallback explain for plan (#4891) by Oleks V · 2 weeks ago
  82. dd30f41 perf: optimize escape_string in datafusion-comet-spark-expr (#4902) by Andy Grove · 2 weeks ago
  83. a0f3acf test: cover invalid unhex inputs in SQL file tests (#4890) by Andy Grove · 2 weeks ago
  84. 8e7cee8 fix: restrict array_filter array_compact fast path to the lambda variable (#4848) by Andy Grove · 2 weeks ago
  85. 691e2ae chore: remove `hdfs` Comet crate (#4904) by Oleks V · 2 weeks ago
  86. b9cbb68 perf: optimize parse_url in datafusion-comet-spark-expr (#4893) by Andy Grove · 3 weeks ago
  87. 824fc42 perf: optimize spark_unhex in spark-expr (#4876) by Andy Grove · 3 weeks ago
  88. b7ad0ba feat: core SPI for contrib leaf scans (CometScanWithPlanData) [Delta contrib split, part 1] (#4700) by Scott Schenkein · 3 weeks ago
  89. edb7b65 perf: optimize spark_size in spark-expr (#4877) by Andy Grove · 3 weeks ago
  90. 1142c3a chore: fallback for `spark.sql.mapKeyDedupPolicy` == `LAST_WIN` (#4863) by Oleks V · 3 weeks ago
  91. 20279ba feat: remove constraint on array of nested elements (#4714) by hsiang-c · 3 weeks ago
  92. ff41f96 refactor(shuffle): Introduce PartitionWriter interface to decouple shuffle partitioning from storage (#4779) by Zhen Wang · 3 weeks ago
  93. eb5b761 feat: support approx_percentile / percentile_approx aggregate (#4801) by Andy Grove · 3 weeks ago
  94. d4fbc16 docs: update Gluten comparison with AWS Labs benchmark and Comet strengths (#4873) by Andy Grove · 3 weeks ago
  95. 1ba76df feat: support Iceberg 1.11, audit existing Iceberg diffs, bump iceberg-rust dep, add run-iceberg-tests CI trigger (#4840) by Matt Butrovich · 3 weeks ago
  96. b6571d9 fix: match Spark percentile interpolation precision (#4792) by Manu Zhang · 3 weeks ago
  97. 6ca6529 feat: Add experimental support for accelerated PyArrow UDFs (#4234) by Andy Grove · 3 weeks ago
  98. 6456f33 feat: enable mixed partial/final execution for sum and non-decimal avg (#4861) by Andy Grove · 3 weeks ago
  99. 301e459 fix: register partitioning scalar subqueries for native shuffle to avoid "Subquery N not found" (#4869) by Matt Butrovich · 3 weeks ago
  100. 3f1aa1c fix: emit JDK libjvm search path from core build script (#4868) by Andy Grove · 3 weeks ago