Google Git Google Git
Sign in
apache/datafusion-spark/HEAD
  1. 664a7be ci: add cargo fmt and clippy workflow (#53) by Andy Grove · 10 hours ago main
  2. 9a219ee test: run sqllogictest files in CI (#51) by Andy Grove · 10 hours ago
  3. b947917 ci: add Apache RAT license header check (#50) by Andy Grove · 11 hours ago
  4. 4061d37 docs: add audit-datafusion-spark-expression agent skill and AGENTS.md (#52) by Andy Grove · 11 hours ago
  5. 420c280 docs: add README, LICENSE.txt and NOTICE.txt (#49) by Andy Grove · 11 hours ago
  6. a71e37a chore: add top-level workspace Cargo.toml (#45) by Andy Grove · 15 hours ago
  7. ea1e784 chore: add `.asf.yaml` with repository settings by Andy Grove · 17 hours ago
  8. ef4c88a perf: stop dictionary work growing with the group count (#26703) by Jay Zhan · 5 days ago
  9. d5000e4 chore: Complete the short Apache header migration (#27049) by Yongting You · 9 days ago
  10. db6f43d fix(spark): floor instead of truncate in unix_millis/unix_seconds for pre-epoch timestamp (#26129) by lazzypanda7 · 13 days ago
  11. 99eee7c fix(spark): accept STRING and TIMESTAMP start dates in next_day (#26127) by lazzypanda7 · 14 days ago
  12. efd0fc1 chore: Use short Apache license header (#26761) by Yongting You · 2 weeks ago
  13. 829bd8a feat: improve Spark from_utc_timestamp compatibility (#25979) by nat-openai · 2 weeks ago
  14. e9b08eb fix: date_part sub-second parts and result nullability, reusing arrow kernels (#26686) by Matt Butrovich · 3 weeks ago
  15. 0c32e99 refactor(spark): deduplicate bucket computation in width_bucket_interval_mdn_exact (#26489) by Shahzeb Ali · 3 weeks ago
  16. 454a488 test: run microbenchmarks in extended CI (#25836) by aetos · 3 weeks ago
  17. d8fdd56 feat: support Spark-compatible `stack` function (#26266) by Oleks V · 3 weeks ago
  18. c5733fe chore: Use `value_field` to fetch list element field (#26567) by Neil Conway · 3 weeks ago
  19. 4b09f5a fix: report OneOf signature mismatches as planning errors (#26329) by Singleton · 4 weeks ago
  20. 54d9338 perf: pre-size collections and reuse per-iteration buffers (#26192) by Oleks V · 4 weeks ago
  21. 641db3f fix(spark): derive concat_ws nullability from separator (#26205) by Vova Kot · 5 weeks ago
  22. 887a321 fix: keep the running hash for nested dictionaries in Spark xxhash64 (#25813) by Varun · 5 weeks ago
  23. 0c1e720 fix(spark): return NULL from `char` for a NULL scalar argument (#26126) by ranflarion · 5 weeks ago
  24. f952497 fix: handle null lists with empty children in Spark's `shuffle` (#25544) by Neil Conway · 6 weeks ago
  25. 5cdf57d fix: Validate `execution.time_zone` at `SET` time (#25788) by Kassahun Sanayew · 6 weeks ago
  26. 9f98a0a fix: xxhash64 of a NULL struct ignores the struct fields (#25774) by mrhard9090 · 6 weeks ago
  27. 4ff76e3 Fix panic from `avg(x ORDER BY y)` (and more) (#25711) by Mason · 7 weeks ago
  28. 7411b61 feat(spark): add equal_null (#24827) by Advit Arora · 7 weeks ago
  29. f1dbbd7 perf: Size builder capacity using visible array span, not total size (#25502) by Neil Conway · 8 weeks ago
  30. 36df651 fix: reject LargeList offsets that exceed i32 (#25516) by Liang-Chi Hsieh · 8 weeks ago
  31. 110d168 chore: Add helpers for computing `OffsetBuffer` span, length (#25481) by Neil Conway · 8 weeks ago
  32. c93275c fix: Spark `map_from_arrays`, `map_from_entries` for sliced lists (#25431) by Neil Conway · 8 weeks ago
  33. fb5dd79 Fix `Numeric` signature coercion to properly handle null types (#24988) by Jeffrey Vo · 9 weeks ago
  34. 1c832e0 chore: check license headers in SQL logic tests (#25182) by Xuanwo · 9 weeks ago
  35. 12888a7 feat: Add Spark-compatible `encode` function to datafusion-spark (#21331) by Zeel Rajodiya · 10 weeks ago
  36. 4f3c26f fix(spark): derive pmod's decimal result type from the declared arguments (#24409) by Amit Vijapur · 10 weeks ago
  37. dd615d8 fix(spark): accept every integer width in `factorial`, matching Spark's implicit cast (#24943) by Shayan Gh · 10 weeks ago
  38. bf5f654 fix: keep decimal precision for SLT tests (#24934) by theirix · 10 weeks ago
  39. c0909aa perf: remove per-row String allocation from Spark soundex and quote (#23880) by Andy Grove · 10 weeks ago
  40. c5e0864 Unify temporal field parsing with DatePart (#24906) by Kosta Tarasov · 10 weeks ago
  41. 3500399 fix: find_in_set internal error with two LargeUtf8 scalar arguments (#24802) by Advit Arora · 10 weeks ago
  42. e44933b Enable more clippy lints (#24566) by Emil Ernerfeldt · 2 months ago
  43. 120a846 Enable more clippy lints (#24466) by Emil Ernerfeldt · 3 months ago
  44. d61e54d fix: tree-style explain for memory table shows wrong row count (#24511) by Yongting You · 3 months ago
  45. 3ccc755 refactor: Unify Spark format_string integer numeric assembly (#24480) by Goutam Adwant · 3 months ago
  46. 150c013 feat(spark): add `to_binary` and `try_to_binary` (#24266) by arsathS · 3 months ago
  47. fed2103 doc: add implementation guidelines for `datafusion-spark` (#24140) by Jeffrey Vo · 3 months ago
  48. 6842daf fix(spark): match Spark abs overflow errors (#24156) by Goutam Adwant · 3 months ago
  49. f6cb81b Enable more clippy lints (#24322) by Emil Ernerfeldt · 3 months ago
  50. 3d2805e fix(spark): correct mod ANSI zero divisor and negative zero handling (#23987) by kid · 3 months ago
  51. 1df8b4e Perf: remove extra allocations for hex operations (#24057) by RIchard Baah · 3 months ago
  52. d4e9785 feat(cli): add opt-in Spark function registration (#24179) by Goutam Adwant · 3 months ago
  53. b7966cf fix: correct list field inner type in array functions (#24345) by Tim Saucer · 3 months ago
  54. 940f8d9 Reduce datafusion-spark dependency footprint (#24351) by dentiny · 3 months ago
  55. aa2732f perf: remove per-row String allocations from the Spark url functions (#23884) by Andy Grove · 3 months ago
  56. e2b7830 refactor: Refactor numeric sign and padding in Spark format_string (#24115) by Justin O'Dwyer · 3 months ago
  57. 2dc2fc7 fix: prevent next_day panic on far-future start dates (#24194) by Liang-Chi Hsieh · 3 months ago
  58. aea763a feat: add Spark-compatible atan2 function (#23962) by Karpagam Balasubramaniam · 3 months ago
  59. 0e490c2 refactor: move arrow integer hex dispatch to datafusion-common (#23917) by Burak Şen · 3 months ago
  60. 4df467d Optimize Spark hex null handling (#23688) by Floze · 3 months ago
  61. f104c83 feat: support `ansi` for `elt` (#23928) by Oleks V · 4 months ago
  62. f927994 fix: support parentheses for negative decimal formatting (#23718) by zhigang · 4 months ago
  63. ca40c5d feat: add Spark-compatible hypot function (#23774) by Karpagam Balasubramaniam · 4 months ago
  64. 7f027c4 perf: avoid per-row String allocation in Spark bin and char (#23881) by Andy Grove · 4 months ago
  65. 53454d9 refactor: share hex encoding across datafusion-common, functions, and spark (#23766) by Andy Grove · 4 months ago
  66. 62880f4 Remove `GroupsAccumulator::supports_convert_to_state` and require `convert_to_state` (#23489) by linfeng · 4 months ago
  67. b17ef83 perf: avoid per-row copy in Spark hex byte encoding (#23473) by Andy Grove · 4 months ago
  68. 1d845ac Handle nulls in type coercion of higher-order UDFs, map_extract, spark array_repeat (#23071) by gstvg · 4 months ago
  69. 6cf2246 fix: align dictionary coercion across typed signatures (#23549) by linfeng · 4 months ago
  70. 62bc120 minor: validate config `meta_fetch_concurrency` when setting it (#23595) by Yongting You · 4 months ago
  71. 3c19a28 perf: avoid intermediate slice allocation in Spark slice function (#23481) by Andy Grove · 4 months ago
  72. 79a62b8 chore: Update to arrow/parquet 59.1.0 (#23312) by Andrew Lamb · 4 months ago
  73. 713865e spark: support `collect_list` `collect_set` for `windows` execution (#23281) by Oleks V · 4 months ago
  74. e3f8d07 fix: Handle decimal columns consistently in SLT tests (#23161) by Adam Gutglick · 4 months ago
  75. 7bc93e4 fix: Preserve integer values in round() for large Int64 and UInt64 inputs (#22697) by pchintar · 5 months ago
  76. b2bdb63 fix(spark): return error from ELT coerce_types when fewer than 2 args (#23164) by David López · 5 months ago
  77. 0bded7c feat: support mixed binary and string types for concat UDFs (#22244) by theirix · 5 months ago
  78. eaf2a7f bugfix: changed return type of spark's width_bucket to i64 (#22811) by Eduardo Aguilar · 5 months ago
  79. f0ed502 refactor: remove `opt_filter` in `GroupsAccumulator::merge_batch` (#22816) by Huaijin · 5 months ago
  80. b1665a4 fix: preserve Spark next_day whitespace validation (#22720) by Ahmed EL. · 5 months ago
  81. d682c3c feat(spark): add `concat_ws` with array support (#20928) by David López · 5 months ago
  82. 452281c chore: Update to arrow/parquet 59.0.0 (#22744) by Andrew Lamb · 5 months ago
  83. 050a4d2 feat: implement Spark-compatible weekday function (#22740) by 7. Sun · 5 months ago
  84. 65b9f2b Spark quote function implementation (#22642) by Kazantsev Maksim · 5 months ago
  85. 1499c2e feat: Add Spark SQL parser dialect config (#22529) by Kumar Ujjawal · 5 months ago
  86. 299d197 Refactor Spark `format_string` integer conversion dispatch (#22388) by kosiew · 5 months ago
  87. c772f59 added support for MapFromEntries (#21720) by Krishna Sudarshan J · 5 months ago
  88. 6f500fa fix: wrong precision in a decimal256 log test (#22578) by theirix · 5 months ago
  89. 32bf631 feat: add SparkPow UDF returning Infinity for pow(0, negative) (#22605) by Brijesh Thakkar · 6 months ago
  90. 4786b62 refactor: wrap HigherOrderUDFImpl in a concrete HigherOrderUDF struct (#22593) by Lía Adriana · 6 months ago
  91. 9450a18 feat: Add Spark-compatible `monthname` function to datafusion-spark (#21639) by Zeel Rajodiya · 6 months ago
  92. b900bcf chore: Disallow `reserve()` in clippy to prevent panics (#22386) by Yongting You · 6 months ago
  93. e1b58c2 feat: fix `slice` function on OOB ranges (#22404) by Oleks V · 6 months ago
  94. dfea3c0 Refactor Spark `format_string` numeric `%c` conversion dispatch (#22166) by kosiew · 6 months ago
  95. d1d6565 feat: add Spark-compatible xxhash64 function (#21967) by Andy Grove · 6 months ago
  96. df30b3c chore: Update Rust toolchain to 1.95 (#22177) by Daniël Heres · 6 months ago
  97. d148e3f fix `date_part('isodow')` (#22116) by Konstantin Tarasov · 6 months ago
  98. f3887fd fix: Panic in Spark's `format_string` for illegal characters (#22077) by Neil Conway · 6 months ago
  99. 122c6aa perf: Use `NullBuffer::union_many` (#22070) by Neil Conway · 6 months ago
  100. aab37a4 feat: support spark compatible floor function (#21933) by Krishna Sudarshan J · 6 months ago