Google Git Google Git
Sign in
apache/datafusion-ballista/HEAD
  1. 333e263 docs: refresh the README and generate benchmark results from JSON (#2814) by Andy Grove · 16 hours ago main
  2. 6f9ea31 fix: plan a range RepartitionExec as a shuffle stage instead of dropping it (#2722) by Andy Grove · 21 hours ago
  3. 8ccb863 chore(ci): bump taiki-e/install-action from 2.90.2 to 2.90.3 (#2846) by dependabot[bot] · 21 hours ago
  4. d987208 docs: present Ballista as one engine for ETL and interactive queries (#2834) by Andy Grove · 2 days ago
  5. 6ecc5c3 feat: let custom ExecutionPlan nodes restrict themselves to a task's partitions (#2721) by Andy Grove · 2 days ago
  6. a48c232 fix: raise the executor's open file limit to the hard limit at startup (#2794) by Andy Grove · 2 days ago
  7. 9f770a9 fix(dev): let the Docker build scripts run when CI is unset (#2835) by NoahKusaba · 2 days ago
  8. b0f4e94 chore(scheduler): remove the no-op disable-stage-plan-cache feature (#2836) by NoahKusaba · 2 days ago
  9. 4aa5367 feat: hide ballista session contexts implementations behind common interface (#2832) by Marko Milenković · 2 days ago
  10. 9ed1cae fix: keep volatile semi joins in place and test results with the rule on and off (#2793) by Andy Grove · 2 days ago
  11. 1b348f7 chore(deps): bump uuid from 1.29.0 to 1.29.1 (#2830) by dependabot[bot] · 2 days ago
  12. 3ba366d fix: let executor spills use the work dir's free space by default (#2797) by Andy Grove · 2 days ago
  13. 09a52ad fix(scheduler): don't drop a task's status when its metrics can't be merged (#2828) by Bodor Laszlo · 2 days ago
  14. 5bd230e perf: share each broadcast read between the tasks on an executor (#2807) by Andy Grove · 2 days ago
  15. 153c5f9 perf: semi-join small filtered dimensions below the joins in between (#2799) by Andy Grove · 2 days ago
  16. 714e23c chore(deps): bump uuid from 1.29.0 to 1.29.1 in /python (#2831) by dependabot[bot] · 2 days ago
  17. 7b6d7d3 test: share fixtures in the executor, history, result-service, flight-sql, cli and chaos tests (#2821) by Ville Brofeldt · 3 days ago
  18. 13d8742 fix(python): use a non-default codec in the shuffle compression setter test (#2829) by Andy Grove · 3 days ago
  19. f0da3a2 perf: deduplicate executor metadata in partition locations (#2813) by Andy Grove · 3 days ago
  20. 1c675a2 fix(client): report an unreadable first block of a shuffle fetch as a fetch failure (#2812) by Andy Grove · 3 days ago
  21. 10fd932 fix(ci): quote the labeler trigger's echo so YAML keeps the whole command (#2822) by Andy Grove · 3 days ago
  22. 2580b60 chore(ci): bump the github-codeql group with 2 updates (#2823) by dependabot[bot] · 3 days ago
  23. 7fbf57d chore(ci): bump taiki-e/install-action from 2.90.0 to 2.90.2 (#2824) by dependabot[bot] · 3 days ago
  24. 781b4e5 chore(deps): bump blake3 from 1.8.5 to 1.8.7 (#2825) by dependabot[bot] · 3 days ago
  25. 04455a1 test(scheduler): share plan, graph and server fixtures in the scheduler tests (#2819) by Ville Brofeldt · 4 days ago
  26. 5ea3781 Bound the executor pool's shared connections (#2779) by goingforstudying-ctrl · 4 days ago
  27. 23c3372 ci: label pull requests from workflow_run instead of pull_request_target (#2778) by Mason Kong · 4 days ago
  28. fd8b371 perf: default the shuffle compression codec to zstd (#2805) by Andy Grove · 4 days ago
  29. fd94ccf fix(scheduler): fail to start when event_log_dir is not writable (#2787) by Samuel James · 4 days ago
  30. e4a9966 fix(scheduler): free intermediate shuffle files when an adaptive job succeeds (#2753) by ZIHAN DAI · 4 days ago
  31. d49c848 fix(executor): bound each scheduler connect attempt by the deadline (#2715) by Samuel James · 4 days ago
  32. 070ae91 docs: add AGENTS.md and a pr-review agent skill (#2789) by Andy Grove · 4 days ago
  33. d94a279 docs: refresh the README and the architecture diagram (#2815) by Andy Grove · 4 days ago
  34. 76584d0 fix: keep aggregates above undecided joins partial and final (#2806) by Andy Grove · 4 days ago
  35. 616ce8c test(core): share execution plan test fixtures (#2800) by Ville Brofeldt · 4 days ago
  36. 781f4ee fix: reschedule tasks that do not fit in a poll response (#2795) by Andy Grove · 4 days ago
  37. bf90879 perf: disable Nagle's algorithm on scheduler connections (#2798) by Andy Grove · 5 days ago
  38. 810724f fix: count buffers shared by sliced batches once in shuffle buffering (#2796) by Andy Grove · 5 days ago
  39. 2ad5f37 test(client): share integration test fixtures in tests/common (#2791) by Ville Brofeldt · 5 days ago
  40. 2597c57 fix(test): keep the join sides of the coalesce passthrough test as separate stages (#2790) by Ville Brofeldt · 6 days ago
  41. 9fedc4d feat: run a repeated subplan's stage once under AQE (#2765) by Andy Grove · 6 days ago
  42. e97e2d8 update installation section (#2788) by Marko Milenković · 6 days ago
  43. 29a01ac chore(ci): bump taiki-e/install-action from 2.89.1 to 2.90.0 (#2786) by dependabot[bot] · 6 days ago
  44. 1afb351 chore(ci): bump the github-codeql group with 2 updates (#2785) by dependabot[bot] · 6 days ago
  45. b497530 feat(python): Add Python gRPC client with `BallistaPythonSessionContext` (#2754) by Marko Milenković · 7 days ago
  46. d56a2ad feat(aqe): coalesce shuffle partitions down to a single partition (#2782) by Andy Grove · 7 days ago
  47. 5e13d82 feat(python): python project cleanup and s3 support for python cluster (#2748) by Marko Milenković · 7 days ago
  48. 74c0924 chore(ci): bump taiki-e/install-action from 2.89.0 to 2.89.1 (#2777) by dependabot[bot] · 7 days ago
  49. 24003e1 make it possible to disable propagate empty (#2776) by Marko Milenković · 7 days ago
  50. 1aad53c chore(ci): bump taiki-e/install-action from 2.88.1 to 2.89.0 (#2772) by dependabot[bot] · 8 days ago
  51. d7ef7b8 chore(deps): bump tonic-prost from 0.14.7 to 0.14.9 in /python (#2771) by dependabot[bot] · 8 days ago
  52. cf4358e chore(deps): bump pyo3-log from 0.13.4 to 0.13.5 in /python (#2770) by dependabot[bot] · 8 days ago
  53. 963fa08 remove unused sys making ruff to fail (#2769) by Marko Milenković · 9 days ago
  54. 70a0743 docs: post benchmarking results produced with the cluster scripts (#2763) by Andy Grove · 9 days ago
  55. 4ccca3b feat(bench): add DataFusion Distributed to the cluster comparison scripts (#2762) by Andy Grove · 9 days ago
  56. 96b5ba9 feat: run submitted physical plans through the adaptive planner (#2682) by Andy Grove · 9 days ago
  57. d151e32 chore(deps): bump tonic-prost from 0.14.6 to 0.14.9 in /python (#2738) by dependabot[bot] · 9 days ago
  58. 0b5f599 chore(deps): bump tonic-prost from 0.14.7 to 0.14.9 (#2733) by dependabot[bot] · 9 days ago
  59. 6a1e7e2 chore(deps): bump tonic from 0.14.7 to 0.14.9 in /python (#2739) by dependabot[bot] · 9 days ago
  60. 849690a fix(chaos): never hand two processes of one cluster the same port (#2740) by ump45nose · 9 days ago
  61. a976c4c feat: add ComposedLogicalExtensionCodec (#2752) by NoahKusaba · 9 days ago
  62. 91697ca chore(deps): bump log from 0.4.34 to 0.4.35 in /python (#2750) by dependabot[bot] · 9 days ago
  63. c7a5267 chore(deps): bump log from 0.4.34 to 0.4.35 (#2751) by dependabot[bot] · 9 days ago
  64. c52958d feat: collect HyperLogLog distinct counts on shuffle writes for AQE (#2671) by Andy Grove · 10 days ago
  65. 964809d fix(executor): cached session runtime ignores SET s3.* changes (#2562) by goingforstudying-ctrl · 10 days ago
  66. a747f63 chore(deps): bump tonic-prost-build from 0.14.7 to 0.14.9 in /python (#2737) by dependabot[bot] · 10 days ago
  67. ee6fde8 chore(ci): bump taiki-e/install-action from 2.87.32 to 2.88.1 (#2735) by dependabot[bot] · 10 days ago
  68. feb495e chore(ci): bump astral-sh/setup-uv from 10.3.2 to 10.3.3 (#2736) by dependabot[bot] · 10 days ago
  69. c720591 fix: enable tracing with the scheduler's rest-api feature (#2747) by Andy Grove · 10 days ago
  70. 60def1d chore(deps): bump tonic-prost-build from 0.14.7 to 0.14.9 (#2734) by dependabot[bot] · 10 days ago
  71. b52f5e1 add execution modes to readme (#2744) by Marko Milenković · 10 days ago
  72. 9665258 feat(python): Improve ballista session context configuration (#2637) by Marko Milenković · 10 days ago
  73. dc6af5f docs: add a user guide page for pipelined execution (#2713) by Andy Grove · 10 days ago
  74. 19a62ad feat: let a scheduler embedder add rules to adaptive query planning (#2743) by Andy Grove · 10 days ago
  75. 26699ca refactor: rename blocking execution mode to staged (#2741) by Andy Grove · 10 days ago
  76. 6e77991 chore: regenerate ballista.rs after tonic-prost-build 0.14.7 bump (#2732) by Andy Grove · 11 days ago
  77. f325830 docs: add versioning policy for minor releases from release branches (#2724) by Andy Grove · 11 days ago
  78. 5b621d1 docs: add blocking and pipelined results to the benchmarking page (#2676) by Andy Grove · 11 days ago
  79. 0ef7399 feat: Add experimental pipelined execution mode (all tasks placed up front, streaming exchange) (#2657) by Andy Grove · 12 days ago
  80. 760bab3 feat(aqe): split skewed partitioned joins (#2714) by Xuanyi Li · 12 days ago
  81. 3b1877d feat: add runtime filter operators and task reports (#2701) by Xuanyi Li · 12 days ago
  82. 10a56e1 fix: share Ballista client retry handling (#2608) by Isaac Emmanuel · 12 days ago
  83. 0b40747 chore(deps): bump tonic-prost-build from 0.14.6 to 0.14.7 in /python (#2709) by dependabot[bot] · 12 days ago
  84. bb0640f chore(deps): bump tonic from 0.14.6 to 0.14.7 (#2708) by dependabot[bot] · 12 days ago
  85. 74bae51 chore(deps): bump tonic from 0.14.6 to 0.14.7 in /python (#2707) by dependabot[bot] · 12 days ago
  86. 31c734d chore(deps): bump tonic-build from 0.14.6 to 0.14.7 in /python (#2706) by dependabot[bot] · 12 days ago
  87. 0fcadec chore(deps): bump tonic-prost from 0.14.6 to 0.14.7 (#2705) by dependabot[bot] · 12 days ago
  88. d2efb10 chore(deps): bump arrow-flight from 59.3.1 to 59.3.2 (#2704) by dependabot[bot] · 12 days ago
  89. 72d6807 chore(deps): bump arrow from 59.3.1 to 59.3.2 (#2703) by dependabot[bot] · 12 days ago
  90. 95ecadc chore(deps): bump tonic-prost-build from 0.14.6 to 0.14.7 (#2702) by dependabot[bot] · 12 days ago
  91. 2342897 refactor(scheduler): split QueryStageScheduler::on_receive into per-event handlers (#2643) by ump45nose · 12 days ago
  92. 52651f7 fix(scheduler): keep AQE stage in the graph when a stage transition fails (#2613) by DeviousCardi · 12 days ago
  93. 325eca9 fix(executor): honour scheduler_connect_timeout_seconds (#2607) by Samuel James · 12 days ago
  94. 41eb785 chore(deps): bump tonic-build from 0.14.6 to 0.14.7 (#2710) by dependabot[bot] · 13 days ago
  95. 10c5877 docs: compare Ballista with DataFusion Distributed (#2699) by Andy Grove · 13 days ago
  96. 1fe8e2f feat: let a standalone cluster run push-staged (#2669) by Andy Grove · 14 days ago
  97. efa54e6 ci: run the Docker image build nightly instead of on every PR (#2684) by Andy Grove · 14 days ago
  98. 1780e6d feat: stream pipelined job results to the client and Flight SQL (#2696) by Andy Grove · 14 days ago
  99. 2787284 feat(bench): scripts to run the Ballista, Spark, Comet and Trino comparison on Kubernetes (#2697) by Andy Grove · 14 days ago
  100. cc17e86 feat: serve pipelined partitions from the executor (#2695) by Andy Grove · 14 days ago