Changelog

0.8.0 (2023-02-17)

Full Changelog

Implemented enhancements:

Add bindings for datafusion_common::DFField #184
Add bindings for DFSchema/DFSchemaRef #181
Add bindings for datafusion_expr Projection #179
Add bindings for TableScan struct from datafusion_expr::TableScan #177
Add a “mapping” struct for types #172
Improve string representation of datafusion classes (dataframe, context, expression, ...) #158
Add DataFrame count method #151
[REQUEST] Github Actions Improvements #146
Change default branch name from master to main #144
Bump pyo3 to 0.18.0 #140
Add script for Python linting #134
Add Python bindings for substrait module #132
Expand unit tests for built-in functions #128
support creating arrow-datafusion-python conda environment #122
Build Python source distribution in GitHub workflow #81
EPIC: Add all functions to python binding functions #72

Fixed bugs:

Build is broken #161
Out of memory when sorting #157
window_lead test appears to be non-deterministic #135
Reading csv does not work #130
Github actions produce a lot of warnings #94
ASF source release tarball has wrong directory name #90
Python Release Build failing after upgrading to maturin 14.2 #87
Maturin build hangs on Linux ARM64 #84
Cannot install on Mac M1 from source tarball from testpypi #82
ImportPathMismatchError when running pytest locally #77

Closed issues:

Publish documentation for Python bindings #39
Add Python binding for approx_median #32
Release version 0.7.0 #7

Merged pull requests:

Add ability to execute ExecutionPlan and get a stream of RecordBatch #186 (andygrove)
Dffield bindings #185 (jdye64)
Add bindings for DFSchema #183 (jdye64)
test: Window functions #182 (simicd)
Add bindings for Projection #180 (jdye64)
Table scan bindings #178 (jdye64)
Make session configurable #176 (andygrove)
Upgrade to DataFusion 18.0.0 #175 (andygrove)
Use latest DataFusion rev in preparation for DF 18 release #174 (andygrove)
Arrow type bindings #173 (jdye64)
Pyo3 bump #171 (jdye64)
feature: Add additional aggregation functions #170 (simicd)
Make from_substrait_plan return DataFrame instead of LogicalPlan #164 (andygrove)
feature: Implement count method #163 (simicd)
CI Fixes #162 (jdye64)
Upgrade to DataFusion 17 #160 (andygrove)
feature: Improve string representation of datafusion classes #159 (simicd)
Make PyExecutionPlan.plan public #156 (andygrove)
Expose methods on logical and execution plans #155 (andygrove)
Fix clippy for new Rust version #154 (andygrove)
Add DataFrame methods for accessing plans #153 (andygrove)
Use DataFusion rev 5238e8c97f998b4d2cb9fab85fb182f325a1a7fb #150 (andygrove)
build(deps): bump async-trait from 0.1.61 to 0.1.62 #148 (dependabot[bot])
Rename default branch from master to main #147 (andygrove)
Substrait bindings #145 (jdye64)
build(deps): bump uuid from 0.8.2 to 1.2.2 #143 (dependabot[bot])
Prepare for 0.8.0 release #141 (andygrove)
Improve README and add more examples #137 (andygrove)
test: Expand tests for built-in functions #129 (simicd)
build(deps): bump object_store from 0.5.2 to 0.5.3 #126 (dependabot[bot])
build(deps): bump mimalloc from 0.1.32 to 0.1.34 #125 (dependabot[bot])
Introduce conda directory containing datafusion-dev.yaml conda enviro… #124 (jdye64)
build(deps): bump bzip2 from 0.4.3 to 0.4.4 #121 (dependabot[bot])
build(deps): bump tokio from 1.23.0 to 1.24.1 #119 (dependabot[bot])
build(deps): bump async-trait from 0.1.60 to 0.1.61 #118 (dependabot[bot])
Upgrade to DataFusion 16.0.0 #115 (andygrove)
Bump async-trait from 0.1.57 to 0.1.60 #114 (dependabot[bot])
Bump object_store from 0.5.1 to 0.5.2 #112 (dependabot[bot])
Bump tokio from 1.21.2 to 1.23.0 #109 (dependabot[bot])
Add entries for publishing production (asf-site) and staging docs #107 (martin-g)
Add a workflow that builds the docs and deploys them at staged or production #104 (martin-g)
Upgrade to DataFusion 15.0.0 #103 (andygrove)
build(deps): bump futures from 0.3.24 to 0.3.25 #102 (dependabot[bot])
build(deps): bump pyo3 from 0.17.2 to 0.17.3 #101 (dependabot[bot])
build(deps): bump mimalloc from 0.1.30 to 0.1.32 #98 (dependabot[bot])
build(deps): bump rand from 0.7.3 to 0.8.5 #97 (dependabot[bot])
Fix GitHub actions warnings #95 (martin-g)
Fixes #81 - Add CI workflow for source distribution #93 (martin-g)
post-release updates #91 (andygrove)
Build for manylinux 2014 #88 (martin-g)
update release readme tag #86 (Jimexist)
Upgrade Maturin to 0.14.2 #85 (martin-g)
Update release instructions #83 (andygrove)
[Functions] - Add python function binding to functions #73 (francis-du)

Unreleased

Full Changelog

Merged pull requests:

use __getitem__ for df column selection #41 (Jimexist)
fix demo in readme #40 (Jimexist)
Implement select_columns #39 (andygrove)
update readme and changelog #38 (Jimexist)
Add PyDataFrame.explain #36 (andygrove)
Release 0.5.0 #34 (Jimexist)
disable nightly in workflow #33 (Jimexist)
update requirements to 37 and 310, update readme #32 (Jimexist)
Add custom global allocator #30 (matthewmturner)
Remove pandas dependency #25 (matthewmturner)
upgrade datafusion and pyo3 #20 (Jimexist)
update maturin 0.12+ #17 (Jimexist)
Update README.md #16 (Jimexist)
apply cargo clippy --fix #15 (Jimexist)
update test workflow to include rust clippy and check #14 (Jimexist)
use maturin 0.12.6 #13 (Jimexist)
apply cargo fmt #12 (Jimexist)
use stable not nightly #11 (Jimexist)
ci: test against more compilers, setup clippy and fix clippy lints #9 (cpcloud)
Fix use of importlib.metadata and unify requirements.txt #8 (cpcloud)
Ship the Cargo.lock file in the source distribution #7 (cpcloud)
add __version__ attribute to datafusion object #3 (tfeda)
fix ci by fixing directories #2 (Jimexist)
setup workflow #1 (Jimexist)

0.5.1 (2022-03-15)

Full Changelog

0.5.1-rc1 (2022-03-15)

Full Changelog

0.5.0 (2022-03-10)

Full Changelog

0.5.0-rc2 (2022-03-10)

Full Changelog

Closed issues:

Add support for Ballista #37
Implement DataFrame.explain #35

0.5.0-rc1 (2022-03-09)

Full Changelog

Closed issues:

Investigate exposing additional optimizations #28
Use custom allocator in Python build #27
Why is pandas a requirement? #24
Unable to build #18
Setup CI against multiple Python version #6

* This Changelog was automatically generated by github_changelog_generator