DataFusion Python Examples

Some of the examples rely on data which can be downloaded from the following site:

• https://www.nyc.gov/site/tlc/about/tlc-trip-record-data.page

Here is a direct link to the file used in the examples:

• https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2021-01.parquet

Examples

• Query a Parquet file using SQL
• Query a Parquet file using the DataFrame API
• Run a SQL query and store the results in a Pandas DataFrame
• Query PyArrow Data
• Register a Python UDF with DataFusion
• Register a Python UDAF with DataFusion
• Executing SQL on Polars
• Executing SQL on Pandas