)]}' { "log": [ { "commit": "a0b68c4a2f8a992d71e076bb40f0678a18081ef7", "tree": "259049616bb978117c8f43d707c7d567c0f1d01c", "parents": [ "f749758e33e5f029e06542e775a0e441f1ec2f1d" ], "author": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Fri Oct 03 16:22:31 2025 +0900" }, "committer": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Fri Oct 03 16:22:31 2025 +0900" }, "message": "[SPARK-53363] Add uuid builtin function\n\n### What changes were proposed in this pull request?\nThis PR proposes to add `uuid` builtin function.\n\n### Why are the changes needed?\nThis function is supported as of Spark 3.5.0 but spark-connect-rust doesn\u0027t have.\n\n### Does this PR introduce _any_ user-facing change?\nYes, but doesn\u0027t break compatibility because this PR just add a new builtin function.\n\n### How was this patch tested?\nAdd new test.\n\n### Was this patch authored or co-authored using generative AI tooling?\nNo.\n\nCloses #7 from sarutak/uuid-builtin-function.\n\nAuthored-by: Kousuke Saruta \u003csarutak@amazon.co.jp\u003e\nSigned-off-by: Kousuke Saruta \u003csarutak@amazon.co.jp\u003e\n" }, { "commit": "f749758e33e5f029e06542e775a0e441f1ec2f1d", "tree": "721deb2648d3011ccd9115a68c3af128b7bee915", "parents": [ "061cb3ecb187b039141f20c722c7984e915f3b9d" ], "author": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Wed Oct 01 21:13:14 2025 +0900" }, "committer": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Wed Oct 01 21:13:14 2025 +0900" }, "message": "[SPARK-53554] Fix `sum_distinct`\n\n### What changes were proposed in this pull request?\nThis PR aims to fix `sum_distinct`.\nIn the current spark-connect-rust, `sum_distinct` doesn\u0027t work correctly.\nIf we run the following code,\n\n```\nlet df \u003d spark\n .sql(\"SELECT * FROM VALUES (1), (2), (3), (1), (2), (3) AS data(value)\")\n .await?;\ndf.select([sum_distinct(col(\"value\")).alias(\"sum\")])\n .show(None, None, None)\n .await?;\n```\n\nWe will get the following error.\n```\nError: AnalysisException(\"[UNRESOLVED_ROUTINE] Cannot resolve routine `sum_distinct` on search path [`system`.`builtin`, `system`.`session`, `spark_catalog`.`default`]. SQLSTATE: 42883\")\n```\n\n### Why are the changes needed?\nBug fix.\n\n### Does this PR introduce _any_ user-facing change?\nNo.\n\n### How was this patch tested?\n\nAdded new tests.\n\n### Was this patch authored or co-authored using generative AI tooling?\nNo.\n\nCloses #8 from sarutak/fix-sum-distinct.\n\nAuthored-by: Kousuke Saruta \u003csarutak@amazon.co.jp\u003e\nSigned-off-by: Kousuke Saruta \u003csarutak@amazon.co.jp\u003e\n" }, { "commit": "061cb3ecb187b039141f20c722c7984e915f3b9d", "tree": "67934a58b3f76916a1412e095dfafdcb3ae3a86e", "parents": [ "ca629aa34fb452373555855a277d2a59e2bd5693" ], "author": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Tue Aug 12 11:51:33 2025 +0900" }, "committer": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Tue Aug 12 11:51:33 2025 +0900" }, "message": "[SPARK-53016][INFRA] Replace actions-rs/toolchain with dtolnay/rust-toolchain\n\n### What changes were proposed in this pull request?\n\nThis PR proposes to replace `actions-rs/toolchain` with `dtolnay/rust-toolchain`.\nCurrently actions-rs doesn\u0027t work in spark-connect-rust repository.\nhttps://github.com/apache/spark-connect-rust/actions/runs/16609256565\n```\nactions-rs/toolchainv1 is not allowed to be used in apache/spark-connect-rust. Actions in this workflow must be: within a repository that belongs to your Enterprise account, created by GitHub, verified in the GitHub Marketplace, or matching the following: 1Password/load-secrets-action581a835fb51b8e7ec56b71cf2ffddd7e68bb25e0, AdoptOpenJDK/install-jdk*, BobAnkh/auto-generate-changelog*, DavidAnson/markdownlint-cli2-action992badcdf24e3b8eb7e87ff9287fe931bcb00c6e, DavidAnson/markdownlint-cli2-actionb4c9feab76d8025d1e83c653fa3990936df0e6c8, DavidAnson/markdownlint-cli2-actionv16, EnricoMi/publish-unit-test-result-action*, JamesIves/github-pages-deploy-action6c2d9db40f9296374acc17b90404b6e8864128c8, JamesIves/github-pages-deploy-action881db5376404c5c8d621010bcbec0310b58d5e29, JamesIves/github-pages-deploy-actionv4.6.8, JustinBeckwith/linkinator-action3d5ba091319fa7b0ac14703761eebb7d100e6f6d, JustinBeckwith/linkinator-actionv1.11.0, Kesin11/actions-timeline427ee2cf860166e404d...\n```\n\nAlso, actions-rs/toolchain is public archived.\nhttps://github.com/actions-rs/toolchain\n\n### Why are the changes needed?\n\nRecovering CI on GA.\n\n### Does this PR introduce _any_ user-facing change?\n\nNo.\n\n### How was this patch tested?\n\nI confirmed this change works on my repository.\nhttps://github.com/sarutak/spark-connect-rust/actions/runs/16614429755\n\n### Was this patch authored or co-authored using generative AI tooling?\n\nNo.\n\nCloses #5 from sarutak/replace-actions-rs-with-dtolnay.\n\nAuthored-by: Kousuke Saruta \u003csarutak@amazon.co.jp\u003e\nSigned-off-by: Kousuke Saruta \u003csarutak@amazon.co.jp\u003e\n" }, { "commit": "ca629aa34fb452373555855a277d2a59e2bd5693", "tree": "dfdb68b7e50ead7235b7b4873da5fe849958c5cc", "parents": [ "589ea876fa9aef9b7ec6c415402cb66f6e884939" ], "author": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Tue Aug 12 11:50:00 2025 +0900" }, "committer": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Tue Aug 12 11:50:00 2025 +0900" }, "message": "[SPARK-53001][TESTS] Fix test_df_unpivot to pass with Spark 4.0\n\n# Description\n\nThis PR proposes to fix the issue that `test_df_unpivot` doesn\u0027t pass with Spark 4.0.\n```\n---- dataframe::tests::test_df_unpivot stdout ----\nSparkSession Setup\n\nthread \u0027dataframe::tests::test_df_unpivot\u0027 panicked at crates/connect/src/dataframe.rs:2463:9:\nassertion `left \u003d\u003d right` failed\n left: RecordBatch { schema: Schema { fields: [Field { name: \"id\", data_type: Int64, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: \"var\", data_type: Utf8, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: \"val\", data_type: Float32, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }], metadata: {} }, columns: [PrimitiveArray\u003cInt64\u003e\n[\n 1,\n 1,\n 2,\n 2,\n], StringArray\n[\n \"int\",\n \"float\",\n \"int\",\n \"float\",\n], PrimitiveArray\u003cFloat32\u003e\n[\n 11.0,\n 1.1,\n 12.0,\n 1.2,\n]], row_count: 4 }\n right: RecordBatch { schema: Schema { fields: [Field { name: \"id\", data_type: Int64, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: \"var\", data_type: Utf8, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }, Field { name: \"val\", data_type: Float64, nullable: false, dict_id: 0, dict_is_ordered: false, metadata: {} }], metadata: {} }, columns: [PrimitiveArray\u003cInt64\u003e\n[\n 1,\n 1,\n 2,\n 2,\n], StringArray\n[\n \"int\",\n \"float\",\n \"int\",\n \"float\",\n], PrimitiveArray\u003cFloat64\u003e\n[\n 11.0,\n 1.100000023841858,\n 12.0,\n 1.2000000476837158,\n]], row_count: 4 }\n```\n\nAs of Spark 4.0, ANSI mode is enabled by default but this test doesn\u0027t consider it.\nTo fix this issue, I tweaked the test so that the test pass in both ANSI mode is enabled or not.\n\n## Related Issue(s)\nSPARK-53001\n\nCloses #4 from sarutak/fix-unpivot-test.\n\nAuthored-by: Kousuke Saruta \u003csarutak@amazon.co.jp\u003e\nSigned-off-by: Kousuke Saruta \u003csarutak@amazon.co.jp\u003e\n" }, { "commit": "589ea876fa9aef9b7ec6c415402cb66f6e884939", "tree": "3399ba8e495926b8ae18d446cecdb962e4020893", "parents": [ "bbd86afb0ef36e10b2993bf086d7c2305854a972" ], "author": { "name": "Kousuke Saruta", "email": "sarutak@amazon.co.jp", "time": "Thu Aug 07 17:18:53 2025 +0900" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu Aug 07 01:18:53 2025 -0700" }, "message": "[SPARK-52964] Add `merge_connect_rust_pr.py` and `PULL_REQUEST_TEMPLATE` (#3)\n\nThis PR proposes adding merge_connect_rust_pr.py and PULL_REQUEST_TEMPLATE like the Spark repository does.\nThese files are brought from Spark repository and tweaked." }, { "commit": "bbd86afb0ef36e10b2993bf086d7c2305854a972", "tree": "52da1b1e5abddde67bd3c653206798cf94bcfa33", "parents": [ "257df1cd6c31a968e2e7b18a4c149057f2f6d394" ], "author": { "name": "Kousuke Saruta", "email": "sarutak@apache.org", "time": "Sat Jul 26 18:45:10 2025 +0900" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Sat Jul 26 02:45:10 2025 -0700" }, "message": "[SPARK-52941] Make GitHub Actions work for spark-connect-rust (#2)\n\n# Description\n\nThis PR proposes to let GA work, and includes fix for a typo in `README.md`\n\n## Related Issue(s)\n[SPARK-52941](https://issues.apache.org/jira/browse/SPARK-52941)" }, { "commit": "257df1cd6c31a968e2e7b18a4c149057f2f6d394", "tree": "7934d29762a3029b735deaa56b411c788dabc2a6", "parents": [ "84db605504cd2044b87d5b81164c0cd0355d7a54", "379e7759db88691c257c8136c8267948540ca65d" ], "author": { "name": "Li Yuanjian", "email": "liyuanjian@apache.org", "time": "Wed Jul 23 13:34:02 2025 -0700" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed Jul 23 13:34:02 2025 -0700" }, "message": "Merge pull request #1 from sjrusso8/source\n\n### Initial Merge Notice\n\nThis is the initial merge from the original project into the Apache repository.\n\n- **Apache Spark PMC Acceptance Vote:** \n [https://lists.apache.org/thread/mj3ggbsqhjr2lblffmyn1rq5zcfckcrn](https://lists.apache.org/thread/mj3ggbsqhjr2lblffmyn1rq5zcfckcrn)\n\n- **IP Clearance File:** \n [https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/spark-connect-rust.xml](https://svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/spark-connect-rust.xml)\n\nAll four contributors have ICLAs on file:\n\n- **Steve Russo** – Filed 2025-06-25 \n- **Stephen Carman** – Filed 2025-06-25 \n- **Alexander Brassel** – Filed 2025-07-03 \n- **Irfan Ghat** – Filed 2025-07-04" }, { "commit": "379e7759db88691c257c8136c8267948540ca65d", "tree": "7934d29762a3029b735deaa56b411c788dabc2a6", "parents": [ "84db605504cd2044b87d5b81164c0cd0355d7a54", "bb520be066b48bfc1a6f712770003c7ec8c1adbc" ], "author": { "name": "sjrusso8", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Jun 10 09:15:41 2025 -0400" }, "committer": { "name": "sjrusso8", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Jun 10 09:15:41 2025 -0400" }, "message": "merge repo\n" }, { "commit": "bb520be066b48bfc1a6f712770003c7ec8c1adbc", "tree": "0638b295d946fd99eafb2c3bfda5fadcefa17373", "parents": [ "251ebce2005c3b24a30d0e3ac9dd52089e8afcaa" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Jun 10 09:09:52 2025 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue Jun 10 09:09:52 2025 -0400" }, "message": "feat(license) add apache license to files (#96)\n\n" }, { "commit": "84db605504cd2044b87d5b81164c0cd0355d7a54", "tree": "d9087f1ad0849a50fc7ac89479fcfc5ba9e70e69", "parents": [ "b294fcf1fc4a7c8c4e707b71b6cb2701414fc903" ], "author": { "name": "Yuanjian Li", "email": "liyuanjian@apache.org", "time": "Mon May 26 02:26:16 2025 -0700" }, "committer": { "name": "Yuanjian Li", "email": "liyuanjian@apache.org", "time": "Mon May 26 02:26:16 2025 -0700" }, "message": "Update Project Description\n" }, { "commit": "b294fcf1fc4a7c8c4e707b71b6cb2701414fc903", "tree": "e7c07f2b97ababd4f813ffbe287f87b662f2596b", "parents": [], "author": { "name": "Yuanjian Li", "email": "liyuanjian@apache.org", "time": "Mon May 26 00:51:31 2025 -0700" }, "committer": { "name": "Yuanjian Li", "email": "liyuanjian@apache.org", "time": "Mon May 26 00:51:31 2025 -0700" }, "message": "Initial Commit\n" }, { "commit": "251ebce2005c3b24a30d0e3ac9dd52089e8afcaa", "tree": "37eec5f7e1114440ec65f79ecfbbb7d18d4e51c3", "parents": [ "0945fb6f1affbc8437b48d77c2b8186a5ccc1e6c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Apr 25 16:16:02 2025 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Apr 25 16:16:02 2025 -0400" }, "message": "code clean up \u0026 dep bump (#94)\n\n* fix \u0026 clean\n\n* error fixes and bump" }, { "commit": "0945fb6f1affbc8437b48d77c2b8186a5ccc1e6c", "tree": "4b3864683b316d55730de5134559d81a47738f19", "parents": [ "2a27f05fe64e0ae1e377f6fba3a64920a60a705a" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Feb 03 07:42:15 2025 -0500" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Feb 03 07:42:15 2025 -0500" }, "message": "bump: release (#92)\n\n" }, { "commit": "2a27f05fe64e0ae1e377f6fba3a64920a60a705a", "tree": "176dd9a3c5b95a41a373406c9484237cca573bc5", "parents": [ "6eb4de46d1900d654403dff5dafeb1d08fa5ae82" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Feb 02 21:17:04 2025 -0500" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Sun Feb 02 21:17:04 2025 -0500" }, "message": "feat(config): add ability to control builder configurations (#91)\n\n* feat(config): add ability to control builder configurations\r\n\r\n* fix" }, { "commit": "6eb4de46d1900d654403dff5dafeb1d08fa5ae82", "tree": "d032d1c726624e84551080d3779e0ec698a64905", "parents": [ "57dcd2d810df51e5a0d7a84061551d88346364ac" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Jan 10 15:02:20 2025 -0500" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Jan 10 15:02:20 2025 -0500" }, "message": "feat(funcs): add more functions (#89)\n\n* feat(funcs): add more functions\r\n\r\n* update README" }, { "commit": "57dcd2d810df51e5a0d7a84061551d88346364ac", "tree": "ef2fde21ec60d85db7857420e31cafc341abb0da", "parents": [ "7e55ffb62da58d5df14ccbba7e153c3a31eeecd2" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Dec 17 09:03:16 2024 -0500" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue Dec 17 09:03:16 2024 -0500" }, "message": "bug(reattach): connection is lost and session id is empty (#88)\n\n" }, { "commit": "7e55ffb62da58d5df14ccbba7e153c3a31eeecd2", "tree": "9ef562e17bb2e68973121c55512456a078ee9952", "parents": [ "188fb529fe27ddf15e0cc60e0bc7492cd80a8acb" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Dec 16 20:33:26 2024 -0500" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Dec 16 20:33:26 2024 -0500" }, "message": "bump(docker): update docker and fix test (#87)\n\n* bump(docker): update docker and fix test\r\n\r\n* docker" }, { "commit": "188fb529fe27ddf15e0cc60e0bc7492cd80a8acb", "tree": "c288fa7a7a2641dad863a3ef2095824d82ea51e8", "parents": [ "bb466323dfc46c88e0e9f31c54aac09fe141c99a" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu Oct 31 22:09:00 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu Oct 31 22:09:00 2024 -0400" }, "message": "feat!(wasm): remove feature flag (#85)\n\n" }, { "commit": "bb466323dfc46c88e0e9f31c54aac09fe141c99a", "tree": "c25667117394fda0a15a8b947b51223bac7b0b02", "parents": [ "4b7c697fe7ab0df14a42472c735d2bfe049385b7" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Oct 30 14:47:07 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed Oct 30 14:47:07 2024 -0400" }, "message": "chore: bump crate version (#84)\n\n" }, { "commit": "4b7c697fe7ab0df14a42472c735d2bfe049385b7", "tree": "ba8258aeb3ee3f96580e145937bbd13adeaa1d35", "parents": [ "cfbfa56779052559756e5ad221a85aa52f5f96ff" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Oct 30 14:38:56 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed Oct 30 14:38:56 2024 -0400" }, "message": "docs: update rustdocs (#83)\n\n* docs: update rustdocs\r\n\r\n* update rust docs\r\n\r\n* update README" }, { "commit": "cfbfa56779052559756e5ad221a85aa52f5f96ff", "tree": "8ab212f7a50dc1cefe51a406e0e112a83be4fffb", "parents": [ "5b3dce0a11973f14ae8e1c6ffa36a7c091903b69" ], "author": { "name": "Irfan Ghat", "email": "58285388+lexara-prime-ai@users.noreply.github.com", "time": "Tue Oct 29 19:00:17 2024 +0300" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue Oct 29 12:00:17 2024 -0400" }, "message": "feat: Implement createTable and createExternalTable in Catalog (#55) (#82)\n\n- Added create_table method to Catalog for creating managed tables.\r\n- Added create_external_table method to Catalog for creating external tables.\r\n- Implemented tests for managed and external table creation with schema validation." }, { "commit": "5b3dce0a11973f14ae8e1c6ffa36a7c091903b69", "tree": "30d06f7d2d6c878564a312176f98553b809aefb1", "parents": [ "8e622e815d3a43408c45afce3d9a5230f1a1626c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Oct 25 13:57:42 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Oct 25 13:57:42 2024 -0400" }, "message": "grunt: remove rust/ folder and change core/ to crates/ (#81)\n\n" }, { "commit": "8e622e815d3a43408c45afce3d9a5230f1a1626c", "tree": "6a690270310479805696eef4592d779962d7b5e5", "parents": [ "b2e42073cd8d6bf7ad51fdd5903b58d2da878710" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Oct 25 13:40:17 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Oct 25 13:40:17 2024 -0400" }, "message": "feat(sqm): add streaming query manager (#80)\n\n* feat(sqm): add streaming query manager\r\n\r\n* adjust error messages" }, { "commit": "b2e42073cd8d6bf7ad51fdd5903b58d2da878710", "tree": "55b395a518028b9a67d8dabd4ff81e918760516c", "parents": [ "11e810a1d26da09eb3ae8df00d0770ea4b3e8ada" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu Oct 24 12:05:01 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu Oct 24 12:05:01 2024 -0400" }, "message": "feat(errors): cleaner handling of tonic status errors (#79)\n\n" }, { "commit": "11e810a1d26da09eb3ae8df00d0770ea4b3e8ada", "tree": "0d6c8690518bc364d85a435bc8dd94a40651c7f6", "parents": [ "70c325541bf0cbf56f9a334fe78f23ae7fe2e4dd" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Oct 23 12:05:26 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed Oct 23 12:05:26 2024 -0400" }, "message": "feat(reattach): Add reattach \u0026 release logic (#78)\n\n* restructure client mod\r\n\r\n* feat(reattach): add reattach \u0026 release logic\r\n - add logic to submit reattach to the connect server" }, { "commit": "70c325541bf0cbf56f9a334fe78f23ae7fe2e4dd", "tree": "0b3895f623f7ebd290a29ef8c991ea140206efc2", "parents": [ "1a58cd2e50bb59cf51d78f3fc779548e04e8606c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Oct 14 21:15:34 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Oct 14 21:15:34 2024 -0400" }, "message": "revert(tonic): move tonic back to 0.11 (#76)\n\n" }, { "commit": "1a58cd2e50bb59cf51d78f3fc779548e04e8606c", "tree": "27f68a13bf54f70e90bb8116cb691b70c40e86f4", "parents": [ "84f170ac5270d27ce59cf9ea224c9a9e3ea3e10e" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Oct 14 08:00:50 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Oct 14 08:00:50 2024 -0400" }, "message": "feat(functions): implement more functions #75\n\nfeat(functions): implement more functions\r\n\r\n - implement nearly all of the remaining functions\r\n - create a macro to quickly create simple functions\r\n - create a macro to quickly create simple unit tests\r\n - fix some doc references" }, { "commit": "84f170ac5270d27ce59cf9ea224c9a9e3ea3e10e", "tree": "f422d60eb73850097341d0db5f5a36576367fc23", "parents": [ "2b138c6587d39c694e3ca05762cd1dd90a664c74" ], "author": { "name": "Irfan Ghat", "email": "58285388+lexara-prime-ai@users.noreply.github.com", "time": "Fri Oct 11 22:00:43 2024 +0300" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Oct 11 15:00:43 2024 -0400" }, "message": "feat(readwriter): Implement File Format Reader/Writer (#72)\n\n* feat: Implement CSV Options Configuration for DataFrameReader (#53)\r\n\r\n- Added CsvOptions struct to support CSV read options like `header`, `delimiter`, and `nullValue`.\r\n- Implemented ConfigOpts trait for CsvOptions to convert options into key-value pairs.\r\n- Updated DataFrameReader to include `csv` method that accepts CsvOptions.\r\n\r\n* feat: Implement CSV Options Configuration for DataFrameReader (#54)\r\n\r\n- Added documentation for the CsvOptions struct.\r\n\r\n* test(readwriter): Implement test_dataframe_read_csv_with_options (#54)\r\n\r\n* refactor: Improve CSV method to handle multiple paths (#54)\r\n\r\n - Updated the csv method in DataFrameReader to support both single string slices and arrays of string slices as input paths.\r\n\r\n* feat: Added implementations for JSON Options struct (#54)\r\n\r\n* feat: Implement JSON Options Configuration for DataFrameReader (#54)\r\n\r\n- Added JsonOptions struct to support JSON read options like `schema`, `multi_line`, `encoding`, and more.\r\n- Implemented ConfigOpts trait for JsonOptions to convert options into key-value pairs.\r\n- Updated DataFrameReader to include `json` method that accepts JsonOptions.\r\n- Documented all available JSON options, including example usage for setting options when reading JSON files. [TO DO]\r\n- Write tests to validate JSON options functionality.\r\n\r\n* feat: Implement ORC Options Configuration for DataFrameReader (#54)\r\n\r\n- Example usage provided for setting ORC options when reading files.\r\n- Write tests to validate ORC options functionality.\r\n\r\n* feat: Implement Parquet Options Configuration for DataFrameReader (#54)\r\n\r\n- Added ParquetOptions struct to support Parquet read options like `mergeSchema`, `pathGlobFilter`, and `recursiveFileLookup`.\r\n- Implemented ConfigOpts trait for ParquetOptions to convert options into key-value pairs.\r\n- Updated DataFrameReader to include `parquet` method that accepts ParquetOptions.\r\n- Example usage provided for setting Parquet options when reading files.\r\n- Write tests to validate Parquet options functionality.\r\n\r\n* feat: Implement Text Options Configuration for DataFrameReader (#54)\r\n\r\n- Added TextOptions struct to support text read options like `wholetext`, `lineSep`, and `pathGlobFilter`.\r\n- Implemented ConfigOpts trait for TextOptions to convert options into key-value pairs.\r\n- Updated DataFrameReader to include `text` method that accepts TextOptions.\r\n- Example usage provided for setting text options when reading files.\r\n- Write tests to validate text options functionality.\r\n\r\n* feat: Implement Text and Parquet Options Configuration for DataFrameWriter (#54)\r\n\r\n- Added TextOptions struct to support text write options such as `whole_text` and `line_sep`.\r\n- Added ParquetOptions struct to support Parquet write options like `merge_schema`, `path_glob_filter`, and `datetime_rebase_mode`.\r\n- Implemented `write` method in DataFrameWriter to handle configuration for text and Parquet file formats.\r\n- Example usage provided for setting text and Parquet options when writing DataFrames.\r\n- Write tests to validate text and Parquet file writing functionality.\r\n\r\n* Added rustdocs to method implementations.\r\n\r\n* feat: Implement initial methods for file format reader and writer (#54)\r\n\r\n- Added support for reading and writing .csv, .json, .orc, .parquet, and .text file formats.\r\n- Created `ConfigOpts` trait for each file type to manage options in a structured way.\r\n- Added example method signatures for file reading using a configurable options object passed into methods.\r\n\r\n* Add missing csv options to CsvOptions.\r\n\r\n* feat: Implement Configuration Options for DataFrameReader and Writer (#54)\r\n\r\n - Implemented additional fields in ParquetOptions compression.\r\n - Updated test_dataframe_read_parquet_with_options to ensure valid compression codec usage.\r\n - Enhanced test_dataframe_read_text_with_options to properly read lines by setting line_sep and disabling whole_text.\r\n - Implemented the #[derive(Debug, Clone)] traits for all Option structs.\r\n - Updated expected path_glob_filter type to string.\r\n - Added the compression field to ParquetOptions, OrcOptions, and JsonOptions.\r\n - Updated documentation for all Options structs to include descriptions for new and existing fields.\r\n\r\n* feat: Refactor file format options with shared CommonFileOptions (#54)\r\n\r\n - Introduced CommonFileOptions to handle common configuration fields such as:\r\n - path_glob_filter\r\n - recursive_file_lookup\r\n - ignore_corrupt_files\r\n - ignore_missing_files\r\n - modified_before\r\n - modified_after\r\n\r\n - Updated CsvOptions, JsonOptions, OrcOptions, ParquetOptions, and TextOptions\r\n to use CommonFileOptions for the shared fields.\r\n\r\n - Updated the new() constructors for each file format options struct to initialize\r\n CommonFileOptions.\r\n\r\n - Refactored tests for each file format (e.g., ORC, CSV) to utilize the new\r\n CommonFileOptions, ensuring that both format-specific and shared options\r\n are properly tested.\r\n\r\n - Updated and verified tests for DataFrame reading and writing operations with updated options.\r\n\r\n* Updated rustdocs.\r\n\r\n* Updated typo in rustdocs: /// - - Common file options...\r\n\r\n* Updated README - DataFrameReader/Writer section.\r\n\r\n---------\r\n\r\nCo-authored-by: lexara-prime-ai \u003cirfanghta@gmail.com\u003e" }, { "commit": "2b138c6587d39c694e3ca05762cd1dd90a664c74", "tree": "61de9d5433bfac79b73d04b785b75e2e8bb6cad7", "parents": [ "ab85ae6f6324d572393e0fb56d9eca2073fb2748" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu Oct 03 20:53:49 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu Oct 03 20:53:49 2024 -0400" }, "message": "refactor: consolidate traits (#74)\n\n* refactor: consolidate traits\r\n\r\n* refactor\r\n\r\n* remove\r\n\r\n* fix" }, { "commit": "ab85ae6f6324d572393e0fb56d9eca2073fb2748", "tree": "2320ae8cca5ed4ec47bf2972f504ee30498186d3", "parents": [ "af53c29dd246bc5c21589b92fa98fb2f29e5ec84" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 25 21:15:36 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed Sep 25 21:15:36 2024 -0400" }, "message": "chore: update readme \u0026 bump dependencies (#73)\n\n* chore: update readme \u0026 bump dependency\r\n\r\n* fix datafusion/polars \u0026 update doc" }, { "commit": "af53c29dd246bc5c21589b92fa98fb2f29e5ec84", "tree": "6fe6c6c38516deb2372730028c1f8df5d7fd9f3a", "parents": [ "7ea744b2beb4b6af4fe146f48797203c6b4b4a82" ], "author": { "name": "Irfan Ghat", "email": "58285388+lexara-prime-ai@users.noreply.github.com", "time": "Mon Aug 19 22:32:24 2024 +0300" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Aug 19 15:32:24 2024 -0400" }, "message": "fix(cicd): resolve issue with broken release (#70)\n\n* Updated release workflow.\r\n" }, { "commit": "7ea744b2beb4b6af4fe146f48797203c6b4b4a82", "tree": "51ca78575ff74bceefc5b318caef1edb29eb0827", "parents": [ "b25c9388b1113fbbbb286f4736ddfcfc74e5a089" ], "author": { "name": "Irfan Ghat", "email": "58285388+lexara-prime-ai@users.noreply.github.com", "time": "Fri Aug 09 15:40:13 2024 +0300" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Aug 09 08:40:13 2024 -0400" }, "message": "tests(column): enhance column function code coverage (#68)\n\n* Add test for ascending order with NULLs first.\r\n\r\n* feat(tests): add test for ascending order with NULLs first (#17)\r\n\r\n * feat(tests): implement `test_func_asc_nulls_first`\r\n - Verify sorting functionality for ascending order with NULL values positioned first.\r\n\r\n* feat(tests): add test for ascending order with NULLs last (#17)\r\n\r\n * feat(tests): implement `test_func_asc_nulls_last`\r\n - Verify sorting functionality for ascending order with NULL values positioned last.\r\n\r\n* feat(tests): add tests for descending order with NULLs first and last (#49)\r\n\r\n * feat(tests): implement `test_func_desc_nulls_first`\r\n - Verify sorting functionality for descending order with NULL values positioned first.\r\n\r\n * feat(tests): implement `test_func_desc_nulls_last`\r\n - Verify sorting functionality for descending order with NULL values positioned last.\r\n\r\n * validate robustness and accuracy of the sorting mechanism\r\n\r\n* feat(tests): add tests for descending order with NULLs first and last (#17)\r\n\r\n * feat(tests): implement `test_func_desc_nulls_first`\r\n - Verify sorting functionality for descending order with NULL values positioned first.\r\n\r\n * feat(tests): implement `test_func_desc_nulls_last`\r\n - Verify sorting functionality for descending order with NULL values positioned last.\r\n\r\n * validate robustness and accuracy of the sorting mechanism\r\n\r\n* feat(tests): add test for LIKE filter functionality (#17)\r\n\r\n * feat(tests): implement `test_func_like`\r\n - Verify filter functionality using the LIKE operator.\r\n - Ensure the filter correctly selects the name \"Alice\".\r\n\r\n * validate robustness and accuracy of the LIKE filter mechanism\r\n\r\n* feat(tests): add test for ILIKE filter functionality (#17)\r\n\r\n * feat(tests): implement `test_func_ilike`\r\n - Verify filter functionality using the ILIKE operator.\r\n - Ensure the filter correctly selects the name \"Alice\" using a case-insensitive pattern \"%Ice\".\r\n\r\n * validate robustness and accuracy of the ILIKE filter mechanism\r\n\r\n* feat(tests): add test for RLIKE filter functionality (#17)\r\n * feat(tests): implement\r\n - Implemented a test to validate the behavior of the \u0027rlike\u0027 filter on a DataFrame.\r\n - Ensured that the filter correctly identifies records with names matching the regex pattern ice.\r\n - Added necessary setup and assertions for expected results.\r\n\r\n* feat(tests): add test for RLIKE filter functionality (#17)\r\n * feat(tests): implement `test_func_rlike`\r\n - Implemented a test to validate the behavior of the \u0027rlike\u0027 filter on a DataFrame.\r\n - Ensured that the filter correctly identifies records with names matching the regex pattern ice.\r\n - Added necessary setup and assertions for expected results.\r\n\r\n* feat(tests): add test for EQ filter functionality (#17)\r\n * feat(tests): implement `test_func_eq`\r\n - Verify filter functionality using the EQ operator.\r\n\r\n* feat(tests): add test for OR filter functionality (#17)\r\n * feat(tests): implement `test_func_or`\r\n - Verify filter functionality using the OR operator.\r\n - Ensure the filter correctly selects the name \"Alice\" using a case-insensitive pattern \"%Ice\".\r\n\r\n * validate robustness and accuracy of the ILIKE filter mechanism\r\n main\r\n\r\n* feat(tests): add test for IS_NULL filter functionality (#17)\r\n * feat(tests): implement `test_func_is_null`\r\n - Implemented a test to validate the behavior of the \u0027is_null\u0027 filter on a DataFrame.\r\n - Ensured that the filter correctly identifies records with null values.\r\n - Added necessary setup and assertions for expected results.\r\n\r\n* Exclude additional is_null test.\r\n\r\n* feat(tests): add test for IS_NOT_NULL filter functionality (#17)\r\n * feat(tests): implement `test_func_is_not_null`\r\n - Implemented a test to validate the behavior of the \u0027isnotnull\u0027 filter on a DataFrame.\r\n - Ensured that the filter correctly identifies records with non-null values.\r\n - Added necessary setup and assertions for expected results.\r\n - Moved `isnotnull` function definition to `\r\n // functions that require a single col argument\r\n generate_functions!(\r\n one_col: isnan,\r\n isnull,\r\n isnotnull,\r\n ...)\r\n `\r\n\r\n* feat(tests): add tests for window functions and IS_NAN filter functionality(#17)\r\n\r\n* feat(tests): implement `test_func_over`\r\n - Implemented a test to validate the behavior of window functions on a DataFrame.\r\n - Ensured that the window functions (`rank` and `min`) correctly compute values within the specified window.\r\n - Added necessary setup, sorting, and assertions for expected results.\r\n\r\n* feat(tests): implement `test_func_isnan`\r\n - Implemented a test to validate the behavior of the `isnan` function on a DataFrame.\r\n - Ensured that the `isnan` function correctly identifies NaN values.\r\n - Added necessary setup and assertions for expected results.\r\n\r\n* feat(tests): add tests for column aliasing, casting, and substring functions (#17)\r\n\r\n- feat(tests): implement `test_func_cast`\r\n - Added a test to validate the behavior of casting an integer column to a string.\r\n - Ensured that the cast operation correctly transforms the data type and assigns the alias.\r\n\r\n- feat(tests): implement `test_func_alias`\r\n - Added a test to verify column aliasing functionality.\r\n - Confirmed that the DataFrame correctly applies aliases to columns.\r\n\r\n- feat(tests): implement `test_func_substr`\r\n - Added a test to validate the substring function on a string column.\r\n - Ensured that the substring operation works as expected and assigns the alias.\r\n\r\n* feat(fix): Fixed typo on test name - test_func_substract to test_func_subtract." }, { "commit": "b25c9388b1113fbbbb286f4736ddfcfc74e5a089", "tree": "d886bc2149d0a9ae1f3866510f63861598008b73", "parents": [ "386a4309763c5aeac6fc0c574b10029c5fdc061c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu Aug 08 14:03:30 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu Aug 08 14:03:30 2024 -0400" }, "message": "fix(cicd): issue with docker compose (#69)\n\n- change to `docker compose`" }, { "commit": "386a4309763c5aeac6fc0c574b10029c5fdc061c", "tree": "d1b748d985ce23be0455eef0f19ffc12d95bfb9b", "parents": [ "676e89379affa12f837e96d4ec1c46c5661c9839" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Jul 30 15:04:26 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue Jul 30 15:04:26 2024 -0400" }, "message": "feat(dataframe): implement missing methods (#67)\n\n* feat(dataframe): stat \u0026 na methods\r\n\r\n* update README\r\n\r\n* update rust docs\r\n\r\n* flaky test" }, { "commit": "676e89379affa12f837e96d4ec1c46c5661c9839", "tree": "d71141d1b3677c973dee21861e28db473c877c13", "parents": [ "12848307df5db17bbcd4a5490c451ee59cdaed3f" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Jul 22 14:35:43 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Jul 22 14:35:43 2024 -0400" }, "message": "feat(submodule): remove git submodule (#66)\n\n- copy the protobuf from spark3.5 release\r\n- update cargo.toml" }, { "commit": "12848307df5db17bbcd4a5490c451ee59cdaed3f", "tree": "3532092ed0e481136795b8d3c70257b75d65d024", "parents": [ "42c88e40a76a9a9b57605f8330d77b71f96c3e57" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Jul 03 07:11:05 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Jul 03 07:11:05 2024 -0400" }, "message": "bump version\n" }, { "commit": "42c88e40a76a9a9b57605f8330d77b71f96c3e57", "tree": "e409b85f4a9d79c3172b59a9d8c684d5edfbfe24", "parents": [ "5ea47e5c98b55b93e331573283c4dafcabab7314" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Jun 14 15:59:52 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Jun 14 15:59:52 2024 -0400" }, "message": "feat(sq): implement missing methods (#53)\n\n* feat(sq): implement missing methods\r\n- change methods to references\r\n" }, { "commit": "5ea47e5c98b55b93e331573283c4dafcabab7314", "tree": "a3b849825fe62a7996e27d6ae7ce8c6d8afb3166", "parents": [ "8f204f4500a00f4a58afd15389d293b2cbfe9c8f" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu Jun 13 17:13:40 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu Jun 13 17:13:40 2024 -0400" }, "message": "refactor: remove snake case (#52)\n\n" }, { "commit": "8f204f4500a00f4a58afd15389d293b2cbfe9c8f", "tree": "579762309493f062e9a3fcc88a8f8a55afc2efe4", "parents": [ "ca9df65a7c9fcb0a10f80270eea6d584d07b10ea" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Jun 12 21:02:24 2024 -0700" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu Jun 13 00:02:24 2024 -0400" }, "message": "refactor(session): use ref for session methods \u0026 error messages (#51)\n\n* feat(session): use ref\r\n\r\n* fix" }, { "commit": "ca9df65a7c9fcb0a10f80270eea6d584d07b10ea", "tree": "fc6f343448e26a4428593981afce7149da2a4c5a", "parents": [ "395e593014e16eee2fc3bebe1b78ba7768e987b5" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Jun 12 15:08:07 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed Jun 12 15:08:07 2024 -0400" }, "message": "bug(dep): fix tokio dependeny on wasm feature (#50)\n\n* bug(dep): fix tokio dependeny on wasm featrue\r\n\r\n* fix example dependencies" }, { "commit": "395e593014e16eee2fc3bebe1b78ba7768e987b5", "tree": "28ec04fc2ba2b3ece5768a060b363787fbdc926d", "parents": [ "8988aba883c8c39ad1a57d608b6fa131fb458869" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Jun 12 14:44:16 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed Jun 12 14:44:16 2024 -0400" }, "message": "bug(conf): runtimeconfig on wasm feature (#49)\n\n* fix: runtimeconfig with wasm" }, { "commit": "8988aba883c8c39ad1a57d608b6fa131fb458869", "tree": "d4ad3f2598c7d19cdedd3a2621b278cd537e72c5", "parents": [ "1db643c11b8496325c0ac3d726d1c7a4c427919b" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Jun 11 14:08:23 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue Jun 11 14:08:23 2024 -0400" }, "message": "bug(deadlock): change to async rwlock (#48)\n\n* bug(deadlock): change to async rwlock\r\n- remove parking_lot and change to tokio::sync::rwlock\r\n- add test for deadlock check\r\n- update dependencies\r\n\r\n* remove clippy content" }, { "commit": "1db643c11b8496325c0ac3d726d1c7a4c427919b", "tree": "2c465383ef511639bb663e317799d9038b06ab35", "parents": [ "cf25ac948a3352373a15cddd9b5e1d194f8f6481" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Jun 07 22:08:02 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Jun 07 22:08:02 2024 -0400" }, "message": "update README\n" }, { "commit": "cf25ac948a3352373a15cddd9b5e1d194f8f6481", "tree": "1001ce4cf8d3a1ed07f49998aec7b8e786844ee3", "parents": [ "87cb35d9dd322b91485f74ec14aff3a6bde4a41f" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Jun 07 22:02:53 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Jun 07 22:02:53 2024 -0400" }, "message": "feat(session): add RunTimeConfig \u0026 Session tags (#45)\n\n" }, { "commit": "87cb35d9dd322b91485f74ec14aff3a6bde4a41f", "tree": "84841027570ead949b80f06f2833949cb989ab38", "parents": [ "c9cb32113ef4dafbcc50910197ce06d453313c2e" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Jun 03 15:14:05 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Jun 03 15:14:05 2024 -0400" }, "message": "feat(examples): update with local datasets (#44)\n\n* feat(examples): update with local datasets\r\n - update docker-compose with volume pointing to \u0027datasets/\u0027\r\n - update tests to use the volume\r\n\r\n* simplify dataset location" }, { "commit": "c9cb32113ef4dafbcc50910197ce06d453313c2e", "tree": "9e4c9c68bc4250edfc330c82d24c808e458906ad", "parents": [ "3a28504d97ec999d986ccd9c1107d85b7b5da85e" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri May 31 09:43:01 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri May 31 09:43:01 2024 -0400" }, "message": "feat(dataframe): Spark DF to Polars, DataFusion, or JSON (#43)\n\n* feat(dataframe): to datafusion,polars,json\r\n\r\n* update tests \u0026 readme\r\n\r\n* modify feature flag \u0026 update build pipeline" }, { "commit": "3a28504d97ec999d986ccd9c1107d85b7b5da85e", "tree": "ae7434fc84b41e25ff5bfd38a9adb88e043e4d44", "parents": [ "32c8f3c60fc28001a6c406906c57b73c351e9154" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun May 26 06:58:59 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Sun May 26 06:58:59 2024 -0400" }, "message": "feat(data types): implement data types (#41)\n\n* feat(types): create SparkDataType representations" }, { "commit": "32c8f3c60fc28001a6c406906c57b73c351e9154", "tree": "1d2f1d54efadbbf9c5296131f02771e0aa2b05d9", "parents": [ "93f8fc9bfd17e81f1e38e713dfcbd16478af7eb0" ], "author": { "name": "Alexander Brassel", "email": "abrassel@users.noreply.github.com", "time": "Fri May 24 12:23:58 2024 -0700" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri May 24 15:23:58 2024 -0400" }, "message": "Update README (#37)\n\n" }, { "commit": "93f8fc9bfd17e81f1e38e713dfcbd16478af7eb0", "tree": "696073907e729b16871e1c27906b176f5315c8dd", "parents": [ "9924e61aa3c627e166f7adbd7facc48534731f34" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue May 21 14:20:21 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue May 21 14:20:21 2024 -0400" }, "message": "bug(tls): incorrect scheme for tls (#39)\n\n- needs to be https for only when using tls" }, { "commit": "9924e61aa3c627e166f7adbd7facc48534731f34", "tree": "f11e17891a8ae61e76284edb0b486ab2adab8a0e", "parents": [ "72384478442f80d64df6bc6157958f18a60b0cc9" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon May 20 22:13:27 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon May 20 22:13:27 2024 -0400" }, "message": "feat(examples): update examples (#35)\n\n* feat(examples): update examples" }, { "commit": "72384478442f80d64df6bc6157958f18a60b0cc9", "tree": "4dfee3c45bf8871c50557cb726543f94860b8aac", "parents": [ "eb12b83400082f5881767766fc0c62409753c072" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri May 17 07:43:19 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri May 17 07:43:19 2024 -0400" }, "message": "feat(dataframe): implement transform (#34)\n\n" }, { "commit": "eb12b83400082f5881767766fc0c62409753c072", "tree": "fa693d03288738859759c33de231a6677a1278d5", "parents": [ "7fa53b0dd9a04f70c98b6cdf6f4cbcab0ffbbcca" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed May 15 13:53:35 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed May 15 13:53:35 2024 -0400" }, "message": "feat(col): dropFields \u0026 withField (#32)\n\n* feat(col): dropFields \u0026 withField" }, { "commit": "7fa53b0dd9a04f70c98b6cdf6f4cbcab0ffbbcca", "tree": "25e8998a4c8691de9be109b149aeade76ecf3291", "parents": [ "707a1765c59e1daa273b39a067d009e3e60091df" ], "author": { "name": "Stephen Carman", "email": "hntd187@users.noreply.github.com", "time": "Wed May 15 08:25:03 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed May 15 08:25:03 2024 -0400" }, "message": "feat: initial implementation of DataframeWriterV2 (#30)\n\n* feat: initial implementation of DataframeWriterV2" }, { "commit": "707a1765c59e1daa273b39a067d009e3e60091df", "tree": "d4c81309aecc311019ca5e6dd38b9c2b632673c3", "parents": [ "e38f4e2b49f46ea8f551fe4da7bb89c01f0da8b2" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue May 14 12:20:58 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue May 14 12:20:58 2024 -0400" }, "message": "feat(types) \u0026 bug(plan): add new datatypes \u0026 fix plan id bug (#31)\n\nNew DataTypes \u0026 Literals:\r\n - update `types` with `Timestamp`, `TimestampNtz` \u0026 `\u0026[u8]` as `Binary`\r\n - update `expressions` to handle `Timestamp` and `TimestampNtz` correctly\r\n - use the `chrono` crate correctly and not manually parsing dates to unix epoch \r\n - update `expressions` to create a binary literal from `\u0026[u8]`\r\n \r\nFix plan id \u0026 column issue:\r\n - Plan ID was not incrementing correctly, changed to a `static AtomicI64` counter. Implementation is much simpler. \r\n - Issue with `plan_id` being hardcoded to `Some(1)` on column expressions. Results in an error. Changed to `None` and error is resolved \r\n\r\nOther: \r\n - Changed the `rust` Cargo.toml to only include tokio as a dev dependency\r\n - Updated README" }, { "commit": "e38f4e2b49f46ea8f551fe4da7bb89c01f0da8b2", "tree": "4667512d8b0aa2cd005fef711d8c1c43bb47e7a7", "parents": [ "6233fe0088d6ed5db6233fd9ee2b578840f84186" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu May 09 21:17:01 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu May 09 21:17:01 2024 -0400" }, "message": "update cargo.toml\n" }, { "commit": "6233fe0088d6ed5db6233fd9ee2b578840f84186", "tree": "542f896ecf14c49b78a04b831746c5cd337199f2", "parents": [ "3adabe62411009b06882c5cdf818478e75f6ffe6" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu May 09 21:07:55 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu May 09 21:07:55 2024 -0400" }, "message": "fix: add include to cargo.toml (#29)\n\n" }, { "commit": "3adabe62411009b06882c5cdf818478e75f6ffe6", "tree": "e538d1c8d047a46761fbf080010b0aff6505691a", "parents": [ "7f110d1a89a1b4028e02efd95625eed04161c6ca" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu May 09 20:12:25 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu May 09 20:12:25 2024 -0400" }, "message": "fix: publish \u0026 bump versions (#28)\n\n* bump version\r\n\r\n* update release pipeline\r\n\r\n* bump version" }, { "commit": "7f110d1a89a1b4028e02efd95625eed04161c6ca", "tree": "c6a283f2370dc37dfb5e8cb390f880c75951a5eb", "parents": [ "587e09a29df7074adbcca87e7e968109e36ee223" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed May 01 16:12:48 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed May 01 16:12:48 2024 -0400" }, "message": "refactor: wrap all spark sessions in box (#27)\n\n- all spark sessions are now wrapped in a box\r\n- cloning a box is fast and only clones the pointer and not the object\r\n- update DataFrame create logic\r\n- clean up code in the stream module" }, { "commit": "587e09a29df7074adbcca87e7e968109e36ee223", "tree": "2e2d739ebe5b263062aab91c1e15a8903026f52c", "parents": [ "073e1fa14ec2b0b16eed358662e7692f4f46155e" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sat Apr 27 13:39:58 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Sat Apr 27 13:39:58 2024 -0400" }, "message": "chore: reorganize code into a workspace (#24)\n\nMoving all code into a workspace for `core` and `rust`. The goal is to allow for better interop for future languages by having a `core` implementation and language specific bindings.\r\n\r\nRefactor some of the existing code so that macros and utility functions are created in the modules they are used. Updated for that leveraged the function `lit` to leverage traits. " }, { "commit": "073e1fa14ec2b0b16eed358662e7692f4f46155e", "tree": "3fda62e66797ba6a59b0bd4f04103eca298cc70a", "parents": [ "418e92641ffa4688ac62e0aeb6f2380a0756bee7" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Apr 26 20:19:57 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Apr 26 20:19:57 2024 -0400" }, "message": "feat: client improvements \u0026 flaky tests (#23)\n\n- Update client mod to be more reusable\r\n- Leverage environment variables for `SPARK_REMOTE` and `USER` \r\n- Move `SparkSessionBuilder` to `session` module\r\n- Change `mutex` to `rwlock` when creating the client object\r\n- Fix flaky tests\r\n- Remove `arrow` as a re-export" }, { "commit": "418e92641ffa4688ac62e0aeb6f2380a0756bee7", "tree": "bb08bd5a864114dc2ac2f423d3cbd8922d2e7a21", "parents": [ "21c827ae2b35f7ff6674430a50123e5f84b4428c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Apr 23 12:00:36 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue Apr 23 12:00:36 2024 -0400" }, "message": "feat(catalog): add additional methods (#22)\n\n* feat(catalog): add additional methods\r\n- add additional methods for `cacheTable`, \u0027databasesExists`, etc.\r\n- did **not** include methods for `createTable`, `createExternalTable` or `registerFunction`" }, { "commit": "21c827ae2b35f7ff6674430a50123e5f84b4428c", "tree": "e5aa2c30958d9bc26d8dc373180f8ce82cdec12f", "parents": [ "ca5882cce6dbd5829f45a3917a617723771548a8" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Apr 23 10:38:13 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue Apr 23 10:38:13 2024 -0400" }, "message": "bump: dependencies \u0026 docker (#21)\n\n" }, { "commit": "ca5882cce6dbd5829f45a3917a617723771548a8", "tree": "8ab232ad740d76d76c23ff73c0cb4a0f2233666a", "parents": [ "74f14f1ae8148c7ac294b5a29c1a501df1e4db4a" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Fri Apr 19 10:23:05 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Fri Apr 19 10:23:05 2024 -0400" }, "message": "feat(window): create Window \u0026 WindowSpec (#19)\n\nfeat(window): create Window \u0026 WindowSpec\r\n- create two new structs for Window \u0026 WindowSpec based a similar implementation of the existing Spark API.\r\n- add unit tests for coverage of specific Window methods\r\n- add new over method onto Column and add unit test\r\n- update Rust Docs and README for `Window\r\n" }, { "commit": "74f14f1ae8148c7ac294b5a29c1a501df1e4db4a", "tree": "e2d66160a2c92d180d2d286fe7bc25683a77f07f", "parents": [ "67d78877c36246d250dadf50a17b04ac0d13e159" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Apr 16 10:30:44 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Tue Apr 16 10:30:44 2024 -0400" }, "message": "chore: update readme \u0026 examples (#15)\n\n# Description\r\n\r\n- Update README with clearer \"getting started\" instructions\r\n- Update the SQL example to match this gist https://gist.github.com/sjrusso8/2b4e43af462367a15f91db5a33627449\r\n- Update other examples to explicitly set a remote URL \r\n\r\n# Related Issue(s)\r\n\u003c!---\r\nFor example:\r\n\r\n- closes #106\r\n---\u003e\r\n\r\n- closes #14 \r\n" }, { "commit": "67d78877c36246d250dadf50a17b04ac0d13e159", "tree": "13120c5a8ce12627ace8e41b6e886c593d548160", "parents": [ "89c5d858275a096fbb413da9228a02da3293565e" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Apr 08 22:03:27 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Apr 08 22:03:27 2024 -0400" }, "message": "feat: implement pivot \u0026 unpivot (#12)\n\n- add tests \u0026 update docs" }, { "commit": "89c5d858275a096fbb413da9228a02da3293565e", "tree": "03811d214670f77582c493206136030618d1c965", "parents": [ "6650707c15cc4f33774a2a70ec5462abd980bebc" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Apr 07 21:00:53 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Sun Apr 07 21:00:53 2024 -0400" }, "message": "bug(column): incorrect logical not (#11)\n\n- fix issue with logical not operator setup\r\n- add unit test for functionality" }, { "commit": "6650707c15cc4f33774a2a70ec5462abd980bebc", "tree": "7307a5bf8da8f5cf14f2fb21f26ccc2ab75383f7", "parents": [ "e5f9411dd6cb46dbbd778ce9b2123c4e42b3fc1c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Apr 01 22:24:28 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Apr 01 22:24:28 2024 -0400" }, "message": "feat(updates): streaming \u0026 aggregations (#10)\n\n* update mutex references and client\r\n\r\n* add timestamp \u0026 nativedate support from chrono\r\n\r\n* add groupby \u0026 streaming\r\n\r\n* serde_json \u0026 stream example\r\n\r\n* bump version" }, { "commit": "e5f9411dd6cb46dbbd778ce9b2123c4e42b3fc1c", "tree": "e3014670776352d687158dd30df042760f3ae93c", "parents": [ "c039840a4335ee42230c134d23bde08ce787a168" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Mar 24 17:50:30 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Mar 24 17:50:30 2024 -0400" }, "message": "bug(client): reset response state\n" }, { "commit": "c039840a4335ee42230c134d23bde08ce787a168", "tree": "16c9b4fa53fd546a5e57920daff167a9497f726d", "parents": [ "bf6d9f30c33f57baeb5f536d8e773e885cfd7dde", "32c11bec27b0b4e4b4ff376b2ee9a092ede76d4e" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Mar 24 12:24:38 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Mar 24 12:24:38 2024 -0400" }, "message": "Merge branch \u0027main\u0027 of https://github.com/sjrusso8/spark-connect-rs\n" }, { "commit": "bf6d9f30c33f57baeb5f536d8e773e885cfd7dde", "tree": "14bdabc9b1f5f064a4ff19f4cedc59bc63821ebd", "parents": [ "2b8995f4b6a3551f30b27cd5d77ecbb16e7d159c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Mar 24 12:19:21 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Mar 24 12:19:21 2024 -0400" }, "message": "bump: cargo version \u0026 deps\n" }, { "commit": "32c11bec27b0b4e4b4ff376b2ee9a092ede76d4e", "tree": "a2c6419abb27280475f539f1cdfb3f8b046a02ac", "parents": [ "2b8995f4b6a3551f30b27cd5d77ecbb16e7d159c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sun Mar 24 11:55:38 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Sun Mar 24 11:55:38 2024 -0400" }, "message": "feat(client/handler): reimplement client \u0026 response handlers (#9)\n\n* feat(client/handler): reimplement client \u0026 response handlers\r\n- Rewrote the spark client to so it handles responses and requests. Logic is no longer on the SparkSession\r\n- Actions no longer return Vec\u003cRecordBatch\u003e but one RecordBatch\r\n- Fixed issue with incorrect de-serialization during the handling of the response\r\n- Remove old handler logic\r\n- Update tests" }, { "commit": "2b8995f4b6a3551f30b27cd5d77ecbb16e7d159c", "tree": "5159fcf295e28688d48a6069813d7beccc211a1c", "parents": [ "6f0fc4f5d7558407c5b6f4dcbe4778cf92503f93" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Thu Mar 21 22:28:08 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Thu Mar 21 22:28:08 2024 -0400" }, "message": "feat: better generic args (#8)\n\n- add better generic types to traits\r\n- add new trait implementation for an array of expressions\r\n- update example" }, { "commit": "6f0fc4f5d7558407c5b6f4dcbe4778cf92503f93", "tree": "3b744ad6b51312152620705f409964dac5698d89", "parents": [ "fbd54c6feeab51bcec3e7011e0bee74a63399ed1" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Mar 20 21:09:54 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Mar 20 21:09:54 2024 -0400" }, "message": "bug(example): change connection string\n" }, { "commit": "fbd54c6feeab51bcec3e7011e0bee74a63399ed1", "tree": "47ab8bedf2e3663544ee8281edf03387aec2620a", "parents": [ "bc0e0d0c937e990eab03e4a53978f371b8d18876" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Mar 20 21:03:11 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Mar 20 21:03:11 2024 -0400" }, "message": "feat(tls): enable tls authentication\n- update client for better metadata headers\n- add feature flag for tls to enable connection to Databricks\n- update sparksession builder to accetp \u0026str and not String for connection string\n" }, { "commit": "bc0e0d0c937e990eab03e4a53978f371b8d18876", "tree": "da7369ec45650d0d49c98ec74a9b83c6c6ebc276", "parents": [ "5c85ffbb365134cb3d879e963306755e0e6983c1" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Mar 20 20:01:27 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Mar 20 20:01:27 2024 -0400" }, "message": "bump(spark): move to tag v3.5.1\n" }, { "commit": "5c85ffbb365134cb3d879e963306755e0e6983c1", "tree": "97c464a2934c9c75a75d87137c80f38427acad81", "parents": [ "13e463b48ed8bd271cbe16fc533be191b24eb17c" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Sat Mar 16 10:55:39 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Sat Mar 16 10:55:39 2024 -0400" }, "message": "feat(dataframe): implement core traits (#6)\n\n* feat(dataframe): implement core traits\r\n- implement more basic traits for DataFrame\r\n- change interface to leverage Enums where possible (jointype, savemode, storagelevel)\r\n- create storage.rs with enum wrapper around spark::StorageLevel\r\n- update tests\r\n- update docker-compose.yml with delta-spark\r\n\r\n* update docs and examples\r\n\r\n* update readme" }, { "commit": "13e463b48ed8bd271cbe16fc533be191b24eb17c", "tree": "b6ca1c9eff79a8eb22b9b9ec3a93d5b314d4882f", "parents": [ "8441e2f8f54bffa9f6fbb0677a2f6c7862e94fd9" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Mar 13 18:50:18 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Mar 13 18:50:18 2024 -0400" }, "message": "feat(session): make sensitive fields private\n- should not have access to token or user_id on the spark session\n" }, { "commit": "8441e2f8f54bffa9f6fbb0677a2f6c7862e94fd9", "tree": "8ecaba92176556b8cac5a9e2079777a1de51d3eb", "parents": [ "635c3217aae33ac715fe9c0852afe69772b47f69" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Mar 12 21:09:55 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Mar 12 21:09:55 2024 -0400" }, "message": "update readme\n" }, { "commit": "635c3217aae33ac715fe9c0852afe69772b47f69", "tree": "f156e5decd9b11192e49665a73e674f9d7275a24", "parents": [ "d82454aef79afd28d1e5ea0bf062b72af671f692" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Mar 12 20:52:12 2024 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Mar 12 20:52:12 2024 -0400" }, "message": "feat(errors): some better error handling\n- create custom error enum\n- update session traits to leverage new error method\n- update .sql command to be a Result\n" }, { "commit": "d82454aef79afd28d1e5ea0bf062b72af671f692", "tree": "c872567e379c845855dd0126d499f2689009be5c", "parents": [ "778f7c0210fa3fa544908fdc88e7203a57be4db4" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Mar 11 21:00:05 2024 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Mar 11 21:00:05 2024 -0400" }, "message": "Add Catalog \u0026 more DataFrame traits (#4)\n\n* feat: implement basic catalog\r\n\r\n* feat: colummns \u0026 dtypes" }, { "commit": "778f7c0210fa3fa544908fdc88e7203a57be4db4", "tree": "1fa16d30f5ec13d97b9833985e35496e872bb104", "parents": [ "ab932de265e5959fe1664cbf732d619e17387305" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Mar 04 15:57:19 2024 -0500" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Mar 04 15:57:19 2024 -0500" }, "message": "bump version\n" }, { "commit": "ab932de265e5959fe1664cbf732d619e17387305", "tree": "d5d6e75f1f82857d65773ccaf68672e72bd1cdfe", "parents": [ "faf2d8ab803e0cd0ba0d7ecc5ba7472b1c6cc32b" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Mar 04 15:52:55 2024 -0500" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Mar 04 15:52:55 2024 -0500" }, "message": "feat: marco refactor and lots of functions (#3)\n\n* feat: functions \u0026 column operators\r\n\r\n* feat: macros \u0026 sql fix\r\n- update functions to use a util marco\r\n- fix sql command\r\n\r\n* feat: update examples\r\n\r\n* fix: remove panic! replace with todo\r\n\r\n* update docs and examples" }, { "commit": "faf2d8ab803e0cd0ba0d7ecc5ba7472b1c6cc32b", "tree": "f6332137012acf8afcb3b05455f540e98a576539", "parents": [ "5b1b7f303657ff76c866b0000dc15ea769bc7ebd" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Feb 28 08:42:59 2024 -0500" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Wed Feb 28 08:42:59 2024 -0500" }, "message": "feat: restructure existing modules, and add Column, Expression, and Functions modules (#1)\n\n**feat**: restructure existing modules, and add Column, Expression, and Functions modules\r\n\r\n* refactor existing modules to mirror the pyspark connector layout\r\n* move logic plan creation into the `plan` module and out of the `dataframe` module\r\n* create an `expression` module to handle `Expression` creation\r\n* create `Column` struct as a representation of a `Column` object\r\n * add traits for `alias` and `name`\r\n* create `functions` module containing the first workings of pyspark functions \r\n * add functions for `col`, `pi`, and `coalesce` \r\n* **breaking change** the `select()` trait now only excepts `Vec\u003cColumn\u003e`\r\n * tests and examples are updated to match the change " }, { "commit": "5b1b7f303657ff76c866b0000dc15ea769bc7ebd", "tree": "464358a251b44deec90b4cfef3e8af1d12e9151c", "parents": [ "05f19aeb4f9c8e53a115cf4d39b2352a8a87312d" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 20 15:48:54 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 20 15:48:54 2023 -0400" }, "message": "chore\n" }, { "commit": "05f19aeb4f9c8e53a115cf4d39b2352a8a87312d", "tree": "0dab6581bf8e09e6361c79a9e301e9a43b0d6bd4", "parents": [ "e66de5426a378195fbdc99c7016ac7dafd1b2b60" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 20 15:48:17 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 20 15:48:17 2023 -0400" }, "message": "feat: explain as println\n" }, { "commit": "e66de5426a378195fbdc99c7016ac7dafd1b2b60", "tree": "4207f2da06663574793bf8611c57c23ce364a93b", "parents": [ "f9b93d7b2ac36a430136480b67e76e2354a5966b" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 20 15:05:32 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 20 15:05:32 2023 -0400" }, "message": "bump version\n" }, { "commit": "f9b93d7b2ac36a430136480b67e76e2354a5966b", "tree": "a3cdc063a272b4ff8ef602c3c69264bbc8ce7ef0", "parents": [ "85f46711bb476f987998e94671a921cea5d21cf9" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 20 14:52:30 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Wed Sep 20 14:52:30 2023 -0400" }, "message": "update: docker-compose \u0026 release\n" }, { "commit": "85f46711bb476f987998e94671a921cea5d21cf9", "tree": "97694b6f244b63ffdef2e2c9f5a3677f13cfcd71", "parents": [ "d379b09e09e28171ad1833f06fd0252c3ff5f752" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Sep 19 22:20:21 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Tue Sep 19 22:20:21 2023 -0400" }, "message": "feat(dataframe): additional methods \u0026 updated docs\n" }, { "commit": "d379b09e09e28171ad1833f06fd0252c3ff5f752", "tree": "5feb79b0f578aecfff4e020fd229472e7a0cab8d", "parents": [ "d36b3d1a373f1816ca83c14636d61a5c85a2eb56" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 21:43:39 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 21:43:39 2023 -0400" }, "message": "fix: update readme\n" }, { "commit": "d36b3d1a373f1816ca83c14636d61a5c85a2eb56", "tree": "a9cf7c6d25c0727f0273667d3ea82912ad632570", "parents": [ "c98c2eb2a4ce2def30455da1db947e52fd5a85ae" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 18:08:10 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 18:08:10 2023 -0400" }, "message": "fix: update readme\n" }, { "commit": "c98c2eb2a4ce2def30455da1db947e52fd5a85ae", "tree": "5981e545b1ab2259109226bebec407cbd15fcdba", "parents": [ "b342f156e9ccc69a27f3cd0608197692174ec264" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 18:06:31 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 18:06:31 2023 -0400" }, "message": "fix: toml \u0026 readme\n" }, { "commit": "b342f156e9ccc69a27f3cd0608197692174ec264", "tree": "f594016c5ddf74f9a6c887ddb561bdb06b9267b0", "parents": [ "ba0fcc73851097b4a2b97f4b41100c2a0a88a894" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 18:01:30 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 18:01:30 2023 -0400" }, "message": "fix: toml, readme, github action\n" }, { "commit": "ba0fcc73851097b4a2b97f4b41100c2a0a88a894", "tree": "ab2584390bca6cfc038075be04b4ffe03ce31c17", "parents": [ "a5b36b32a9e832040f423aceb419873588c865a7" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:49:09 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:49:09 2023 -0400" }, "message": "fix: github actions\n" }, { "commit": "a5b36b32a9e832040f423aceb419873588c865a7", "tree": "141c0b421e5748e63ebeb40814a237c606557971", "parents": [ "d317981e5273765d557e50f5376ebd82ed369953" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:44:53 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:44:53 2023 -0400" }, "message": "fix: github actions\n" }, { "commit": "d317981e5273765d557e50f5376ebd82ed369953", "tree": "24c512adc2f98bbbd2d00b77531d85d5d4424ae9", "parents": [ "62ac79ef62e5c7034e8bec46190297a3d2733228" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:34:03 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:34:03 2023 -0400" }, "message": "fix: github actions\n" }, { "commit": "62ac79ef62e5c7034e8bec46190297a3d2733228", "tree": "4a83ba0af8720f2cc3f8a6c56830b3a360365369", "parents": [ "476dec95e511c59e2c790cf9f208a4f1aaa9779f" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:23:44 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:23:44 2023 -0400" }, "message": "github action\n" }, { "commit": "476dec95e511c59e2c790cf9f208a4f1aaa9779f", "tree": "be200b939184147eab1874798ff2b2b8e6824e66", "parents": [ "dcd08fb6914c98bc13ae1b9aeb60a2f33887e378" ], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:20:37 2023 -0400" }, "committer": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 17:20:37 2023 -0400" }, "message": "initial commit\n" }, { "commit": "dcd08fb6914c98bc13ae1b9aeb60a2f33887e378", "tree": "8f57a99980891ccc68701b94b94342f7ae0e02d6", "parents": [], "author": { "name": "Steve Russo", "email": "64294847+sjrusso8@users.noreply.github.com", "time": "Mon Sep 18 09:32:20 2023 -0400" }, "committer": { "name": "GitHub", "email": "noreply@github.com", "time": "Mon Sep 18 09:32:20 2023 -0400" }, "message": "Initial commit" } ] }