Apache Spark Connect Gateway

Clone this repo:

Branches

  1. 50e1c14 Add .gitattributes by Liang-Chi Hsieh · 17 hours ago main
  2. b1eb448 Use an allowlisted CI toolchain setup by Liang-Chi Hsieh · 21 hours ago
  3. 99fcd1f Exclude dev/.rat-excludes from license header check by Liang-Chi Hsieh · 24 hours ago
  4. ce35815 Add dev/merge_spark_pr.py by Liang-Chi Hsieh · 2 days ago
  5. 96b6d77 Add a minimal README by Liang-Chi Hsieh · 2 days ago

Apache Spark Connect Gateway

A stateless gRPC proxy that fronts a pool of Apache Spark Connect servers, adding session affinity, multi-tenant routing, authentication, and observability in front of the open-source Spark Connect server.

This is an Apache Spark subproject, developed as a Rust workspace.

Status: bootstrapping. This repository is being initialized. The gateway implementation is imported separately; for now it contains only project scaffolding (license, CI, and contribution setup).

Contributing

This subproject uses the Apache Spark development process: the dev@spark.apache.org mailing list and the SPARK JIRA project. Please open a pull request against main.

License

Licensed under the Apache License, Version 2.0; see NOTICE for attribution details.