| commit | 3f36653d68abcbcea1e41de877dabe1493bc067f | [log] [tgz] |
|---|---|---|
| author | Saranya Krishnakumar <saranya_k@apple.com> | Thu Nov 20 09:45:54 2025 -0800 |
| committer | GitHub <noreply@github.com> | Thu Nov 20 09:45:54 2025 -0800 |
| tree | 6f38e0f606a57bbe7206fff41be96b0673e385ac | |
| parent | 4c198efc94ebfcec144ccde02021d549b1bf773e [diff] |
CASSANALYTICS-102: Add TimeRangeFilter to filter out SSTables outside given time window (#155) patch by Saranya Krishnakumar; reviewed by Yifan Cai, for CASSANALYTICS-102
The open-source repository for the Cassandra Spark Bulk Reader. This library allows integration between Cassandra and Spark job, allowing users to run arbitrary Spark jobs against a Cassandra cluster securely and consistently.
This project contains the necessary open-source implementations to connect to a Cassandra cluster and read the data into Spark.
For example usage, see the example repository; sample steps:
import org.apache.cassandra.spark.sparksql.CassandraDataSource import org.apache.spark.sql.SparkSession val sparkSession = SparkSession.builder.getOrCreate() val df = sparkSession.read.format("org.apache.cassandra.spark.sparksql.CassandraDataSource") .option("sidecar_contact_points", "localhost,localhost2,localhost3") .option("keyspace", "sbr_tests") .option("table", "basic_test") .option("DC", "datacenter1") .option("createSnapshot", true) .option("numCores", 4) .load()
The Cassandra Spark Bulk Writer allows for high-speed data ingest to Cassandra clusters running Cassandra 3.0 and 4.0.
Developers interested in contributing to the Analytics library, please see the DEV-README.
For example usage, see the example repository. This example covers both setting up Cassandra 4.0, Apache Sidecar, and running a Spark Bulk Reader and Spark Bulk Writer job.
Contributions are welcome!
Please join us on #cassandra-dev in ASF Slack.
Issues are tracked in JIRA.