Google Git
Sign in
apache / cassandra-analytics / HEAD
commit85f4ba57b8143bbedb19688bb8867e0d64b3f592[log] [tgz]
authorBernardo Botella <bbotella@users.noreply.github.com>Thu Sep 18 09:09:59 2025 -0700
committerGitHub <noreply@github.com>Thu Sep 18 09:09:59 2025 -0700
treec0333994d876504e8b8d00a5b19b2ca23b20c25a
parent075c21d346b6242b3599d510cdd96d8934923ade [diff]
CASSANALYTICS-91: Add extractCdcTables method to CqlUtils (#141)

Patch by Bernardo Botella; Reviewed by Francisco Guerrero, Yifan Cai for CASSANALYTICS-91
3 files changed
tree: c0333994d876504e8b8d00a5b19b2ca23b20c25a
  1. .circleci/
  2. analytics-sidecar-client/
  3. analytics-sidecar-client-common/
  4. analytics-sidecar-vertx-client/
  5. analytics-sidecar-vertx-client-shaded/
  6. cassandra-analytics-cdc/
  7. cassandra-analytics-cdc-codec/
  8. cassandra-analytics-cdc-sidecar/
  9. cassandra-analytics-common/
  10. cassandra-analytics-core/
  11. cassandra-analytics-core-example/
  12. cassandra-analytics-integration-framework/
  13. cassandra-analytics-integration-tests/
  14. cassandra-analytics-sidecar-client/
  15. cassandra-analytics-spark-converter/
  16. cassandra-analytics-spark-five-zero-converter/
  17. cassandra-analytics-spark-four-zero-converter/
  18. cassandra-avro-converter/
  19. cassandra-bridge/
  20. cassandra-five-zero/
  21. cassandra-five-zero-avro-converter/
  22. cassandra-five-zero-bridge/
  23. cassandra-five-zero-types/
  24. cassandra-four-zero/
  25. cassandra-four-zero-avro-converter/
  26. cassandra-four-zero-bridge/
  27. cassandra-four-zero-types/
  28. cassandra-three-zero/
  29. config/
  30. githooks/
  31. gradle/
  32. ide/
  33. profiles/
  34. scripts/
  35. .asf.yaml
  36. .gitignore
  37. build.gradle
  38. CHANGES.txt
  39. code_version.sh
  40. DEV-README.md
  41. gradle.properties
  42. gradlew
  43. LICENSE.txt
  44. NOTICE.txt
  45. README.md
  46. settings.gradle
README.md

Cassandra Analytics

Cassandra Spark Bulk Reader

The open-source repository for the Cassandra Spark Bulk Reader. This library allows integration between Cassandra and Spark job, allowing users to run arbitrary Spark jobs against a Cassandra cluster securely and consistently.

This project contains the necessary open-source implementations to connect to a Cassandra cluster and read the data into Spark.

For example usage, see the example repository; sample steps:

import org.apache.cassandra.spark.sparksql.CassandraDataSource
import org.apache.spark.sql.SparkSession

val sparkSession = SparkSession.builder.getOrCreate()
val df = sparkSession.read.format("org.apache.cassandra.spark.sparksql.CassandraDataSource")
                          .option("sidecar_contact_points", "localhost,localhost2,localhost3")
                          .option("keyspace", "sbr_tests")
                          .option("table", "basic_test")
                          .option("DC", "datacenter1")
                          .option("createSnapshot", true)
                          .option("numCores", 4)
                          .load()

Cassandra Spark Bulk Writer

The Cassandra Spark Bulk Writer allows for high-speed data ingest to Cassandra clusters running Cassandra 3.0 and 4.0.

Developers interested in contributing to the Analytics library, please see the DEV-README.

Getting Started

For example usage, see the example repository. This example covers both setting up Cassandra 4.0, Apache Sidecar, and running a Spark Bulk Reader and Spark Bulk Writer job.

Contributing

Contributions are welcome!

Please join us on #cassandra-dev in ASF Slack.

Issues are tracked in JIRA.