blob: df7a7d4204fb2613158ed0fa893ce302495f2397 [file] [view]
<!--
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
-->
# Cassandra Analytics
## Cassandra Spark Bulk Reader
The open-source repository for the Cassandra Spark Bulk Reader. This library allows integration between Cassandra and Spark job, allowing users to run arbitrary Spark jobs against a Cassandra cluster securely and consistently.
This project contains the necessary open-source implementations to connect to a Cassandra cluster and read the data into Spark.
For example usage, see the example repository; sample steps:
```scala
import org.apache.cassandra.spark.sparksql.CassandraDataSource
import org.apache.spark.sql.SparkSession
val sparkSession = SparkSession.builder.getOrCreate()
val df = sparkSession.read.format("org.apache.cassandra.spark.sparksql.CassandraDataSource")
.option("sidecar_contact_points", "localhost,localhost2,localhost3")
.option("keyspace", "sbr_tests")
.option("table", "basic_test")
.option("DC", "datacenter1")
.option("createSnapshot", true)
.option("numCores", 4)
.load()
```
## Cassandra Spark Bulk Writer
The Cassandra Spark Bulk Writer allows for high-speed data ingest to Cassandra clusters running Cassandra 4.x and 5.0.
Developers interested in contributing to the Analytics library, please see the [DEV-README](DEV-README.md).
## Getting Started
For example usage, see the [example repository](cassandra-analytics-core-example/README.md). This example covers both
setting up Cassandra 4.0, Apache Sidecar, and running a Spark Bulk Reader and Spark Bulk Writer job.
## Contributing
Contributions are welcome!
Please join us on #cassandra-dev in [ASF Slack](https://infra.apache.org/slack.html).
Issues are tracked in [JIRA](https://issues.apache.org/jira/projects/CASSANALYTICS/issues).