Apache Pekko Kafka Connector - Pekko-Connectors is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Apache Pekko.

Clone this repo:
  1. 07a19b8 Set version scheme by Matthew de Detrich · 3 days ago main
  2. 1d6c97c Add unwrap single string into .git-ignore-blame-revs by Matthew de Detrich · 3 days ago
  3. ebd2cf6 Update sbt-apache-sonatype by Matthew de Detrich · 3 days ago
  4. 63f2ae0 Unwrap single string interpolation syntax by Matthew de Detrich · 3 days ago
  5. 07abca1 use Scala 3.3.0 (#74) by PJ Fanning · 6 days ago

Apache Pekko Kafka Connector scaladex-badge maven-central-badge gh-actions-badge

Systems don't come alone. In the modern world of microservices and cloud deployment, new components must interact with legacy systems, making integration an important key to success. Reactive Streams give us a technology-independent tool to let these heterogeneous systems communicate without overwhelming each other.

The Apache Pekko Connectors project is an open source initiative to implement stream-aware, reactive, integration pipelines for Java and Scala. It is built on top of Apache Pekko Streams, and has been designed from the ground up to understand streaming natively and provide a DSL for reactive and stream-oriented programming, with built-in support for backpressure. Pekko Streams is a Reactive Streams and JDK 9+ java.util.concurrent.Flow-compliant implementation and therefore fully interoperable with other implementations.

This repository contains the sources for the Apache Pekko Kafka Connector. Which lets you connect Apache Kafka to Pekko Streams.

Pekko connectors to other technologies are listed in the Pekko connectors repository.

The Apache Pekko Kafka Connector is a fork of Alpakka Kafka 3.0.1, prior to the Akka project's adoption of the Business Source License.

Documentation

TODO add documentation links

Community

You can join these forums and chats to discuss and ask Pekko and Pekko connector related questions:

  • GitHub discussions: for questions and general discussion.
  • Pekko dev mailing list: for Pekko connectors development discussions.
  • GitHub issues: for bug reports and feature requests. Please search the existing issues before creating new ones. If you are unsure whether you have found a bug, consider asking in GitHub discussions or the mailing list first.

The Apache Pekko Kafka Connector was originally created as Reactive Kafka by .

Contributing

Contributions are very welcome. If you have an idea on how to improve Pekko, don't hesitate to create an issue or submit a pull request.

See CONTRIBUTING.md for details on the development workflow and how to create your pull request.

Caveat Emptor

Pekko Connectors are not always binary compatible between releases. API changes that are not backward compatible might be introduced as we refine and simplify based on your feedback. A module may be dropped in any release without prior deprecation.