tree: 4a279161c30ce4a2c79bbddab9ee102e4c69c988 [path history] [tgz]
  1. README.md
  2. pom.xml
  3. src/
flink-connector-akka/README.md

Flink Akka Connector

This connector provides a sink to Akka source actors in an ActorSystem. To use this connector, add the following dependency to your project:

<dependency>
  <groupId>org.apache.bahir</groupId>
  <artifactId>flink-connector-akka_2.11</artifactId>
  <version>1.1-SNAPSHOT</version>
</dependency>

Version Compatibility: This module is compatible with Akka 2.0+.

Note that the streaming connectors are not part of the binary distribution of Flink. You need to link them into your job jar for cluster execution. See how to link with them for cluster execution here.

Configuration

The configurations for the Receiver Actor System in Flink Akka connector can be created using the standard typesafe Config (com.typesafe.config.Config) object.

To enable acknowledgements, the custom configuration akka.remote.auto-ack can be used.

The user can set any of the default configurations allowed by Akka as well as custom configurations allowed by the connector.

A sample configuration can be defined as follows:

String configFile = getClass().getClassLoader()
      .getResource("feeder_actor.conf").getFile();
Config config = ConfigFactory.parseFile(new File(configFile));    

Message Types

There are 3 different kind of message types which the receiver Actor in Flink Akka connector can receive.

  • message containing Iterable<Object> data

  • message containing generic Object data

  • message containing generic Object data and a Timestamp value passed as Tuple2<Object, Long>.