blob: 6a8a069a6e72f7d331d497d2c0b34ceaa99e604a [file] [log] [blame] [view]
A library for reading data from [ZeroMQ](http://zeromq.org/) using Spark Streaming.
## Linking
Using SBT:
```
libraryDependencies += "org.apache.bahir" %% "spark-streaming-zeromq" % "2.0.0"
```
Using Maven:
```xml
<dependency>
<groupId>org.apache.bahir</groupId>
<artifactId>spark-streaming-zeromq_2.11</artifactId>
<version>2.0.0</version>
</dependency>
```
This library can also be added to Spark jobs launched through `spark-shell` or `spark-submit` by using the `--packages` command line option.
For example, to include it when starting the spark shell:
```
$ bin/spark-shell --packages org.apache.bahir:spark-streaming_zeromq_2.11:2.0.0
```
Unlike using `--jars`, using `--packages` ensures that this library and its dependencies will be added to the classpath.
The `--packages` argument can also be used with `bin/spark-submit`.
This library is cross-published for Scala 2.10 and Scala 2.11, so users should replace the proper Scala version (2.10 or 2.11) in the commands listed above.
## Examples
### Scala API
```Scala
val lines = ZeroMQUtils.createStream(ssc, ...)
```
### Java API
```Java
JavaDStream<String> lines = ZeroMQUtils.createStream(jssc, ...);
```
See end-to-end examples at ([ZeroMQ Examples](https://github.com/apache/bahir/tree/master/streaming-zeromq/examples)