Apache Streams (incubating) Licensed under Apache License 2.0 - http://www.apache.org/licenses/LICENSE-2.0

flink-twitter-collection

Requirements:

• Authorized Twitter API credentials

Description:

Collects large batches of documents from api.twitter.com from a seed set of ids.

Streams:

FlinkTwitterFollowingPipeline

FlinkTwitterPostsPipeline

FlinkTwitterSpritzerPipeline

FlinkTwitterUserInformationPipeline

Test:

Create a local file application.conf with valid twitter credentials

twitter {
  oauth {
    consumerKey = ""
    consumerSecret = ""
    accessToken = ""
    accessTokenSecret = ""
  }
}

Build:

mvn clean test verify -DskipITs=false -DargLine="-Dconfig.file=`pwd`/application.conf"

JavaDocs

Licensed under Apache License 2.0 - http://www.apache.org/licenses/LICENSE-2.0