TwitterHistoryElasticsearch
Description:
Retrieves as many posts from a known list of users as twitter API allows.
Converts them to activities, and writes them in activity format to Elasticsearch.
Configuration:
TwitterHistoryElasticsearchIT.conf
In the Twitter section you should place all of your relevant authentication keys and whichever Twitter IDs you want to pull history for.
Twitter IDs can be converted from screennames at http://www.gettwitterid.com
Run (SBT):
sbtx -210 -sbt-create set resolvers += "Local Maven Repository" at "file://"+Path.userHome.absolutePath+"/.m2/repository" set libraryDependencies += "org.apache.streams" % "twitter-history-elasticsearch" % "0.4-incubating-SNAPSHOT" set fork := true set javaOptions +="-Dconfig.file=application.conf" run org.apache.streams.example.TwitterHistoryElasticsearch
Run (Docker):
docker run apachestreams/twitter-history-elasticsearch java -cp twitter-history-elasticsearch-jar-with-dependencies.jar -Dconfig.file=`pwd`/application.conf org.apache.streams.example.TwitterHistoryElasticsearch
Specification:
TwitterHistoryElasticsearch.dot
Diagram:
