Google Git
Sign in
apache / fluo / 833d0130046fe98a6c5b022b6475226c87613207
commit833d0130046fe98a6c5b022b6475226c87613207[log] [tgz]
authorKeith Turner <keith@deenlo.com>Tue Jun 14 13:27:23 2016 -0400
committerGitHub <noreply@github.com>Tue Jun 14 13:27:23 2016 -0400
tree3298dfdd6fe8fb74e94041589ef65cbe10328285
parentf161b659020a326c93d307014d9614b663c0b9b9 [diff]
parent644eb281501a34db57fcaa631a3e53ed5c76588b [diff]
Merge pull request #679 from mikewalch/fluo-653

Closes #653 - Added support for plotting historical committing transa…
tree: 3298dfdd6fe8fb74e94041589ef65cbe10328285
  1. contrib/
  2. docs/
  3. modules/
  4. .gitignore
  5. .travis.yml
  6. AUTHORS
  7. LICENSE
  8. pom.xml
  9. README.md
README.md

Fluo

Build Status Apache License Maven Central Javadoc

Fluo is transaction layer that enables incremental processing on big data.

Fluo is an implementation of Percolator built on Accumulo that runs in YARN. It is not recommended for production use yet. Check out the Fluo project website for news and general information.

Getting Started

There are several ways to run Fluo (listed in order of increasing difficulty):

  • quickstart - Starts a MiniFluo instance that is configured to run a word count application
  • MiniFluo - Sets up a minimal Fluo instance that writes its data to single directory
  • fluo-dev - Command-line tool for running Fluo and its dependencies on a single machine
  • Zetten - Command-line tool that launches an AWS cluster and sets up Fluo/Accumulo on it
  • Production - Sets up Fluo on a cluster where Accumulo, Hadoop & Zookeeper are running

Except for quickstart, all above will set up a Fluo application that will be idle unless you create client & observer code for your application. You can either create your own application or configure Fluo to run an example application below:

  • phrasecount - Computes phrase counts for unique documents
  • fluo-stress - Computes the number of unique integers by building bitwise trie
  • webindex - Creates a web index using Common Crawl data

Applications

Below are helpful resources for Fluo application developers:

  • Instructions for creating Fluo applications
  • Fluo API javadocs
  • Fluo Recipes is a project that provides common code for Fluo application developers implemented using the Fluo API.

Implementation

  • Architecture - Overview of Fluo's architecture
  • Contributing - Documentation for developers who want to contribute to Fluo
  • Metrics - Fluo metrics are visible via JMX by default but can be configured to send to Graphite or Ganglia