FLUME-3360: Use POSIX tar format for long uid/gid support on macOS (#318)

Fixes the following error:

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:3.1.0:single (assemble) on project flume-ng-dist: Execution assemble of goal org.apache.maven.plugins:maven-assembly-plugin:3.1.0:single failed: group id '110526762' is too big ( > 2097151 ). Use STAR or POSIX extensions to overcome this limit -> [Help 1]
1 file changed
tree: e447c48e210c646251153e4cecf6ce2e4152961f
  1. .gitignore
  2. .mvn/
  3. .travis.yml
  9. README.md
  11. bin/
  12. build-support/
  13. conf/
  14. dev-docs/
  15. dev-support/
  16. doap_Flume.rdf
  17. flume-ng-auth/
  18. flume-ng-channels/
  19. flume-ng-clients/
  20. flume-ng-configfilters/
  21. flume-ng-configuration/
  22. flume-ng-core/
  23. flume-ng-dist/
  24. flume-ng-doc/
  25. flume-ng-embedded-agent/
  26. flume-ng-legacy-sources/
  27. flume-ng-node/
  28. flume-ng-sdk/
  29. flume-ng-sinks/
  30. flume-ng-sources/
  31. flume-ng-tests/
  32. flume-shared/
  33. flume-tools/
  34. mvnw
  35. mvnw.cmd
  36. pom.xml

Welcome to Apache Flume!

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. The system is centrally managed and allows for intelligent dynamic management. It uses a simple extensible data model that allows for online analytic application.

The Apache Flume 1.x (NG) code line is a refactoring of the first generation Flume to solve certain known issues and limitations of the original design.

Apache Flume is open-sourced under the Apache Software Foundation License v2.0.


Documentation is included in the binary distribution under the docs directory. In source form, it can be found in the flume-ng-doc directory.

The Flume 1.x guide and FAQ are available here:

Contact us!

Bug and Issue tracker.

Compiling Flume

Compiling Flume requires the following tools:

  • Oracle Java JDK 1.8
  • Apache Maven 3.x

Note: The Apache Flume build requires more memory than the default configuration. We recommend you set the following Maven options:

export MAVEN_OPTS="-Xms512m -Xmx1024m"

To compile Flume and build a distribution tarball, run mvn install from the top level directory. The artifacts will be placed under flume-ng-dist/target/.