Incorporated feedback from IPMC on RC2

- Added build instructions to generate a "gradlew" script when building Myriad from source downloads. Myriad's source releases will henceforth exclude the "gradlew" script and the "gradle-wrapper.jar".
- Modified the LICENSE file to match the stock LICENSE. Added a note that normalize.css is MIT licensed.
- Updated the top level README to include an explicit section for build instructions. It just points to the "developing myriad" document so that users don't struggle to find out where the build instructions are located.

This closes: #49
Review: https://github.com/apache/incubator-myriad/pull/49
3 files changed
tree: 19dd8de441e741b9c360f18ad8dc62e619c72511
  1. config/
  2. docker/
  3. docs/
  4. gradle/
  5. myriad-commons/
  6. myriad-executor/
  7. myriad-scheduler/
  8. vagrant/
  9. website/
  10. .gitignore
  11. .travis.yml
  12. build.gradle
  13. DISCLAIMER
  14. gradle.properies
  15. gradlew
  16. gradlew.bat
  17. LICENSE
  18. NOTICE
  19. README.md
  20. settings.gradle
  21. Vagrantfile
README.md

Myriad

Build Status

Myriad is a Mesos framework designed for scaling a YARN cluster on Mesos. Myriad can expand or shrink the resources managed by a YARN cluster in response to events as per configured rules and policies.

The name Myriad means, countless or extremely great number. In context of the project, it allows one to expand overall resources managed by Mesos, even when the cluster under Mesos management runs other cluster managers like YARN.

Please note: Myriad is not yet production ready. However, the project is rapidly progressing with some very useful features.

Getting started

For up-to-date documentation, see Apache Myriad on the wiki.

Build Myriad

Please refer to the build section for steps to build Myriad.

Roadmap

Please keep checking this section for updates.

  • [x] NodeManager Profiles
  • [x] Scale up/down Node Managers via REST API/Web UI
  • [x] Framework re-conciliation & HA
  • [x] ResourceManager failover/discovery using Marathon/Mesos-DNS
  • [x] Fine-grained scaling
  • [x] Remote distribution of NodeManager binaries
  • [x] Framework checkpointing
  • [x] Launch Job History Server
  • [x] Constraints based Node Manager placement
  • [ ] Support multi-tenancy for Node Managers
  • [ ] Configuration store for storing rules and policies for clusters managed by Myriad

Mailing Lists

Videos and Slides

  • MesosCon 2014 - Running YARN alongside Mesos (video) (slides)
  • Mesos User Group, March 2015 - Myriad: Integrating Hadoop into the Datacenter (video)
  • MesosCon, Seattle 2015 - Resource Sharing Beyond Boundaries (video) (slides)

License

Apache Myriad is licensed under the Apache License, Version 2.0.

For additional information, see the LICENSE and NOTICE files.