| commit | 400caa4c074464710df33290b60ac61beedd5792 | [log] [tgz] |
|---|---|---|
| author | Josh Fischer <josh@joshfischer.io> | Tue Jan 09 11:09:24 2018 -0600 |
| committer | Karthik Ramasamy <karthik@streaml.io> | Tue Jan 09 09:09:24 2018 -0800 |
| tree | ca251977a2006a108d2b020b2db9e100b1cd9db4 | |
| parent | d609b7c192ca5c8af46afd2829c919ef5c2726b0 [diff] |
Joshfischer/eco config (#2658) * initial addition of directory structure * clean up * adding base config for build file \ fixing linting issues * saving progress. Still need to fix missing class definition on ParseException * fixing shaded dependency issue * starting experimentation on how to approach loading config from yaml file * experimenting with snake yaml to extract topology defintion * adding start of topology and component definitions * refactor * successfully populating ecoTopologyDefinition from yaml * clean up * clean up * fixed versioning error * saving progress, still working through building topology from yaml * saving progress * cleaning up styles * checking default config values * adding test for customized config map * transitioning to support heron api * removing last of streamlet api from eco * making a pivot to match storm flux behavior better * saving before chaos * saving progress, running into issue with verifying the toplogy * adding some logging for debugging * printing topology definition. Adding tests * saving with failing test, still working through investigation * back to working * saving progress * finishing eco parser test * handling exception * package change * package change * adding missed id * MVP of ECO at this commit * fixing styles, pulling topology name from topology definition file * fixing spelling * clean up * clean up * refatoring eco builder package * start to removing static calls * removing static calls * still working through linting errors * fixing lint errors * fixing setter * adding test * start to verfiying bean references * verifying components * fixing tests * worked passed constructor argument issue. Now need to deal with backtypes from Storm * saving before restructure * building kafka topology * fixing imports for test * fixing folder structure * refactor for testability * removing more statics * cleaning up eco builders * confirmation config builder maps as expected * finishing configBuilder test * cleaning up BoltBuilder * verfiying component builder * replacing java logger * adding tests * adding verification of building implementations of IRichBolts * clean up * adding mocks for testing * fixing classNotFound errors * coverage on all of stream bulder * need to refactor ObjectBuilder * moving static call * adding verifcation to test * clean up * clean up * verifying path of building objects with args * covering other path * starting on builder utility * verifying className * adding test * adding test * clean up * adding test * clean up * clean up * fixing checkstyle errors * fixing linting issues * fixing linting issues * fixing linting issues * fixing linting issues * linting issues * fixing checkstyle * fixing checkstyle * saving progress * adding simple wordcount eco example * adding examples * checkstyles
Heron is realtime analytics platform developed by Twitter. It is the direct successor of Apache Storm, built to be backwards compatible with Storm's topology API but with a wide array of architectural improvements.
For more information:
We recently merged updates to run Heron natively using Mesos in AWS, Mesos/Aurora in AWS, and locally on a laptop.
We also added beta testing for Apache YARN support using Apache REEF, in addition to the Simple Linux Utility for Resource Management (SLURM).
We are working to add support for Mesosphere DC/OS and Kubernetes. We will continue to post updates as we progress.
The official documentation for Heron is located at heronstreaming.io. To contribute to documentation, build and run the documentation locally. More information can be found in the documentation README.