| commit | ea96a34585e4e02e014277a06b4ba7b4b37a9317 | [log] [tgz] |
|---|---|---|
| author | Lawrence Pan <lawrencefeipan@gmail.com> | Fri Sep 27 12:50:44 2019 -0400 |
| committer | Ning Wang <nwang@twitter.com> | Fri Sep 27 09:50:44 2019 -0700 |
| tree | 9cad270ef52b1bbffb2739120cec93ca31b43a9b | |
| parent | 3f92bc5253ba548a7b22c153818f542e0e46ef14 [diff] |
[STREAMCOMP-2885] broadcast GCC completition (#3330) * amend gitignore * decouple GCC post-save logic from stateful controller * tmaster broadcast checkpoint completion the message will be first sent to all stmgrs, and then each stmgr will forward it to every heron instance it connects to. * heron instance handles global checkpoint saved msg * expose necessary API for the 2PC support unit tests for this will be in the following commit * test: refactor mock physical plan to a builder * test preSave and postSave hook * [STREAMCOMP-2916] block execute on postSave * add stateful tests for spouts * test preRestore * rename interface to ITwoPhaseStatefulComponent * block spout from reading data tuples as well * fix log format * do not check interface this is because the boolean will only be set to true for tasks that implement ITwoPhaseStatefulComponent. No need to do the check again.
Heron is realtime analytics platform developed by Twitter. It has a wide array of architectural improvements over it's predecessor.
https://apache.github.io/incubator-heron
| Name | Scope | |||
|---|---|---|---|---|
| user@heron.incubator.apache.org | User-related discussions | Subscribe | Unsubscribe | Archives |
| dev@heron.incubator.apache.org | Development-related discussions | Subscribe | Unsubscribe | Archives |
Self-Register to our Heron Slack Workspace
Bay Area Heron Meetup, We meet on Third Monday of Every Month in Palo Alto.
Heron on Twitter: @heronstreaming
We recently merged updates to run Heron natively using Mesos in AWS, Mesos/Aurora in AWS, and locally on a laptop.
We also added beta testing for Apache YARN support using Apache REEF, in addition to the Simple Linux Utility for Resource Management (SLURM).
We are working to add support for Mesosphere DC/OS and Kubernetes. We will continue to post updates as we progress.
Licensed under the Apache License, Version 2.0: http://www.apache.org/licenses/LICENSE-2.0