| commit | 2d1225f9a3c5401c48267b5bcef49b19254ea3aa | [log] [tgz] |
|---|---|---|
| author | shijinkui <shijinkui@huawei.com> | Mon Oct 24 19:40:24 2016 +0800 |
| committer | Robert Metzger <rmetzger@apache.org> | Wed Nov 23 11:44:37 2016 +0100 |
| tree | 3929b67e7823c9af228c6b0aa7ecbebbd6cd2b20 | |
| parent | 6b0f6820c707d4667b501e35dfdf6938d1b1abe8 [diff] |
[BAHIR-72] support netty: pushed tcp/http connector When source stream get start, listen a provided tcp port, receive stream data from user data source. This netty tcp source is keepping alive and end-to-end, that is from business system to flink worker directly. 1. source run as a netty tcp and http server 2. user provide a tcp port, if the port is in used, increace the port number between 1024 to 65535. Source can parallel. 3. callback the provided url to report the real port to listen 4. user push streaming data to netty server, then collect the data to flink This closes #7
Apache Bahir provides extensions to distributed analytics platforms such as Apache Spark™ and Apache Flink®.
This repository is for Apache Flink extensions.
The Bahir community is very open to new connector contributions for Apache Flink.
We ask contributors to first open a JIRA issue describing the planned changes. Please make sure to put “Flink Streaming Connector” in the “Component/s” field.
Once the community has agreed that the planned changes are suitable, you can open a pull request at the “bahir-flink” repository. Please follow the same directory structure as the existing code.
The community will review your changes, giving suggestions how to improve the code until we can merge it to the main repository.
Bahir is built using Apache Maven. To build Bahir and its example programs, run:
mvn -DskipTests clean install
Testing first requires building Bahir. Once Bahir is built, tests can be run using:
mvn test