| # Seatunnel Runs On Flink |
| |
| Flink is a powerful high-performance distributed stream processing engine. More information about it you can search for `Apache Flink` |
| |
| ### Set Flink Configuration Information In The Job |
| |
| Begin with `flink.` |
| |
| Example: |
| I set a precise Checkpoint for this job |
| |
| ``` |
| env { |
| parallelism = 1 |
| flink.execution.checkpointing.unaligned.enabled=true |
| } |
| ``` |
| |
| Enumeration types are not currently supported, you need to specify them in the Flink conf file ,Only these types of Settings are supported for the time being:<br/> |
| Integer/Boolean/String/Duration |
| |
| ### How To Set Up A Simple Flink Job |
| |
| This is a simple job that runs on Flink. Randomly generated data is printed to the console |
| |
| ``` |
| env { |
| # common parameter |
| parallelism = 1 |
| checkpoint.interval = 5000 |
| |
| # flink special parameter |
| flink.execution.checkpointing.mode = "EXACTLY_ONCE" |
| flink.execution.checkpointing.timeout = 600000 |
| } |
| |
| source { |
| FakeSource { |
| row.num = 16 |
| plugin_output = "fake_table" |
| schema = { |
| fields { |
| c_map = "map<string, string>" |
| c_array = "array<int>" |
| c_string = string |
| c_boolean = boolean |
| c_int = int |
| c_bigint = bigint |
| c_double = double |
| c_bytes = bytes |
| c_date = date |
| c_decimal = "decimal(33, 18)" |
| c_timestamp = timestamp |
| c_row = { |
| c_map = "map<string, string>" |
| c_array = "array<int>" |
| c_string = string |
| c_boolean = boolean |
| c_int = int |
| c_bigint = bigint |
| c_double = double |
| c_bytes = bytes |
| c_date = date |
| c_decimal = "decimal(33, 18)" |
| c_timestamp = timestamp |
| } |
| } |
| } |
| } |
| } |
| |
| transform { |
| # If you would like to get more information about how to configure seatunnel and see full list of transform plugins, |
| # please go to https://seatunnel.apache.org/docs/transform-v2/sql |
| } |
| |
| sink{ |
| Console{} |
| } |
| ``` |
| |
| ### How To Run A Job In A Project |
| |
| After you pull the code to the local, go to the `seatunnel-examples/seatunnel-flink-connector-v2-example` module and find `org.apache.seatunnel.example.flink.v2.SeaTunnelApiExample` to complete the operation of the job. |