| import Tabs from '@theme/Tabs'; |
| import TabItem from '@theme/TabItem'; |
| |
| # Common Options |
| |
| > Common parameters of source connectors |
| |
| <Tabs |
| groupId="engine-type" |
| defaultValue="spark" |
| values={[ |
| {label: 'Spark', value: 'spark'}, |
| {label: 'Flink', value: 'flink'}, |
| ]}> |
| <TabItem value="spark"> |
| |
| | name | type | required | default value | |
| | ----------------- | ------ | -------- | ------------- | |
| | result_table_name | string | yes | - | |
| | table_name | string | no | - | |
| |
| ### result_table_name [string] |
| |
| When `result_table_name` is not specified, the data processed by this plug-in will not be registered as a data set that can be directly accessed by other plugins, or called a temporary table (table); |
| |
| When `result_table_name` is specified, the data processed by this plug-in will be registered as a data set (dataset) that can be directly accessed by other plug-ins, or called a temporary table (table). The dataset registered here can be directly accessed by other plugins by specifying `source_table_name`. |
| |
| ### table_name [string] |
| |
| [Deprecated since v1.4] The function is the same as `result_table_name` , this parameter will be deleted in subsequent Release versions, and `result_table_name` parameter is recommended. |
| |
| </TabItem> |
| <TabItem value="flink"> |
| |
| | name | type | required | default value | |
| | ----------------- | ------ | -------- | ------------- | |
| | result_table_name | string | no | - | |
| | field_name | string | no | - | |
| |
| ### result_table_name [string] |
| |
| When `result_table_name` is not specified, the data processed by this plugin will not be registered as a data set `(dataStream/dataset)` that can be directly accessed by other plugins, or called a temporary table `(table)` ; |
| |
| When `result_table_name` is specified, the data processed by this plugin will be registered as a data set `(dataStream/dataset)` that can be directly accessed by other plugins, or called a temporary table `(table)` . The data set `(dataStream/dataset)` registered here can be directly accessed by other plugins by specifying `source_table_name` . |
| |
| ### field_name [string] |
| |
| When the data is obtained from the upper-level plug-in, you can specify the name of the obtained field, which is convenient for use in subsequent sql plugins. |
| |
| </TabItem> |
| </Tabs> |
| |
| ## Example |
| |
| <Tabs |
| groupId="engine-type" |
| defaultValue="spark" |
| values={[ |
| {label: 'Spark', value: 'spark'}, |
| {label: 'Flink', value: 'flink'}, |
| ]}> |
| <TabItem value="spark"> |
| |
| ```bash |
| fake { |
| result_table_name = "view_table" |
| } |
| ``` |
| |
| > The result of the data source `fake` will be registered as a temporary table named `view_table` . This temporary table can be used by any Filter or Output plugin by specifying `source_table_name` . |
| |
| </TabItem> |
| <TabItem value="flink"> |
| |
| ```bash |
| source { |
| FakeSourceStream { |
| result_table_name = "fake" |
| field_name = "name,age" |
| } |
| } |
| ``` |
| |
| > The result of the data source `FakeSourceStream` will be registered as a temporary table named `fake` . This temporary table can be used by any `Transform` or `Sink` plugin by specifying `source_table_name` . |
| > |
| > `field_name` names the two columns of the temporary table `name` and `age` respectively. |
| |
| </TabItem> |
| </Tabs> |