Http source connector
Get data from http or https interface
:::tip
Engine Supported and plugin name
:::
name | type | required | default vale |
---|---|---|---|
url | string | yes | - |
method | string | no | GET |
header | string | no | |
request_params | string | no | |
sync_path | string | no |
HTTP request path, starting with http:// or https://.
HTTP request method, GET or POST, default GET.
HTTP request header, json format.
HTTP request parameters, json format. Use string with escapes to save json
HTTP multiple requests, the storage path of parameters used for synchronization (hdfs).
Source plugin common parameters, please refer to Source Plugin for details.
Http { url = "http://date.jsontest.com/" result_table_name= "response_body" }
According to the processing result of the http call, to determine whether the synchronization parameters need to be updated, it needs to be written to hdfs through the hdfs sink plugin after the judgment is made outside the http source plugin.