| commit | c0cd939bae6dcb06f3aa14e0a8e6cff473c15f5a | [log] [tgz] |
|---|---|---|
| author | Petrichor <xiaowenli@selectdb.com> | Mon Feb 17 14:50:39 2025 +0800 |
| committer | GitHub <noreply@github.com> | Mon Feb 17 14:50:39 2025 +0800 |
| tree | aff81dddfe6c84346abe94d36f6cf29a7817aae4 | |
| parent | 65184e7b37e325cb0f9d9e10f85dcab46d3ea566 [diff] |
[fix]avoid label conflict when setting labels in headers. (#25)
A robust, high-performance and user-friendly alternative to the traditional curl-based Stream Load.
doris-streamloader --source_file={FILE_LIST} --url={FE_OR_BE_SERVER_URL}:{PORT} --header={STREAMLOAD_HEADER} --db={TARGET_DATABASE} --table={TARGET_TABLE}
FILE_LIST: directory or file list, support * wildcardFE_OR_BE_SERVER_URL & PORT: Doris FE or BE hostname or IP and HTTP portSTREAMLOAD_HEADER: supports all headers as curl Stream Load does，multiple headers are separated by ‘?’TARGET_DATABASE & TARGET_TABLE: indicate the target database and table where the data will be loadede.g.:
doris-streamloader --source_file="data.csv" --url="http://localhost:8330" --header="column_separator:|?columns:col1,col2" --db="testdb" --table="testtbl"
For additional details and options, refer to our comprehensive docs below.
To build Streamloader, ensure you have golang installed (version >= 1.19.9). For example, on CentOS:
yum install golang
Then, navigate to the doris-streamloader directory and execute:
cd doris-streamloader && sh build.sh