tree: 1f8352398fbc54aa679f883282b6d98333045548 [path history] [tgz]
  1. assemblies/
  2. images/
  3. impl/
  4. ui/
  5. pom.xml
  6. README.md
  7. README_zh.md
extension/kettle/README.md

kettle-plugin

  1. Download and install kettle Download: https://pentaho.com/download/#download-pentaho

After downloading, unzip it and run spoon.sh to start kettle.

You can also compile it yourself, refer to the compilation section

  1. Compile doris stream load plugin
cd doris/extension/kettle
mvn clean package -DskipTests

After the compilation is complete, unzip the plugin package and copy it to the plugins directory of kettle

cd assemblies/plugin/target
unzip doris-stream-loader-plugins-9.4.0.0-343.zip 
cp -r doris-stream-loader ${KETTLE_HOME}/plugins/
mvn clean package -DskipTests
  1. Build job Find Doris Stream Loader in Batch Loading in Kettle and build the job create.png

  2. Click Start to run the job to complete data synchronization running.png

  3. Configuration

KeyDefault ValueRequiredComment
Step name--YStep name
fenodes--YDoris FE http address, supports multiple addresses, separated by commas
DataBase--YDoris's write database
Table--YDoris's write table
User--YUsername to access Doris
Password--NPassword to access Doris
Maximum rows for load10000NMaximum number of rows to load at a time
Maximum bytes for load10485760(10MB)NMaximum size in bytes of a single load
Load retries3NNumber of retries after load failure
StreamLoad Properties--NStreamload http header for request