Google Git
Sign in
apache / seatunnel-web

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

Mirrored from https://github.com/apache/seatunnel-web.git
Clone this repo:

Branches

  1. 80db01c [Doc&Web] Improve readme add how to start seatunnel web (#51) by Eric · 3 weeks ago main
  2. 61bfaca [Feature] Add README and fix some bugs (#46) by Tyrantlucifer · 9 weeks ago
  3. 456e578 [Chore] Remove useless dependency (#45) by Tyrantlucifer · 9 weeks ago
  4. 6896be4 [Hotfix] Bugfix 2 (#42) by dijie · 3 months ago
  5. 9cb3169 Hotfix][UI] Fix warnings in the project. (#41) by songjianet · 3 months ago

Apache SeaTunnel (Incubating)

Backend Workflow Slack Twitter Follow

EN doc

SeaTunnel was formerly named Waterdrop , and renamed SeaTunnel since October 12, 2021.

So, What we are?

An open-source web console to manage your seatunnel-script, and would push them to any scheduling-system easily. Click it if your want to know more about our design. 👉🏻Design

How to start

1 Preparing the Apache DolphinScheduler environment

1.1 Install Apache DolphinScheduler

If you already have Apache DolphinScheduler environment, you can skip this step and go to [Create Tenant and User for SeaTunnel Web](#1.2 Create Tenant and User for SeaTunnel Web)

Because running SeaTunnel Web must rely on the DolphinScheduler, if you do not have a DS environment, you need to first install and deploy a DolphinScheduler (hereinafter referred to as DS). Taking DS version 3.1.5 as an example.

Reference https://dolphinscheduler.apache.org/zh-cn/docs/3.1.5/guide/installation/standalone to install a standalone DS.

1.2 Create Tenant and User for SeaTunnel Web

If you already have a DS environment and decide to use existing users and tenants for SeaTunnel Web, you can skip this step and go to [Create Project for SeaTunnel Web](#1.3 Create Project for SeaTunnel Web).

Because SeaTunnel Web needs to call the interface of DS to create workflows and tasks, it is necessary to submit the projects, users, and tenants created in DS for SeaTunnel to use.

  1. Create Tenant

“Security” -> “Tenant Manage” -> “Create Tenant”

image

  1. For simplicity, use the default user admin of DS directly here

1.3 Create Project for SeaTunnel Web

image

1.4 Create Token for SeaTunnel Web

image

2 Run SeaTunnel Web in IDEA

If you want to deploy and run SeaTunnel Web, Please turn to [3 Run SeaTunnel Web In Server](#3 Run SeaTunnel Web In Server)

2.1 Init database

  1. Edit whaletunnel-server/whaletunnel-app/src/main/resources/script/seatunnel_server_env.sh file, Complete the installed database address, port, username, and password. Here is an example:

    export HOSTNAME="localhost"
export PORT="3306"
export USERNAME="root"
export PASSWORD="123456"

  2. Run init shell sh seatunnel-server/seatunnel-app/src/main/resources/script/init_sql.sh If there are no errors during operation, it indicates successful initialization.

2.2 Config application and Run SeaTunnel Web Backend Server

  1. Edit seatunnel-server/seatunnel-app/src/main/resources/application.yml Fill in the database connection information and DS interface related information in the file.