Google Git
Sign in
apache / dolphinscheduler-operator / 7a1abfbe1a8e680c97aef6cb0dad9d03deebc5b0
commit7a1abfbe1a8e680c97aef6cb0dad9d03deebc5b0[log] [tgz]
authorEric Gao <ericgao.apache@gmail.com>Tue Sep 20 11:43:33 2022 +0800
committerGitHub <noreply@github.com>Tue Sep 20 11:43:33 2022 +0800
tree2d96f3c9bbf452e6be61c5a456c31ef9219fe80d
parentc124cec509644caace139340e29849c1e877b0d9 [diff]
parent4c245933bf7178daba29bf8efe3dfe01e9f605df [diff]
Merge pull request #3 from caishunfeng/fix/readme

Fix README and add log
tree: 2d96f3c9bbf452e6be61c5a456c31ef9219fe80d
  1. .github/
  2. api/
  3. config/
  4. controllers/
  5. dist/
  6. hack/
  7. .dockerignore
  8. .gitignore
  9. .licenserc.yaml
  10. Dockerfile
  11. go.mod
  12. go.sum
  13. LICENSE
  14. main.go
  15. Makefile
  16. NOTICE
  17. PROJECT
  18. README.md
README.md

dolphinscheduler-operator

Features

  • Deploy and manage the master, worker, alert, api components.
  • Scale the Pod numbers with one commond.
  • Update the component's version (not include the database schema).

Project Status

Project status: alpha1

Current API version: v1alpha1

Get Started

  • Create a namespace ds
kubectl create namespace ds
  • Install PostgreSQL database (Optional)

If you don't have a running database, you can run

kubectl apply -f config/ds/postgreSQL

to create a demo database, note that this is only for demonstration, DO NOT use it in production environment. You need to replace the hostPath.path in postgres-pv.yaml if you don't have a directory /var/lib/data.

Connect to PostgreSQL and initialize the database schema by executing dolphinscheduler/dolphinscheduler-dao/src/main/resources/sql/dolphinscheduler_postgresql.sql.

  • Install zookeeper (Optional)

If you don't have a running zookeeper, the demo doployment file is in config/ds/zookeeper,

kubectl apply -f config/ds/zookeeper
  • Create pv and pvc (Optional)

If you have pv and pvc, you can config it in config/sameples.

Or you can create it with config/ds/ds-pv.yaml and config/ds/ds-pvc.yaml. Notice to replace the hostPath.path in ds-pv.yaml.

And you can mount the lib in dolphinscheduler /opt/soft in config/samples/ds_v1alpha1_dsworker.yaml with paramter named lib_pvc_name

Mount the logs in /opt/dolphinscheduler/logs with the pvcname named log_pvc_name.

query the status of worker

kubectl get dsworkers.ds.apache.dolphinscheduler.dev -n ds

api explain

kubectl explain dsmaster

how to test

how to deploy

export IMG=ghcr.io/apache/dolphinscheduler-operator:latest
make build && make manifests && make install && make deploy
  • Deploy the sample
cd config/samples
kubectl apply -f ds_v1alpha1_dsalert.yaml
kubectl apply -f ds_v1alpha1_dsapi.yaml -f ds_v1alpha1_dsmaster.yaml -f ds_v1alpha1_dsworker.yaml