commit | 79afa8badbbf6dc26a78ec41fff7e6292400a871 | [log] [tgz] |
---|---|---|
author | Jay Chung <zhongjiajie955@gmail.com> | Fri Nov 25 13:50:57 2022 +0800 |
committer | GitHub <noreply@github.com> | Fri Nov 25 13:50:57 2022 +0800 |
tree | e49dcad962d27873615c69b18f41cf1301a27b10 | |
parent | afdd923995f4947ec4a9ae8f1b6ff7e1964e5209 [diff] |
[ci] Avoid schedule event upload too many files to codecov (#29) codecov have 100 limit in each commit, and then if will failed the upload process, so we should not upload during schedule, because 6 day not change code base will reach the limit. see more detail in https://community.codecov.com/t/ci-failure-due-to-too-many-uploads-to-this-commit/2587/7
PyDolphinScheduler is python API for Apache DolphinScheduler, which allow you definition your workflow by python code, aka workflow-as-codes.
At Nov 7, 2022 we seperated PyDolphinScheduler from DolphinScheduler, and the version of PyDolphinScheduler 4.0.0 can match multiple versions of DolphinScheduler, for more details, please refer to version
# Install python -m pip install apache-dolphinscheduler # Verify installation is successful, it will show the version of apache-dolphinscheduler, here we use 0.1.0 as example pydolphinscheduler version # 0.1.0
NOTE: package apache-dolphinscheduler not work on above Python version 3.10(including itself) in Window operating system due to dependence py4j not work on those environments.
Here we show you how to install and run a simple example of pydolphinscheduler
Before you run an example, you have to start backend server. You could follow development setup section “DolphinScheduler Standalone Quick Start” to set up developer environment. You have to start backend and frontend server in this step, which mean that you could view DolphinScheduler UI in your browser with URL http://localhost:12345/dolphinscheduler
After backend server is being start, all requests from pydolphinscheduler
would be sent to backend server. And for now we could run a simple example by:
# Please make sure your terminal could curl https://raw.githubusercontent.com/apache/dolphinscheduler-sdk-python/main/src/pydolphinscheduler/examples/tutorial.py -o ./tutorial.py python ./tutorial.py
NOTICE: Since Apache DolphinScheduler's tenant is requests while running command, you might need to change tenant value in
example/tutorial.py
. For now the value istenant_exists
, please change it to username exists in you environment.
After command execute, you could see a new project with single workflow named tutorial in the UI-project list.
Until now, we finish quick start by an example of pydolphinscheduler and run it. If you want to inspect or join pydolphinscheduler develop, you could take a look at develop
If you are interested in how to release PyDolphinScheduler, you could go and see at release
For more detail information, please go to see PyDolphinScheduler latest(unreleased) document