Google Git
Sign in
apache / beam-starter-python / refs/heads/main
commit5fccd912741faffffdb055f12fe347a037fba306[log] [tgz]
authorDanny McCormick <dannymccormick@google.com>Tue Apr 09 09:24:48 2024 -0400
committerGitHub <noreply@github.com>Tue Apr 09 09:24:48 2024 -0400
tree5494a967d3827fda93b90023de4e3c2685a7c7bc
parentde6f9d5619cbaec95694d17f564ce0881ed4a6fd [diff]
parent55d0feb0d01a37c82122fc69a3a9f2c23b9a13e7 [diff]
Merge pull request #31 from apache/dependabot/pip/apache-beam-2.55.1

Bump apache-beam from 2.55.0 to 2.55.1
tree: 5494a967d3827fda93b90023de4e3c2685a7c7bc
  1. .github/
  2. my_app/
  3. test/
  4. .gitignore
  5. CONTRIBUTING.md
  6. LICENSE
  7. main.py
  8. MANIFEST.in
  9. NOTICE
  10. README.md
  11. requirements.txt
  12. setup.py
README.md

Apache Beam starter for Python

If you want to clone this repository to start your own project, you can choose the license you prefer and feel free to delete anything related to the license you are dropping.

Before you begin

Make sure you have a Python 3 development environment ready. If you don't, you can download and install it from the Python downloads page.

We recommend using a virtual environment to isolate your project's dependencies.

# Create a new Python virtual environment.
python -m venv env

# Activate the virtual environment.
source env/bin/activate

While activated, your python and pip commands will point to the virtual environment, so any changes or install dependencies are self-contained.

As a one time setup, let‘s install the project’s dependencies from the requirements.txt file.

# It's always a good idea to update pip before installing dependencies.
pip install -U pip

# Install the project as a local package, this installs all the dependencies as well.
pip install -e .

ℹī¸ Once you are done, you can run the deactivate command to go back to your global Python installation.

Running the pipeline

Running your pipeline in Python is as easy as running the script file directly.

# You can run the script file directly.
python main.py

# To run passing command line arguments.
python main.py --input-text="🎉"

# To run the tests.
python -m unittest -v

GitHub Actions automated testing

This project already comes with automated testing via GitHub Actions.

To configure it, look at the .github/workflows/test.yaml file.

Using other runners

To keep this template small, it only includes the Direct Runner.

For a comparison of what each runner currently supports, look at the Beam Capability Matrix.

To add a new runner, visit the runner's page for instructions on how to include it.

Contributing

Thank you for your interest in contributing! All contributions are welcome! 🎉🎊

Please refer to the CONTRIBUTING.md file for more information.

License

This software is distributed under the terms of both the MIT license and the Apache License (Version 2.0).

See LICENSE for details.