Here we have a hello world example showing how you can take some Hamilton functions and then easily run them in a distributed setting via ray.
pip install sf-hamilton[ray] or pip install sf-hamilton ray to for the right dependencies to run this example.
File organization:
business_logic.py houses logic that should be invariant to how hamilton is executed.data_loaders.py houses logic to load data for the business_logic.py module. The idea is that you'd swap this module out for other ways of loading data.run.py is the script that ties everything together that uses vanilla Ray.run_rayworkflow.py is the script that again ties everything together, but this time uses Ray Workflows to execute.For the vanilla Ray implementation use:
python run.py
Here is the visualization of the execution:
For the Ray Workflow implementation use:
python run_rayworkflow.py