tree: 21ec1e1ffac5617efa64f64cc3484638fbd96447
  1. data_loaders.py
  2. mydask.png
  3. README.md
  4. run.py
examples/dask/hello_world/README.md

Hamilton on Dask

Here we have a hello world example showing how you can take some Hamilton functions and then easily run them in a distributed setting via dask.

pip install sf-hamilton[dask-complete] or pip install sf-hamilton dask[complete] to for the right dependencies to run this example.

File organization:

  • business_logic.py houses logic that should be invariant to how hamilton is executed.
  • data_loaders.py houses logic to load data for the business_logic.py module. The idea is that you'd swap this module out for other ways of loading data.
  • run.py is the script that ties everything together.