tree: 54a3c9f8975126306a27e878ca9c45e489ca9f63
  1. airflow/
  2. async/
  3. aws/
  4. caching_nodes/
  5. cli/
  6. contrib/
  7. dagster/
  8. dask/
  9. data_loaders/
  10. data_quality/
  11. dbt/
  12. decoupling_io/
  13. dlt/
  14. experiment_management/
  15. feast/
  16. feature_engineering/
  17. hamilton_ui/
  18. hello_world/
  19. ibis/
  20. ibisml/
  21. jupyter_notebook_magic/
  22. kedro/
  23. lineage/
  24. LLM_Workflows/
  25. materialization/
  26. model_examples/
  27. numpy/
  28. pandas/
  29. parallelism/
  30. people_data_labs/
  31. plotly/
  32. polars/
  33. prefect/
  34. ray/
  35. reusing_functions/
  36. scikit-learn/
  37. slack/
  38. spark/
  39. streamlit/
  40. styling_visualization/
  41. vaex/
  42. Dockerfile
  43. make_python_virtualenv.sh
  44. README.md
examples/README.md

Examples

Here you‘ll find various examples, some relatively simple, to a few that are more complex. As you can see there are MANY examples, that are mostly organized by a thematic topic that matches the folder name they’re in.

Note: hub.dagworks.io is also a good spot to find Hamilton examples.

If you have questions, or need help with these examples, join us on slack, and we'll try to help!

Running examples through a docker image

Examples could also be executed through a docker image which you can build or pull yourself. Each example directory inside docker image contains a hamilton-env Python virtual environment. hamilton-env environment contains all the dependencies required to run the example.

NOTE: If you already have the container image you can skip to container initialization (step 3).

  1. Change directory to examples.
cd hamilton/examples
  1. Build the container image.
docker build --tag hamilton-example .

Docker build takes around 6m16.298s depending on the system configuration and network. Alternatively, you can pull the container image from https://hub.docker.com/r/skrawcz/sf-hamilton. docker pull skrawcz/sf-hamilton.

  1. Starting the container. If you built it yourself:
docker run -it --rm --name hamilton-example hamilton-example

If you pulled it from dockerhub:

docker run -it --rm --name hamilton-example skrawcz/sf-hamilton

This will start the container and put you into a bash prompt.

  1. Start running examples. E.g. running the hello_world example inside the container:
cd hamilton/examples/hello_world
source hamilton-env/bin/activate  # this will activate the right python environment
python my_script.py
deactivate # this will deactivate the virtual environment so you can activate another

To run another example:

  1. change directory to it.
  2. activate the environment (source hamilton-env/bin/activate).
  3. run the code, e.g. python run.py.
  4. deactivate the environment (deactivate). And then exit to quit out of the running docker container.