tree: 72851ece9f5edbcf3899adc6afd8659a74981338 [path history] [tgz]
  1. airflow/
  2. async/
  3. aws/
  4. caching_nodes/
  5. cli/
  6. contrib/
  7. dagster/
  8. dask/
  9. data_loaders/
  10. data_quality/
  11. dbt/
  12. decoupling_io/
  13. dlt/
  14. due_date_probabilities/
  15. experiment_management/
  16. feast/
  17. feature_engineering/
  18. hamilton-tutorials/
  19. hamilton_ui/
  20. hello_world/
  21. ibis/
  22. ibisml/
  23. jupyter_notebook_magic/
  24. kedro/
  25. lineage/
  26. LLM_Workflows/
  27. materialization/
  28. mlflow/
  29. model_examples/
  30. module_overrides/
  31. narwhals/
  32. numpy/
  33. openlineage/
  34. opentelemetry/
  35. pandas/
  36. parallelism/
  37. people_data_labs/
  38. plotly/
  39. polars/
  40. prefect/
  41. ray/
  42. reusing_functions/
  43. reverse_etl/
  44. schema/
  45. scikit-learn/
  46. slack/
  47. spark/
  48. streamlit/
  49. styling_visualization/
  50. vaex/
  51. validation/
  52. Dockerfile
  53. make_python_virtualenv.sh
  54. README.md
examples/README.md

Examples

Here you‘ll find various examples, some relatively simple, to a few that are more complex. As you can see there are MANY examples, that are mostly organized by a thematic topic that matches the folder name they’re in.

Note: hub.dagworks.io is also a good spot to find Hamilton examples.

If you have questions, or need help with these examples, join us on slack, and we'll try to help!

Running examples through a docker image

Examples could also be executed through a docker image which you can build or pull yourself. Each example directory inside docker image contains a hamilton-env Python virtual environment. hamilton-env environment contains all the dependencies required to run the example.

NOTE: If you already have the container image you can skip to container initialization (step 3).

  1. Change directory to examples.
cd hamilton/examples
  1. Build the container image.
docker build --tag hamilton-example .

Docker build takes around 6m16.298s depending on the system configuration and network. Alternatively, you can pull the container image from https://hub.docker.com/r/skrawcz/sf-hamilton. docker pull skrawcz/sf-hamilton.

  1. Starting the container. If you built it yourself:
docker run -it --rm --name hamilton-example hamilton-example

If you pulled it from dockerhub:

docker run -it --rm --name hamilton-example skrawcz/sf-hamilton

This will start the container and put you into a bash prompt.

  1. Start running examples. E.g. running the hello_world example inside the container:
cd hamilton/examples/hello_world
source hamilton-env/bin/activate  # this will activate the right python environment
python my_script.py
deactivate # this will deactivate the virtual environment so you can activate another

To run another example:

  1. change directory to it.
  2. activate the environment (source hamilton-env/bin/activate).
  3. run the code, e.g. python run.py.
  4. deactivate the environment (deactivate). And then exit to quit out of the running docker container.