tree: dc3bb648945b99dcead3fbd417e6950098d0a016 [path history] [tgz]
  1. notebook.ipynb
  2. README.md
  3. requirements.txt
  4. run.py
  5. simple_etl.png
  6. simple_etl.py
examples/materialization/datasaver_dataloader_example/README.md

@datasaver and @dataloader example

This example shows you can use the @datasaver() and @dataloader() decorators to annotated functions that save and load data so that they can also return metadata.

This metadata is then exposed in the Apache Hamilton UI / inspectable by other adapters.

To run this example, you can use the following command:

  1. Install the requirements:
pip install -r requirements.txt
  1. Have the Apache Hamilton UI set up. See UI docs for instructions.
  2. You have modified the run.py / notebook to log to the right Apache Hamilton UI project.
  3. Run the example:
python run.py

or via the notebook.