tree: 2ce8dabe624447f9c8f6f1a8482e6a700df46cf8 [path history] [tgz]
  1. components/
  2. data/
  3. adapters.py
  4. README.md
  5. requirements.txt
  6. run.py
examples/decoupling_io/README.md

Get started

This accompanies the blog post on decoupling IO from transformation: https://blog.dagworks.io/p/separate-data-io-from-transformation. To get started, you can run:

pip install -r requirements.txt
python run.py --help
Usage: run.py [OPTIONS] COMMAND [ARGS]...

Options:
  --help  Show this message and exit.

Commands:
  run
  visualize

Then you can pass it a stage and mess with the code.

You'll find sample data in data/, and the actual hamilton functions in components