tree: 865cbc2e4783726be79ffdfef4b0f82d296178d8 [path history] [tgz]
  1. components/
  2. data/
  3. adapters.py
  4. README.md
  5. requirements.txt
  6. run.py
examples/decoupling_io/README.md

Get started

This accompanies the blog post on decoupling IO from transformation: https://blog.dagworks.io/p/separate-data-io-from-transformation. To get started, you can run:

pip install -r requirements.txt
python run.py --help
Usage: run.py [OPTIONS] COMMAND [ARGS]...

Options:
  --help  Show this message and exit.

Commands:
  run
  visualize

Then you can pass it a stage and mess with the code.

You'll find sample data in data/, and the actual hamilton functions in components