tree: 187f880aa3bcadf17e1287f6973de46b09267068 [path history] [tgz]
  1. main.py
  2. README.md
  3. reusable_subdags.png
  4. reusable_subdags.py
  5. unique_users.py
examples/reusing_functions/README.md

subdag operator

This README demonstrates the use of the subdag operator.

The subdag operator allows you to effectively run a driver within a node. In this case, we are calculating unique website visitors from the following set of parameters:

  1. Region = CA (canada) or US (United States)
  2. Granularity of data = (day, week, month)

You can find the code in unique_users.py and reusable_subdags.py and look at how we run it in main.py.

Visualizing Execution

Here you can see the resulting shape of the DAG that will be executed:

reusable_subdags