tree: b1018a1cc94d4f288cc44748a6c16954b2590017 [path history] [tgz]
  1. README.md
  2. amlogparser.py
  3. swimlane.py
  4. yarn-swimlanes.sh
tez-tools/swimlanes/README.md

Swimlanes

This is a performance and post-hoc analysis tool for Apache Tez which uses the log lines printed during execution to draw a diagram which represents each container allocated with a horizontal lane, where each task is represented as a section of the lane.

Currently, the tool only works for successfully completed DAGs and does not have much way of representing failures or data dependency in the diagram.

The data output format is SVG, which also includes clickable links back to the history logs of each task for further debugging, after a slow task has been located.

To use the tool, run

./yarn-swimlanes.sh application_..._..

This will generate an svg named the same as the application ID.

For more information on using this tool visit - the tez wiki.