tree: 31f3a35ea6eed71d16bfe0b643af2556853d8fe7 [path history] [tgz]
  1. .vscode/
  2. conf/
  3. dag/
  4. dlpredictor/
  5. docs/
  6. lib/
  7. logs/
  8. tests/
  9. LICENSE
  10. README.md
  11. requirements.txt
  12. run.sh
  13. setup.py
  14. VERSION.md
Processes/dlpredictor/README.md

What is dlpredictor?

dlpredictor is an offline processe to forecast traffic inventory.

Prerequisites

Cluster: Spark 2.3/HDFS 2.7/YARN 2.3/MapReduce 2.7/Hive 1.2 Driver: Python 3.6, Spark Client 2.3

To install dependencies run: pip install -r requirements.txt

Install and Run

  1. Download the blue-martin/dlpredictor project
  2. Transfer the dlpredictor directory to ~/code/dlpredictor on a machine which also has Spark Client.
  3. cd dlpredictor
  4. pip install -r requirements.txt (to install required packages)
  5. python setup.py install (to install predictor_dl_model package)
  6. Run run.sh

Documentation

Documentation is provided through comments in config.yml and README files