tree: 2c67f50d3b275a2b784b2efd36df2696f0958dcd [path history] [tgz]
  1. _bin/
  2. _conf/
  3. _software/
  4. _workspace/
  5. README.md
  6. spark-sql-blazePlugin
dev/testenv/README.md

testenv

Setup an environment for testing spark-blaze-extension

step-1: download and install hadoop/hive/spark

run _software/download_and_install.sh

step-2: initialize and configure environment

run _bin/init-env.sh

step-3: startup environment

run _bin/run.sh start

step-4: try to execute a query with spark-sql

run source _bin/env.sh

run spark-sql -f _workspace/init_bigint_1m.q

step-5: try to execute a query with spark-sql + blaze extension

edit ./spark-sql-blazePlugin and set the correct path spark-blaze-extension and blaze-rs.

run ./spark-sql-blazePlugin -f _workspace/shuffle.q for testing.