Scripts to run SystemDS

This directory contains scripts to launch systemds.

Setting SYSTEMDS_ROOT environment variable

In order to run SystemDS from your development directory and leave the SystemDS files untouched, the following setup could be used (example for bash): The settings are the same if you download a release of SystemDS.

The following example works if you open an terminal at the root of the downloaded release, or a cloned repository. You can also change the $(pwd) with the full path to the folder.

export SYSTEMDS_ROOT=$(pwd)
export PATH=$SYSTEMDS_ROOT/bin:$PATH

It can be beneficial to enter these into your ~/.profile for linux, (but remember to change $(pwd to the full folder path) or your environment variables in windows to enable reuse between terminals and restarts.

Hello World example

To quickly verify that the system is setup correctly. You can run a simple hello world, using the launch script.

first open an terminal and go to an empty folder, then execute the following.

# Create a hello World script
echo 'print("HelloWorld!")' > hello.dml
# Execute hello world Script
systemds hello.dml
# Remove the hello.dml
rm hello.dml

Running a first example

To see SystemDS in action a simple example using the Univar-stats.dml script can be executed. This example is taken from the SystemML documentation. The relevant commands to run this example with SystemDS will be listed here. See their documentation for further details.

Example preparations

# download test data
wget -P data/ http://archive.ics.uci.edu/ml/machine-learning-databases/haberman/haberman.data

# generate a metadata file for the dataset
echo '{"rows": 306, "cols": 4, "format": "csv"}' > data/haberman.data.mtd

# generate type description for the data
echo '1,1,1,2' > data/types.csv
echo '{"rows": 1, "cols": 4, "format": "csv"}' > data/types.csv.mtd

Executing the DML script

bin/systemds Univar-Stats.dml -nvargs X=data/haberman.data TYPES=data/types.csv STATS=data/univarOut.mtx CONSOLE_OUTPUT=TRUE

Using Intel MKL native instructions

To use the MKL acceleration download and install the latest MKL library from 1, set the environment variables with the MKL-provided script $ compilervars.sh intel64 and set the option sysds.native.blas in SystemDS-config.xml.