Google Git
Sign in
apache / systemds / 941589cbf7436e5f3a1e9e7c2ecfeaf42b8c1746 / . / src / test / java / org / apache / sysds / performance
tree: 735fb821c5662d90ea9f18d732a0aa738266171a [path history] [tgz]
  1. compression/
  2. generators/
  3. matrix/
  4. micro/
  5. simple/
  6. Main.java
  7. PerfUtil.java
  8. README.md
  9. TimingUtils.java
src/test/java/org/apache/sysds/performance/README.md

Performance tests

To compile:

mvn package

Example of running it:

java -jar target/systemds-3.3.0-SNAPSHOT-perf.jar 1

example result of the above job:

Running Steam Compression Test
      StreamCompress  Repetitions: 100 GenMatrices rand(10000, 100, 32, 1.0) Seed: 42
               In Memory Block Size,    0.010+-  0.010 ms, 8000152.00
                Write Blocks Stream,   16.272+-  4.027 ms, 8000009.00
               Write Stream Deflate,  444.453+- 37.761 ms, 1037452.78
        Write Stream Deflate Speedy,  276.331+- 24.461 ms, 1362222.20
 In Memory Compress Individual (CI),   29.070+-  2.083 ms, 1041744.00
                    Write CI Stream,   31.607+-  1.722 ms, 1027621.00
            Write CI Deflate Stream,   63.826+-  1.693 ms,  655801.16
     Write CI Deflate Stream Speedy,   54.482+-  1.266 ms,  678390.92

With profiler:

java -jar -agentpath:$HOME/Programs/profiler/lib/libasyncProfiler.so=start,event=cpu,file=temp/log.html target/systemds-3.3.0-SNAPSHOT-perf.jar 12 10000 100 4 1.0 16 1000 -1

Take a Matrix and perform serialization

java -jar -agentpath:$HOME/Programs/profiler/lib/libasyncProfiler.so=start,event=cpu,file=temp/log.html target/systemds-3.3.0-SNAPSHOT-perf.jar 13 16 100 "temp/test.csv" -1

Take a Frame and transform into a Matrix and perform serialization.

java -jar -agentpath:$HOME/Programs/profiler/lib/libasyncProfiler.so=start,event=cpu,file=temp/log.html target/systemds-3.3.0-SNAPSHOT-perf.jar 14 16 1000 "src/test/resources/datasets/titanic/titanic.csv" "src/test/resources/datasets/titanic/tfspec.json" -1

Frame Operation timings

java -jar -agentpath:$HOME/Programs/profiler/lib/libasyncProfiler.so=start,event=cpu,file=temp/log.html target/systemds-3.3.0-SNAPSHOT-perf.jar 15 16 10 "src/test/resources/datasets/titanic/titanic.csv" "src/test/resources/datasets/titanic/tfspec.json"

Reshape Sparse

java -cp "target/systemds-3.3.0-SNAPSHOT-perf.jar:target/lib/*" -agentpath:$HOME/Programs/profiler/lib/libasyncProfiler.so=start,event=cpu,file=temp/log.html  org.apache.sysds.performance.Main 1005