| <!DOCTYPE HTML> |
| <!-- NewPage --> |
| <html lang="en"> |
| <head> |
| <!-- Generated by javadoc --> |
| <title>Overview (Apache SystemDS 3.2.0-SNAPSHOT API)</title> |
| <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> |
| <link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style"> |
| <link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style"> |
| <link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style"> |
| <script type="text/javascript" src="script.js"></script> |
| <script type="text/javascript" src="jquery/jszip/dist/jszip.min.js"></script> |
| <script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils.min.js"></script> |
| <!--[if IE]> |
| <script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script> |
| <![endif]--> |
| <script type="text/javascript" src="jquery/jquery-3.6.0.min.js"></script> |
| <script type="text/javascript" src="jquery/jquery-ui.min.js"></script> |
| </head> |
| <body> |
| <script type="text/javascript"><!-- |
| try { |
| if (location.href.indexOf('is-external=true') == -1) { |
| parent.document.title="Overview (Apache SystemDS 3.2.0-SNAPSHOT API)"; |
| } |
| } |
| catch(err) { |
| } |
| //--> |
| var pathtoroot = "./"; |
| var useModuleDirectories = true; |
| loadScripts(document, 'script');</script> |
| <noscript> |
| <div>JavaScript is disabled on your browser.</div> |
| </noscript> |
| <header role="banner"> |
| <nav role="navigation"> |
| <div class="fixedNav"> |
| <!-- ========= START OF TOP NAVBAR ======= --> |
| <div class="topNav"><a id="navbar.top"> |
| <!-- --> |
| </a> |
| <div class="skipNav"><a href="#skip.navbar.top" title="Skip navigation links">Skip navigation links</a></div> |
| <a id="navbar.top.firstrow"> |
| <!-- --> |
| </a> |
| <ul class="navList" title="Navigation"> |
| <li class="navBarCell1Rev">Overview</li> |
| <li>Package</li> |
| <li>Class</li> |
| <li>Use</li> |
| <li><a href="overview-tree.html">Tree</a></li> |
| <li><a href="deprecated-list.html">Deprecated</a></li> |
| <li><a href="index-all.html">Index</a></li> |
| <li><a href="help-doc.html">Help</a></li> |
| </ul> |
| </div> |
| <div class="subNav"> |
| <ul class="navList" id="allclasses_navbar_top"> |
| <li><a href="allclasses.html">All Classes</a></li> |
| </ul> |
| <ul class="navListSearch"> |
| <li><label for="search">SEARCH:</label> |
| <input type="text" id="search" value="search" disabled="disabled"> |
| <input type="reset" id="reset" value="reset" disabled="disabled"> |
| </li> |
| </ul> |
| <div> |
| <script type="text/javascript"><!-- |
| allClassesLink = document.getElementById("allclasses_navbar_top"); |
| if(window==top) { |
| allClassesLink.style.display = "block"; |
| } |
| else { |
| allClassesLink.style.display = "none"; |
| } |
| //--> |
| </script> |
| <noscript> |
| <div>JavaScript is disabled on your browser.</div> |
| </noscript> |
| </div> |
| <a id="skip.navbar.top"> |
| <!-- --> |
| </a></div> |
| <!-- ========= END OF TOP NAVBAR ========= --> |
| </div> |
| <div class="navPadding"> </div> |
| <script type="text/javascript"><!-- |
| $('.navPadding').css('padding-top', $('.fixedNav').css("height")); |
| //--> |
| </script> |
| </nav> |
| </header> |
| <main role="main"> |
| <div class="header"> |
| <h1 class="title">Apache SystemDS 3.2.0-SNAPSHOT API</h1> |
| </div> |
| <div class="contentContainer"> |
| <div class="block"><h1>SystemDS Architecture</h1> |
| Algorithms in Apache SystemDS are written in a high-level R-like language called Declarative Machine learning Language (DML) |
| or a high-level Python-like language called PyDML. |
| SystemDS compiles and optimizes these algorithms into hybrid runtime |
| plans of multi-threaded, in-memory operations on a single node (scale-up) and distributed Spark operations on |
| a cluster of nodes (scale-out). SystemDS's high-level architecture consists of the following components: |
| |
| <h2>Language</h2> |
| DML (with either R- or Python-like syntax) provides linear algebra primitives, a rich set of statistical |
| functions and matrix manipulations, |
| as well as user-defined and external functions, control structures including parfor loops, and recursion. |
| The user provides the DML script through one of the following APIs: |
| <ul> |
| <li>Command-line interface ( <a href="org/apache/sysds/api/DMLScript.html" title="class in org.apache.sysds.api"><code>DMLScript</code></a> )</li> |
| <li>Convenient programmatic interface for Spark users ( <a href="org/apache/sysds/api/mlcontext/MLContext.html" title="class in org.apache.sysds.api.mlcontext"><code>MLContext</code></a> )</li> |
| <li>Java Machine Learning Connector API ( <a href="org/apache/sysds/api/jmlc/Connection.html" title="class in org.apache.sysds.api.jmlc"><code>Connection</code></a> )</li> |
| </ul> |
| |
| <a href="org/apache/sysds/parser/ParserWrapper.html" title="class in org.apache.sysds.parser"><code>ParserWrapper</code></a> performs syntactic validation and |
| parses the input DML script using ANTLR into a |
| a hierarchy of <a href="org/apache/sysds/parser/StatementBlock.html" title="class in org.apache.sysds.parser"><code>StatementBlock</code></a> and |
| <a href="org/apache/sysds/parser/Statement.html" title="class in org.apache.sysds.parser"><code>Statement</code></a> as defined by control structures. |
| Another important class of the language component is <a href="org/apache/sysds/parser/DMLTranslator.html" title="class in org.apache.sysds.parser"><code>DMLTranslator</code></a> |
| which performs live variable analysis and semantic validation. |
| During that process we also retrieve input data characteristics -- i.e., format, |
| number of rows, columns, and non-zero values -- as well as |
| infrastructure characteristics, which are used for subsequent |
| optimizations. Finally, we construct directed acyclic graphs (DAGs) |
| of high-level operators ( <a href="org/apache/sysds/hops/Hop.html" title="class in org.apache.sysds.hops"><code>Hop</code></a> ) per statement block. |
| |
| <h2>Optimizer</h2> |
| The SystemDS optimizer works over programs of HOP DAGs, where HOPs are operators on |
| matrices or scalars, and are categorized according to their |
| access patterns. Examples are matrix multiplications, unary |
| aggregates like rowSums(), binary operations like cell-wise |
| matrix additions, reorganization operations like transpose or |
| sort, and more specific operations. We perform various optimizations |
| on these HOP DAGs, including algebraic simplification rewrites ( <a href="org/apache/sysds/hops/rewrite/ProgramRewriter.html" title="class in org.apache.sysds.hops.rewrite"><code>ProgramRewriter</code></a> ), |
| intra-/<a href="org/apache/sysds/hops/ipa/InterProceduralAnalysis.html" title="class in org.apache.sysds.hops.ipa"><code>InterProceduralAnalysis</code></a> |
| for statistics propagation into functions and over entire programs, and |
| operator ordering of matrix multiplication chains. We compute |
| memory estimates for all HOPs, reflecting the memory |
| requirements of in-memory single-node operations and |
| intermediates. Each HOP DAG is compiled to a DAG of |
| low-level operators ( <a href="org/apache/sysds/lops/Lop.html" title="class in org.apache.sysds.lops"><code>Lop</code></a> ) such as grouping and aggregate, |
| which are backend-specific physical operators. Operator selection |
| picks the best physical operators for a given HOP |
| based on memory estimates, data, and cluster characteristics. |
| Individual LOPs have corresponding runtime implementations, |
| called instructions, and the optimizer generates |
| an executable runtime program of instructions. |
| |
| <h2>Runtime</h2> |
| We execute the generated runtime program locally |
| in CP (control program), i.e., within a driver process. |
| This driver handles recompilation, runs in-memory single-node |
| <a href="org/apache/sysds/runtime/instructions/cp/CPInstruction.html" title="class in org.apache.sysds.runtime.instructions.cp"><code>CPInstruction</code></a> (some of which are multi-threaded ), |
| maintains an in-memory buffer pool, and launches Spark jobs if the runtime plan contains distributed computations |
| in the form of Spark instructions ( <a href="org/apache/sysds/runtime/instructions/spark/SPInstruction.html" title="class in org.apache.sysds.runtime.instructions.spark"><code>SPInstruction</code></a> ). |
| For the Spark backend, we rely on Spark's lazy evaluation and stage construction. |
| CP instructions may also be backed by GPU kernels ( <a href="org/apache/sysds/runtime/instructions/gpu/GPUInstruction.html" title="class in org.apache.sysds.runtime.instructions.gpu"><code>GPUInstruction</code></a> ). |
| The multi-level buffer pool caches local matrices in-memory, |
| evicts them if necessary, and handles data exchange between |
| local and distributed runtime backends. |
| The core of SystemDS's runtime instructions is an adaptive matrix block library, |
| which is sparsity-aware and operates on the entire matrix in CP, or blocks of a matrix in a distributed setting. Further |
| key features include parallel for-loops for task-parallel |
| computations, and dynamic recompilation for runtime plan adaptation addressing initial unknowns.</div> |
| </div> |
| <div class="contentContainer"> |
| <table class="overviewSummary"> |
| <caption><span>Packages</span><span class="tabEnd"> </span></caption> |
| <tr> |
| <th class="colFirst" scope="col">Package</th> |
| <th class="colLast" scope="col">Description</th> |
| </tr> |
| <tbody> |
| <tr class="altColor" id="i0"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/api/package-summary.html">org.apache.sysds.api</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i1"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/api/jmlc/package-summary.html">org.apache.sysds.api.jmlc</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i2"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/api/mlcontext/package-summary.html">org.apache.sysds.api.mlcontext</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i3"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/common/package-summary.html">org.apache.sysds.common</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i4"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/conf/package-summary.html">org.apache.sysds.conf</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i5"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/package-summary.html">org.apache.sysds.hops</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i6"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/package-summary.html">org.apache.sysds.hops.codegen</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i7"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/cplan/package-summary.html">org.apache.sysds.hops.codegen.cplan</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i8"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/cplan/cuda/package-summary.html">org.apache.sysds.hops.codegen.cplan.cuda</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i9"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/cplan/java/package-summary.html">org.apache.sysds.hops.codegen.cplan.java</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i10"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/opt/package-summary.html">org.apache.sysds.hops.codegen.opt</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i11"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/template/package-summary.html">org.apache.sysds.hops.codegen.template</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i12"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/cost/package-summary.html">org.apache.sysds.hops.cost</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i13"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/estim/package-summary.html">org.apache.sysds.hops.estim</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i14"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/fedplanner/package-summary.html">org.apache.sysds.hops.fedplanner</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i15"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/ipa/package-summary.html">org.apache.sysds.hops.ipa</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i16"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/recompile/package-summary.html">org.apache.sysds.hops.recompile</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i17"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/rewrite/package-summary.html">org.apache.sysds.hops.rewrite</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i18"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/lops/package-summary.html">org.apache.sysds.lops</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i19"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/lops/compile/package-summary.html">org.apache.sysds.lops.compile</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i20"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/lops/compile/linearization/package-summary.html">org.apache.sysds.lops.compile.linearization</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i21"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/lops/rewrite/package-summary.html">org.apache.sysds.lops.rewrite</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i22"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/parser/package-summary.html">org.apache.sysds.parser</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i23"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/parser/dml/package-summary.html">org.apache.sysds.parser.dml</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i24"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/package-summary.html">org.apache.sysds.runtime</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i25"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/codegen/package-summary.html">org.apache.sysds.runtime.codegen</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i26"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/package-summary.html">org.apache.sysds.runtime.compress</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i27"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/bitmap/package-summary.html">org.apache.sysds.runtime.compress.bitmap</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i28"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/cocode/package-summary.html">org.apache.sysds.runtime.compress.cocode</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i29"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/package-summary.html">org.apache.sysds.runtime.compress.colgroup</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i30"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/dictionary/package-summary.html">org.apache.sysds.runtime.compress.colgroup.dictionary</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i31"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/functional/package-summary.html">org.apache.sysds.runtime.compress.colgroup.functional</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i32"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/indexes/package-summary.html">org.apache.sysds.runtime.compress.colgroup.indexes</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i33"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/insertionsort/package-summary.html">org.apache.sysds.runtime.compress.colgroup.insertionsort</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i34"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/mapping/package-summary.html">org.apache.sysds.runtime.compress.colgroup.mapping</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i35"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/offset/package-summary.html">org.apache.sysds.runtime.compress.colgroup.offset</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i36"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/scheme/package-summary.html">org.apache.sysds.runtime.compress.colgroup.scheme</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i37"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/cost/package-summary.html">org.apache.sysds.runtime.compress.cost</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i38"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/estim/package-summary.html">org.apache.sysds.runtime.compress.estim</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i39"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/estim/encoding/package-summary.html">org.apache.sysds.runtime.compress.estim.encoding</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i40"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/estim/sample/package-summary.html">org.apache.sysds.runtime.compress.estim.sample</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i41"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/io/package-summary.html">org.apache.sysds.runtime.compress.io</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i42"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/lib/package-summary.html">org.apache.sysds.runtime.compress.lib</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i43"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/plan/package-summary.html">org.apache.sysds.runtime.compress.plan</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i44"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/readers/package-summary.html">org.apache.sysds.runtime.compress.readers</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i45"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/utils/package-summary.html">org.apache.sysds.runtime.compress.utils</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i46"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/workload/package-summary.html">org.apache.sysds.runtime.compress.workload</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i47"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/package-summary.html">org.apache.sysds.runtime.controlprogram</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i48"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/caching/package-summary.html">org.apache.sysds.runtime.controlprogram.caching</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i49"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/context/package-summary.html">org.apache.sysds.runtime.controlprogram.context</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i50"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/package-summary.html">org.apache.sysds.runtime.controlprogram.federated</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i51"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i52"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/controllers/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring.controllers</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i53"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/models/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring.models</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i54"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/repositories/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring.repositories</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i55"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/services/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring.services</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i56"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/paramserv/package-summary.html">org.apache.sysds.runtime.controlprogram.paramserv</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i57"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/paramserv/dp/package-summary.html">org.apache.sysds.runtime.controlprogram.paramserv.dp</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i58"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/paramserv/homomorphicEncryption/package-summary.html">org.apache.sysds.runtime.controlprogram.paramserv.homomorphicEncryption</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i59"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/paramserv/rpc/package-summary.html">org.apache.sysds.runtime.controlprogram.paramserv.rpc</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i60"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/parfor/package-summary.html">org.apache.sysds.runtime.controlprogram.parfor</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i61"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/parfor/opt/package-summary.html">org.apache.sysds.runtime.controlprogram.parfor.opt</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i62"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/parfor/stat/package-summary.html">org.apache.sysds.runtime.controlprogram.parfor.stat</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i63"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/parfor/util/package-summary.html">org.apache.sysds.runtime.controlprogram.parfor.util</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i64"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/data/package-summary.html">org.apache.sysds.runtime.data</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i65"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/package-summary.html">org.apache.sysds.runtime.frame.data</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i66"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/columns/package-summary.html">org.apache.sysds.runtime.frame.data.columns</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i67"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/compress/package-summary.html">org.apache.sysds.runtime.frame.data.compress</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i68"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/iterators/package-summary.html">org.apache.sysds.runtime.frame.data.iterators</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i69"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/lib/package-summary.html">org.apache.sysds.runtime.frame.data.lib</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i70"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/functionobjects/package-summary.html">org.apache.sysds.runtime.functionobjects</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i71"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/package-summary.html">org.apache.sysds.runtime.instructions</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i72"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/cp/package-summary.html">org.apache.sysds.runtime.instructions.cp</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i73"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/cpfile/package-summary.html">org.apache.sysds.runtime.instructions.cpfile</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i74"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/fed/package-summary.html">org.apache.sysds.runtime.instructions.fed</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i75"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/gpu/package-summary.html">org.apache.sysds.runtime.instructions.gpu</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i76"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/gpu/context/package-summary.html">org.apache.sysds.runtime.instructions.gpu.context</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i77"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/spark/package-summary.html">org.apache.sysds.runtime.instructions.spark</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i78"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/spark/data/package-summary.html">org.apache.sysds.runtime.instructions.spark.data</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i79"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/spark/functions/package-summary.html">org.apache.sysds.runtime.instructions.spark.functions</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i80"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/spark/utils/package-summary.html">org.apache.sysds.runtime.instructions.spark.utils</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i81"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/io/package-summary.html">org.apache.sysds.runtime.io</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i82"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/io/hdf5/package-summary.html">org.apache.sysds.runtime.io.hdf5</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i83"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/io/hdf5/message/package-summary.html">org.apache.sysds.runtime.io.hdf5.message</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i84"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/iogen/package-summary.html">org.apache.sysds.runtime.iogen</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i85"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/lineage/package-summary.html">org.apache.sysds.runtime.lineage</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i86"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/data/package-summary.html">org.apache.sysds.runtime.matrix.data</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i87"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/data/sketch/package-summary.html">org.apache.sysds.runtime.matrix.data.sketch</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i88"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/data/sketch/countdistinct/package-summary.html">org.apache.sysds.runtime.matrix.data.sketch.countdistinct</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i89"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/data/sketch/countdistinctapprox/package-summary.html">org.apache.sysds.runtime.matrix.data.sketch.countdistinctapprox</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i90"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/operators/package-summary.html">org.apache.sysds.runtime.matrix.operators</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i91"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/meta/package-summary.html">org.apache.sysds.runtime.meta</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i92"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/privacy/package-summary.html">org.apache.sysds.runtime.privacy</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i93"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/privacy/finegrained/package-summary.html">org.apache.sysds.runtime.privacy.finegrained</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i94"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/privacy/propagation/package-summary.html">org.apache.sysds.runtime.privacy.propagation</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i95"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/package-summary.html">org.apache.sysds.runtime.transform</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i96"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/decode/package-summary.html">org.apache.sysds.runtime.transform.decode</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i97"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/encode/package-summary.html">org.apache.sysds.runtime.transform.encode</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i98"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/meta/package-summary.html">org.apache.sysds.runtime.transform.meta</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i99"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/tokenize/package-summary.html">org.apache.sysds.runtime.transform.tokenize</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i100"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/tokenize/applier/package-summary.html">org.apache.sysds.runtime.transform.tokenize.applier</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i101"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/tokenize/builder/package-summary.html">org.apache.sysds.runtime.transform.tokenize.builder</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i102"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/util/package-summary.html">org.apache.sysds.runtime.util</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="rowColor" id="i103"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/utils/package-summary.html">org.apache.sysds.utils</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| <tr class="altColor" id="i104"> |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/utils/stats/package-summary.html">org.apache.sysds.utils.stats</a></th> |
| <td class="colLast"> </td> |
| </tr> |
| </tbody> |
| </table> |
| </div> |
| </main> |
| <footer role="contentinfo"> |
| <nav role="navigation"> |
| <!-- ======= START OF BOTTOM NAVBAR ====== --> |
| <div class="bottomNav"><a id="navbar.bottom"> |
| <!-- --> |
| </a> |
| <div class="skipNav"><a href="#skip.navbar.bottom" title="Skip navigation links">Skip navigation links</a></div> |
| <a id="navbar.bottom.firstrow"> |
| <!-- --> |
| </a> |
| <ul class="navList" title="Navigation"> |
| <li class="navBarCell1Rev">Overview</li> |
| <li>Package</li> |
| <li>Class</li> |
| <li>Use</li> |
| <li><a href="overview-tree.html">Tree</a></li> |
| <li><a href="deprecated-list.html">Deprecated</a></li> |
| <li><a href="index-all.html">Index</a></li> |
| <li><a href="help-doc.html">Help</a></li> |
| </ul> |
| </div> |
| <div class="subNav"> |
| <ul class="navList" id="allclasses_navbar_bottom"> |
| <li><a href="allclasses.html">All Classes</a></li> |
| </ul> |
| <div> |
| <script type="text/javascript"><!-- |
| allClassesLink = document.getElementById("allclasses_navbar_bottom"); |
| if(window==top) { |
| allClassesLink.style.display = "block"; |
| } |
| else { |
| allClassesLink.style.display = "none"; |
| } |
| //--> |
| </script> |
| <noscript> |
| <div>JavaScript is disabled on your browser.</div> |
| </noscript> |
| </div> |
| <a id="skip.navbar.bottom"> |
| <!-- --> |
| </a></div> |
| <!-- ======== END OF BOTTOM NAVBAR ======= --> |
| </nav> |
| <p class="legalCopy"><small>Copyright © 2023 <a href="https://www.apache.org/">The Apache Software Foundation</a>. All rights reserved.</small></p> |
| </footer> |
| </body> |
| </html> |
