| <!DOCTYPE HTML> | |
| <!-- NewPage --> | |
| <html lang="en"> | |
| <head> | |
| <!-- Generated by javadoc --> | |
| <title>Overview (Apache SystemDS 3.4.0-SNAPSHOT API)</title> | |
| <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> | |
| <link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style"> | |
| <link rel="stylesheet" type="text/css" href="jquery/jquery-ui.min.css" title="Style"> | |
| <link rel="stylesheet" type="text/css" href="jquery-ui.overrides.css" title="Style"> | |
| <script type="text/javascript" src="script.js"></script> | |
| <script type="text/javascript" src="jquery/jszip/dist/jszip.min.js"></script> | |
| <script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils.min.js"></script> | |
| <!--[if IE]> | |
| <script type="text/javascript" src="jquery/jszip-utils/dist/jszip-utils-ie.min.js"></script> | |
| <![endif]--> | |
| <script type="text/javascript" src="jquery/jquery-3.6.1.min.js"></script> | |
| <script type="text/javascript" src="jquery/jquery-ui.min.js"></script> | |
| </head> | |
| <body> | |
| <script type="text/javascript"><!-- | |
| try { | |
| if (location.href.indexOf('is-external=true') == -1) { | |
| parent.document.title="Overview (Apache SystemDS 3.4.0-SNAPSHOT API)"; | |
| } | |
| } | |
| catch(err) { | |
| } | |
| //--> | |
| var pathtoroot = "./"; | |
| var useModuleDirectories = true; | |
| loadScripts(document, 'script');</script> | |
| <noscript> | |
| <div>JavaScript is disabled on your browser.</div> | |
| </noscript> | |
| <header role="banner"> | |
| <nav role="navigation"> | |
| <div class="fixedNav"> | |
| <!-- ========= START OF TOP NAVBAR ======= --> | |
| <div class="topNav"><a id="navbar.top"> | |
| <!-- --> | |
| </a> | |
| <div class="skipNav"><a href="#skip.navbar.top" title="Skip navigation links">Skip navigation links</a></div> | |
| <a id="navbar.top.firstrow"> | |
| <!-- --> | |
| </a> | |
| <ul class="navList" title="Navigation"> | |
| <li class="navBarCell1Rev">Overview</li> | |
| <li>Package</li> | |
| <li>Class</li> | |
| <li>Use</li> | |
| <li><a href="overview-tree.html">Tree</a></li> | |
| <li><a href="deprecated-list.html">Deprecated</a></li> | |
| <li><a href="index-all.html">Index</a></li> | |
| <li><a href="help-doc.html">Help</a></li> | |
| </ul> | |
| </div> | |
| <div class="subNav"> | |
| <ul class="navList" id="allclasses_navbar_top"> | |
| <li><a href="allclasses.html">All Classes</a></li> | |
| </ul> | |
| <ul class="navListSearch"> | |
| <li><label for="search">SEARCH:</label> | |
| <input type="text" id="search" value="search" disabled="disabled"> | |
| <input type="reset" id="reset" value="reset" disabled="disabled"> | |
| </li> | |
| </ul> | |
| <div> | |
| <script type="text/javascript"><!-- | |
| allClassesLink = document.getElementById("allclasses_navbar_top"); | |
| if(window==top) { | |
| allClassesLink.style.display = "block"; | |
| } | |
| else { | |
| allClassesLink.style.display = "none"; | |
| } | |
| //--> | |
| </script> | |
| <noscript> | |
| <div>JavaScript is disabled on your browser.</div> | |
| </noscript> | |
| </div> | |
| <a id="skip.navbar.top"> | |
| <!-- --> | |
| </a></div> | |
| <!-- ========= END OF TOP NAVBAR ========= --> | |
| </div> | |
| <div class="navPadding"> </div> | |
| <script type="text/javascript"><!-- | |
| $('.navPadding').css('padding-top', $('.fixedNav').css("height")); | |
| //--> | |
| </script> | |
| </nav> | |
| </header> | |
| <main role="main"> | |
| <div class="header"> | |
| <h1 class="title">Apache SystemDS 3.4.0-SNAPSHOT API</h1> | |
| </div> | |
| <div class="contentContainer"> | |
| <div class="block"><h1>SystemDS Architecture</h1> | |
| Algorithms in Apache SystemDS are written in a high-level R-like language called Declarative Machine learning Language (DML) | |
| or a high-level Python-like language called PyDML. | |
| SystemDS compiles and optimizes these algorithms into hybrid runtime | |
| plans of multi-threaded, in-memory operations on a single node (scale-up) and distributed Spark operations on | |
| a cluster of nodes (scale-out). SystemDS's high-level architecture consists of the following components: | |
| <h2>Language</h2> | |
| DML (with either R- or Python-like syntax) provides linear algebra primitives, a rich set of statistical | |
| functions and matrix manipulations, | |
| as well as user-defined and external functions, control structures including parfor loops, and recursion. | |
| The user provides the DML script through one of the following APIs: | |
| <ul> | |
| <li>Command-line interface ( <a href="org/apache/sysds/api/DMLScript.html" title="class in org.apache.sysds.api"><code>DMLScript</code></a> )</li> | |
| <li>Convenient programmatic interface for Spark users ( <a href="org/apache/sysds/api/mlcontext/MLContext.html" title="class in org.apache.sysds.api.mlcontext"><code>MLContext</code></a> )</li> | |
| <li>Java Machine Learning Connector API ( <a href="org/apache/sysds/api/jmlc/Connection.html" title="class in org.apache.sysds.api.jmlc"><code>Connection</code></a> )</li> | |
| </ul> | |
| <a href="org/apache/sysds/parser/ParserWrapper.html" title="class in org.apache.sysds.parser"><code>ParserWrapper</code></a> performs syntactic validation and | |
| parses the input DML script using ANTLR into a | |
| a hierarchy of <a href="org/apache/sysds/parser/StatementBlock.html" title="class in org.apache.sysds.parser"><code>StatementBlock</code></a> and | |
| <a href="org/apache/sysds/parser/Statement.html" title="class in org.apache.sysds.parser"><code>Statement</code></a> as defined by control structures. | |
| Another important class of the language component is <a href="org/apache/sysds/parser/DMLTranslator.html" title="class in org.apache.sysds.parser"><code>DMLTranslator</code></a> | |
| which performs live variable analysis and semantic validation. | |
| During that process we also retrieve input data characteristics -- i.e., format, | |
| number of rows, columns, and non-zero values -- as well as | |
| infrastructure characteristics, which are used for subsequent | |
| optimizations. Finally, we construct directed acyclic graphs (DAGs) | |
| of high-level operators ( <a href="org/apache/sysds/hops/Hop.html" title="class in org.apache.sysds.hops"><code>Hop</code></a> ) per statement block. | |
| <h2>Optimizer</h2> | |
| The SystemDS optimizer works over programs of HOP DAGs, where HOPs are operators on | |
| matrices or scalars, and are categorized according to their | |
| access patterns. Examples are matrix multiplications, unary | |
| aggregates like rowSums(), binary operations like cell-wise | |
| matrix additions, reorganization operations like transpose or | |
| sort, and more specific operations. We perform various optimizations | |
| on these HOP DAGs, including algebraic simplification rewrites ( <a href="org/apache/sysds/hops/rewrite/ProgramRewriter.html" title="class in org.apache.sysds.hops.rewrite"><code>ProgramRewriter</code></a> ), | |
| intra-/<a href="org/apache/sysds/hops/ipa/InterProceduralAnalysis.html" title="class in org.apache.sysds.hops.ipa"><code>InterProceduralAnalysis</code></a> | |
| for statistics propagation into functions and over entire programs, and | |
| operator ordering of matrix multiplication chains. We compute | |
| memory estimates for all HOPs, reflecting the memory | |
| requirements of in-memory single-node operations and | |
| intermediates. Each HOP DAG is compiled to a DAG of | |
| low-level operators ( <a href="org/apache/sysds/lops/Lop.html" title="class in org.apache.sysds.lops"><code>Lop</code></a> ) such as grouping and aggregate, | |
| which are backend-specific physical operators. Operator selection | |
| picks the best physical operators for a given HOP | |
| based on memory estimates, data, and cluster characteristics. | |
| Individual LOPs have corresponding runtime implementations, | |
| called instructions, and the optimizer generates | |
| an executable runtime program of instructions. | |
| <h2>Runtime</h2> | |
| We execute the generated runtime program locally | |
| in CP (control program), i.e., within a driver process. | |
| This driver handles recompilation, runs in-memory single-node | |
| <a href="org/apache/sysds/runtime/instructions/cp/CPInstruction.html" title="class in org.apache.sysds.runtime.instructions.cp"><code>CPInstruction</code></a> (some of which are multi-threaded ), | |
| maintains an in-memory buffer pool, and launches Spark jobs if the runtime plan contains distributed computations | |
| in the form of Spark instructions ( <a href="org/apache/sysds/runtime/instructions/spark/SPInstruction.html" title="class in org.apache.sysds.runtime.instructions.spark"><code>SPInstruction</code></a> ). | |
| For the Spark backend, we rely on Spark's lazy evaluation and stage construction. | |
| CP instructions may also be backed by GPU kernels ( <a href="org/apache/sysds/runtime/instructions/gpu/GPUInstruction.html" title="class in org.apache.sysds.runtime.instructions.gpu"><code>GPUInstruction</code></a> ). | |
| The multi-level buffer pool caches local matrices in-memory, | |
| evicts them if necessary, and handles data exchange between | |
| local and distributed runtime backends. | |
| The core of SystemDS's runtime instructions is an adaptive matrix block library, | |
| which is sparsity-aware and operates on the entire matrix in CP, or blocks of a matrix in a distributed setting. Further | |
| key features include parallel for-loops for task-parallel | |
| computations, and dynamic recompilation for runtime plan adaptation addressing initial unknowns.</div> | |
| </div> | |
| <div class="contentContainer"> | |
| <table class="overviewSummary"> | |
| <caption><span>Packages</span><span class="tabEnd"> </span></caption> | |
| <tr> | |
| <th class="colFirst" scope="col">Package</th> | |
| <th class="colLast" scope="col">Description</th> | |
| </tr> | |
| <tbody> | |
| <tr class="altColor" id="i0"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/api/package-summary.html">org.apache.sysds.api</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i1"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/api/jmlc/package-summary.html">org.apache.sysds.api.jmlc</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i2"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/api/mlcontext/package-summary.html">org.apache.sysds.api.mlcontext</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i3"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/common/package-summary.html">org.apache.sysds.common</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i4"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/conf/package-summary.html">org.apache.sysds.conf</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i5"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/package-summary.html">org.apache.sysds.hops</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i6"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/package-summary.html">org.apache.sysds.hops.codegen</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i7"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/cplan/package-summary.html">org.apache.sysds.hops.codegen.cplan</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i8"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/cplan/cuda/package-summary.html">org.apache.sysds.hops.codegen.cplan.cuda</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i9"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/cplan/java/package-summary.html">org.apache.sysds.hops.codegen.cplan.java</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i10"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/opt/package-summary.html">org.apache.sysds.hops.codegen.opt</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i11"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/codegen/template/package-summary.html">org.apache.sysds.hops.codegen.template</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i12"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/cost/package-summary.html">org.apache.sysds.hops.cost</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i13"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/estim/package-summary.html">org.apache.sysds.hops.estim</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i14"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/fedplanner/package-summary.html">org.apache.sysds.hops.fedplanner</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i15"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/ipa/package-summary.html">org.apache.sysds.hops.ipa</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i16"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/recompile/package-summary.html">org.apache.sysds.hops.recompile</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i17"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/hops/rewrite/package-summary.html">org.apache.sysds.hops.rewrite</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i18"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/lops/package-summary.html">org.apache.sysds.lops</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i19"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/lops/compile/package-summary.html">org.apache.sysds.lops.compile</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i20"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/lops/compile/linearization/package-summary.html">org.apache.sysds.lops.compile.linearization</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i21"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/lops/rewrite/package-summary.html">org.apache.sysds.lops.rewrite</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i22"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/parser/package-summary.html">org.apache.sysds.parser</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i23"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/parser/dml/package-summary.html">org.apache.sysds.parser.dml</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i24"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/resource/package-summary.html">org.apache.sysds.resource</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i25"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/resource/cost/package-summary.html">org.apache.sysds.resource.cost</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i26"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/resource/enumeration/package-summary.html">org.apache.sysds.resource.enumeration</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i27"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/package-summary.html">org.apache.sysds.runtime</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i28"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/codegen/package-summary.html">org.apache.sysds.runtime.codegen</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i29"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/package-summary.html">org.apache.sysds.runtime.compress</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i30"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/bitmap/package-summary.html">org.apache.sysds.runtime.compress.bitmap</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i31"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/cocode/package-summary.html">org.apache.sysds.runtime.compress.cocode</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i32"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/package-summary.html">org.apache.sysds.runtime.compress.colgroup</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i33"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/dictionary/package-summary.html">org.apache.sysds.runtime.compress.colgroup.dictionary</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i34"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/functional/package-summary.html">org.apache.sysds.runtime.compress.colgroup.functional</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i35"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/indexes/package-summary.html">org.apache.sysds.runtime.compress.colgroup.indexes</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i36"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/insertionsort/package-summary.html">org.apache.sysds.runtime.compress.colgroup.insertionsort</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i37"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/mapping/package-summary.html">org.apache.sysds.runtime.compress.colgroup.mapping</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i38"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/offset/package-summary.html">org.apache.sysds.runtime.compress.colgroup.offset</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i39"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/colgroup/scheme/package-summary.html">org.apache.sysds.runtime.compress.colgroup.scheme</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i40"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/cost/package-summary.html">org.apache.sysds.runtime.compress.cost</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i41"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/estim/package-summary.html">org.apache.sysds.runtime.compress.estim</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i42"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/estim/encoding/package-summary.html">org.apache.sysds.runtime.compress.estim.encoding</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i43"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/estim/sample/package-summary.html">org.apache.sysds.runtime.compress.estim.sample</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i44"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/io/package-summary.html">org.apache.sysds.runtime.compress.io</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i45"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/lib/package-summary.html">org.apache.sysds.runtime.compress.lib</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i46"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/plan/package-summary.html">org.apache.sysds.runtime.compress.plan</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i47"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/readers/package-summary.html">org.apache.sysds.runtime.compress.readers</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i48"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/utils/package-summary.html">org.apache.sysds.runtime.compress.utils</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i49"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/compress/workload/package-summary.html">org.apache.sysds.runtime.compress.workload</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i50"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/package-summary.html">org.apache.sysds.runtime.controlprogram</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i51"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/caching/package-summary.html">org.apache.sysds.runtime.controlprogram.caching</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i52"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/context/package-summary.html">org.apache.sysds.runtime.controlprogram.context</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i53"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/package-summary.html">org.apache.sysds.runtime.controlprogram.federated</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i54"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/compression/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.compression</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i55"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i56"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/controllers/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring.controllers</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i57"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/models/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring.models</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i58"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/repositories/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring.repositories</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i59"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/federated/monitoring/services/package-summary.html">org.apache.sysds.runtime.controlprogram.federated.monitoring.services</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i60"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/paramserv/package-summary.html">org.apache.sysds.runtime.controlprogram.paramserv</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i61"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/paramserv/dp/package-summary.html">org.apache.sysds.runtime.controlprogram.paramserv.dp</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i62"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/paramserv/homomorphicEncryption/package-summary.html">org.apache.sysds.runtime.controlprogram.paramserv.homomorphicEncryption</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i63"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/paramserv/rpc/package-summary.html">org.apache.sysds.runtime.controlprogram.paramserv.rpc</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i64"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/parfor/package-summary.html">org.apache.sysds.runtime.controlprogram.parfor</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i65"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/parfor/opt/package-summary.html">org.apache.sysds.runtime.controlprogram.parfor.opt</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i66"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/controlprogram/parfor/util/package-summary.html">org.apache.sysds.runtime.controlprogram.parfor.util</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i67"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/data/package-summary.html">org.apache.sysds.runtime.data</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i68"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/package-summary.html">org.apache.sysds.runtime.frame.data</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i69"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/columns/package-summary.html">org.apache.sysds.runtime.frame.data.columns</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i70"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/compress/package-summary.html">org.apache.sysds.runtime.frame.data.compress</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i71"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/iterators/package-summary.html">org.apache.sysds.runtime.frame.data.iterators</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i72"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/frame/data/lib/package-summary.html">org.apache.sysds.runtime.frame.data.lib</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i73"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/functionobjects/package-summary.html">org.apache.sysds.runtime.functionobjects</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i74"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/package-summary.html">org.apache.sysds.runtime.instructions</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i75"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/cp/package-summary.html">org.apache.sysds.runtime.instructions.cp</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i76"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/cpfile/package-summary.html">org.apache.sysds.runtime.instructions.cpfile</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i77"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/fed/package-summary.html">org.apache.sysds.runtime.instructions.fed</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i78"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/gpu/package-summary.html">org.apache.sysds.runtime.instructions.gpu</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i79"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/gpu/context/package-summary.html">org.apache.sysds.runtime.instructions.gpu.context</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i80"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/spark/package-summary.html">org.apache.sysds.runtime.instructions.spark</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i81"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/spark/data/package-summary.html">org.apache.sysds.runtime.instructions.spark.data</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i82"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/spark/functions/package-summary.html">org.apache.sysds.runtime.instructions.spark.functions</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i83"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/instructions/spark/utils/package-summary.html">org.apache.sysds.runtime.instructions.spark.utils</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i84"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/io/package-summary.html">org.apache.sysds.runtime.io</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i85"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/io/cog/package-summary.html">org.apache.sysds.runtime.io.cog</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i86"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/io/hdf5/package-summary.html">org.apache.sysds.runtime.io.hdf5</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i87"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/io/hdf5/message/package-summary.html">org.apache.sysds.runtime.io.hdf5.message</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i88"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/iogen/package-summary.html">org.apache.sysds.runtime.iogen</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i89"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/iogen/codegen/package-summary.html">org.apache.sysds.runtime.iogen.codegen</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i90"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/iogen/template/package-summary.html">org.apache.sysds.runtime.iogen.template</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i91"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/lineage/package-summary.html">org.apache.sysds.runtime.lineage</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i92"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/data/package-summary.html">org.apache.sysds.runtime.matrix.data</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i93"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/data/sketch/package-summary.html">org.apache.sysds.runtime.matrix.data.sketch</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i94"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/data/sketch/countdistinct/package-summary.html">org.apache.sysds.runtime.matrix.data.sketch.countdistinct</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i95"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/data/sketch/countdistinctapprox/package-summary.html">org.apache.sysds.runtime.matrix.data.sketch.countdistinctapprox</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i96"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/matrix/operators/package-summary.html">org.apache.sysds.runtime.matrix.operators</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i97"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/meta/package-summary.html">org.apache.sysds.runtime.meta</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i98"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/package-summary.html">org.apache.sysds.runtime.transform</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i99"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/decode/package-summary.html">org.apache.sysds.runtime.transform.decode</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i100"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/encode/package-summary.html">org.apache.sysds.runtime.transform.encode</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i101"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/meta/package-summary.html">org.apache.sysds.runtime.transform.meta</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i102"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/tokenize/package-summary.html">org.apache.sysds.runtime.transform.tokenize</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i103"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/tokenize/applier/package-summary.html">org.apache.sysds.runtime.transform.tokenize.applier</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i104"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/transform/tokenize/builder/package-summary.html">org.apache.sysds.runtime.transform.tokenize.builder</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i105"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/runtime/util/package-summary.html">org.apache.sysds.runtime.util</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="altColor" id="i106"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/utils/package-summary.html">org.apache.sysds.utils</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| <tr class="rowColor" id="i107"> | |
| <th class="colFirst" scope="row"><a href="org/apache/sysds/utils/stats/package-summary.html">org.apache.sysds.utils.stats</a></th> | |
| <td class="colLast"> </td> | |
| </tr> | |
| </tbody> | |
| </table> | |
| </div> | |
| </main> | |
| <footer role="contentinfo"> | |
| <nav role="navigation"> | |
| <!-- ======= START OF BOTTOM NAVBAR ====== --> | |
| <div class="bottomNav"><a id="navbar.bottom"> | |
| <!-- --> | |
| </a> | |
| <div class="skipNav"><a href="#skip.navbar.bottom" title="Skip navigation links">Skip navigation links</a></div> | |
| <a id="navbar.bottom.firstrow"> | |
| <!-- --> | |
| </a> | |
| <ul class="navList" title="Navigation"> | |
| <li class="navBarCell1Rev">Overview</li> | |
| <li>Package</li> | |
| <li>Class</li> | |
| <li>Use</li> | |
| <li><a href="overview-tree.html">Tree</a></li> | |
| <li><a href="deprecated-list.html">Deprecated</a></li> | |
| <li><a href="index-all.html">Index</a></li> | |
| <li><a href="help-doc.html">Help</a></li> | |
| </ul> | |
| </div> | |
| <div class="subNav"> | |
| <ul class="navList" id="allclasses_navbar_bottom"> | |
| <li><a href="allclasses.html">All Classes</a></li> | |
| </ul> | |
| <div> | |
| <script type="text/javascript"><!-- | |
| allClassesLink = document.getElementById("allclasses_navbar_bottom"); | |
| if(window==top) { | |
| allClassesLink.style.display = "block"; | |
| } | |
| else { | |
| allClassesLink.style.display = "none"; | |
| } | |
| //--> | |
| </script> | |
| <noscript> | |
| <div>JavaScript is disabled on your browser.</div> | |
| </noscript> | |
| </div> | |
| <a id="skip.navbar.bottom"> | |
| <!-- --> | |
| </a></div> | |
| <!-- ======== END OF BOTTOM NAVBAR ======= --> | |
| </nav> | |
| <p class="legalCopy"><small>Copyright © 2025 <a href="https://www.apache.org/">The Apache Software Foundation</a>. All rights reserved.</small></p> | |
| </footer> | |
| </body> | |
| </html> |