blob: 483e80a1e4d65c499f793d09ff95359a93536e4d [file] [log] [blame]
<!--
-->
<!--
-->
<!DOCTYPE html>
<html lang="en">
<!--
-->
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<title>SystemML 0.9.0-incubating Release Notes</title>
<meta name="description" content="Project Release Notes">
<meta name="author" content="Apache SystemDS">
<!-- Enable responsive viewport -->
<meta name="HandheldFriendly" content="True">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<!-- You can use Open Graph tags to customize link previews.
Learn more: https://developers.facebook.com/docs/sharing/webmasters -->
<meta property="og:url" content="https://systemds.apache.org/" />
<meta property="og:type" content="website" />
<meta property="og:title" content="SystemML 0.9.0-incubating Release Notes" />
<meta property="og:description" content="Apache SystemDS is an open source ML system for the end-to-end data science lifecycle" />
<meta property="og:image" content="" />
<!-- Le HTML5 shim, for IE6-8 support of HTML elements -->
<!--[if lt IE 9]>
<script src="http://html5shim.googlecode.com/svn/trunk/html5.js"></script>
<![endif]-->
<!-- Le styles -->
<link rel="stylesheet" href="/assets/css/main.css">
<!-- favicons -->
<link rel="shortcut icon" href="/assets/img/favicon.png">
</head> <!-- META -->
<body class="vcard">
<!--
-->
<header class="site-header site-header--not-home">
<h1 class="logo"><a class="url" href="/"><i class="logo-mark"></i><span class="fn org">Apache SystemDS<sup
id="trademark">&trade;</sup></span></a></h1>
<nav class="main-nav">
<ul>
<li role="presentation">
<a href="/download" target="_self">Download</a>
</li>
<li role="presentation">
<a href="/get-started" target="_self">Get Started</a>
</li>
<li role="presentation">
<a class="nav-link--hover">Docs <i class="icon icon-chevron-down"></i></a>
<ul>
<li><a href="https://apache.github.io/systemds/" target="_blank">latest</a></li>
<li><a href="https://systemds.apache.org/docs/3.2.0/" target="_blank">3.2.0 (stable)</a></li>
<li><a href="https://systemds.apache.org/release-notes/systemds-release-notes-3.2.0" target="_blank">Release Notes 3.2.0</a></li>
</ul>
</li>
<li role="presentation">
<a class="nav-link--hover">Community <i class="icon icon-chevron-down"></i></a>
<ul>
<li><a href="/community" target="_self">Get Involved</a></li>
<li><a href="https://issues.apache.org/jira/browse/SYSTEMDS" target="_blank">Issue Tracker</a></li>
<li><a href="https://github.com/apache/systemds" target="_blank">Source Code</a></li>
<li><a href="https://github.com/apache/systemds-website" target="_blank">Website Source Code</a></li>
</ul>
</li>
<li role="presentation">
<a class="nav-link--hover">Apache <i class="icon icon-chevron-down"></i></a>
<ul>
<li><a href="https://www.apache.org/foundation/how-it-works" target="_blank">Apache Software Foundation</a></li>
<li><a href="https://www.apache.org/licenses/" target="_blank">Apache License</a></li>
<li><a href="https://www.apache.org/foundation/sponsorship" target="_blank">Sponsorship</a></li>
<li><a href="https://www.apache.org/foundation/thanks" target="_blank">Thanks</a></li>
<li><a href="/privacy-policy" target="_self">Privacy Policy</a></li>
<li><a href="/security" target="_self">Security</a></li>
</ul>
</li>
</ul>
</nav>
</header> <!-- GLOBAL HEADER -->
<!--
-->
<!--
-->
<div>
<!--
-->
<section class="full-stripe full-stripe--subpage-header clear-header">
<div class="ml-container ml-container--horizontally-center">
<div class="col col-12 content-group content-group--center-content content-group--center-align">
<h1>Apache SystemDS<sup id="trademark">&trade;</sup> 0.9.0-incubating Release Notes</h1>
</div>
</div>
</section>
<section class="full-stripe full-stripe--alternate">
<div class="ml-container">
<div class="col col-12 content-group content-group--medium-bottom-margin">
<p>Apache SystemML 0.9.0-incubating is the first release of SystemML since it joined Apache as an incubator project on November 2nd, 2015.</p>
<p>Extensive updates have been made to the project in several areas. These include APIs, data ingestion, optimizations, language and runtime operators, new algorithms, testing, and online documentation.</p>
<h3 id="apis">APIs</h3>
<ul>
<li>Improvements to MLContext and to MLPipeline wrappers</li>
</ul>
<h3 id="data-ingestion">Data Ingestion</h3>
<ul>
<li>Data conversion utilities (from RDDs and DataFrames)</li>
<li>Data transformations on raw data sets</li>
</ul>
<h3 id="optimizations">Optimizations</h3>
<ul>
<li>Extensions to compilation chain, including IPA</li>
<li>Improvements to parfor</li>
<li>Improved execution of concurrent Spark jobs</li>
<li>New rewrites, including eager RDD caching and repartitioning</li>
<li>Improvements to buffer pool caching</li>
<li>Partitioning-preserving operations</li>
<li>On-demand creation of SparkContext</li>
<li>Efficient use of RDD checkpointing</li>
</ul>
<h3 id="language-and-runtime-operators">Language and Runtime Operators</h3>
<ul>
<li>New matrix multiplication operators (e.g., ZipMM)</li>
<li>New multi-threaded readers and operators</li>
<li>Extended aggregation-outer operations for different relational operators</li>
<li>Sample capability</li>
</ul>
<h3 id="new-algorithms">New Algorithms</h3>
<ul>
<li>Alternating Least Squares (Conjugate Gradient)</li>
<li>Cubic Splines (Conjugate Gradient and Direct Solve)</li>
</ul>
<h3 id="testing">Testing</h3>
<ul>
<li>PyDML algorithm tests</li>
<li>Test suite refactoring</li>
<li>Improvements to performance tests</li>
</ul>
<h3 id="online-documentation">Online Documentation</h3>
<ul>
<li>GitHub README</li>
<li>Quick Start Guide</li>
<li>DML and PyDML Programming Guide</li>
<li>MLContext Programming Guide</li>
<li>Algorithms Reference</li>
<li>DML Language Reference</li>
<li>Debugger Guide</li>
</ul>
</div></div></section>
</div>
<!--
-->
<footer class="site-footer">
<div class="ml-container ml-container--horizontally-center">
<div class="footer-col-wrapper">
<div style="margin-top: 20px; margin-bottom: 20px;">
<a href="https://www.apache.org"><img src="/assets/img/apache-foundation-logo.png" alt="Apache Incubator" /></a>
</div>
<!--Footer copyright year update credit: http://updateyourfooter.com/-->
<div>
Copyright &copy; 2015
<script>new Date().getFullYear() > 2015 && document.write("-" + new Date().getFullYear());</script>
<a href="https://www.apache.org">The Apache Software Foundation</a>.
Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
<br>
Apache and the Apache Feather logo are trademarks of The Apache Software Foundation.
</div>
</div>
</div>
</footer> <!-- GLOBAL FOOTER-->
<script src="assets/js/bundle.min.js"></script>
</body>
</html>