content/release-notes/systemds-release-notes-3.0.0.html - systemds-website - Git at Google

 <!--

 -->
 <!--

 -->
 <!DOCTYPE html>
 <html lang="en">
   <!--

 -->

 <head>
   <meta charset="utf-8">
   <meta http-equiv="X-UA-Compatible" content="IE=edge">

   <title>SystemDS 3.0.0 Release Notes</title>

   <meta name="description" content="Project Release Notes">
   <meta name="author" content="Apache SystemDS">

   <!-- Enable responsive viewport -->
   <meta name="HandheldFriendly" content="True">
   <meta name="viewport" content="width=device-width, initial-scale=1.0">

   <!-- You can use Open Graph tags to customize link previews.
   Learn more: https://developers.facebook.com/docs/sharing/webmasters -->
   <meta property="og:url" content="https://systemds.apache.org/" />
   <meta property="og:type" content="website" />
   <meta property="og:title" content="SystemDS 3.0.0 Release Notes" />
   <meta property="og:description" content="Apache SystemDS is an open source ML system for the end-to-end data science lifecycle" />
   <meta property="og:image" content="" />

   <!-- Le HTML5 shim, for IE6-8 support of HTML elements -->
   <!--[if lt IE 9]>
   <script src="http://html5shim.googlecode.com/svn/trunk/html5.js"></script>
   <![endif]-->

   <!-- Le styles -->
   <link rel="stylesheet" href="/assets/css/main.css">

   <!-- favicons -->
   <link rel="shortcut icon" href="/assets/img/favicon.png">
 </head> <!-- META -->
   <body class="vcard">
     <!--

 -->
 <header class="site-header site-header--not-home">
   <h1 class="logo"><a class="url" href="/"><i class="logo-mark"></i><span class="fn org">Apache SystemDS<sup
           id="trademark">&trade;</sup></span></a></h1>
   <nav class="main-nav">
     <ul>

       <li role="presentation">


         <a href="/download" target="_self">Download</a>

       </li>

       <li role="presentation">


         <a href="/get-started" target="_self">Get Started</a>

       </li>

       <li role="presentation">

         <a class="nav-link--hover">Docs <i class="icon icon-chevron-down"></i></a>
         <ul>


           <li><a href="https://apache.github.io/systemds/" target="_blank">latest</a></li>


           <li><a href="https://systemds.apache.org/docs/3.2.0/" target="_blank">3.2.0 (stable)</a></li>


           <li><a href="https://systemds.apache.org/release-notes/systemds-release-notes-3.2.0" target="_blank">Release Notes 3.2.0</a></li>

         </ul>

       </li>

       <li role="presentation">

         <a class="nav-link--hover">Community <i class="icon icon-chevron-down"></i></a>
         <ul>


           <li><a href="/community" target="_self">Get Involved</a></li>


           <li><a href="https://issues.apache.org/jira/browse/SYSTEMDS" target="_blank">Issue Tracker</a></li>


           <li><a href="https://github.com/apache/systemds" target="_blank">Source Code</a></li>


           <li><a href="https://github.com/apache/systemds-website" target="_blank">Website Source Code</a></li>

         </ul>

       </li>

       <li role="presentation">

         <a class="nav-link--hover">Apache <i class="icon icon-chevron-down"></i></a>
         <ul>


           <li><a href="https://www.apache.org/foundation/how-it-works" target="_blank">Apache Software Foundation</a></li>


           <li><a href="https://www.apache.org/licenses/" target="_blank">Apache License</a></li>


           <li><a href="https://www.apache.org/foundation/sponsorship" target="_blank">Sponsorship</a></li>


           <li><a href="https://www.apache.org/foundation/thanks" target="_blank">Thanks</a></li>


           <li><a href="/privacy-policy" target="_self">Privacy Policy</a></li>


           <li><a href="/security" target="_self">Security</a></li>

         </ul>

       </li>

     </ul>
   </nav>
 </header> <!-- GLOBAL HEADER -->
     <!--

 -->
 <!--

 -->
 <div>
   <!--

 -->

 <section class="full-stripe full-stripe--subpage-header clear-header">
   <div class="ml-container ml-container--horizontally-center">
     <div class="col col-12 content-group content-group--center-content content-group--center-align">
       <h1>Apache SystemDS<sup id="trademark">&trade;</sup> 3.0.0 Release Notes</h1>
     </div>
   </div>
 </section>

 <section class="full-stripe full-stripe--alternate">
   <div class="ml-container">
     <div class="col col-12 content-group content-group--medium-bottom-margin">

       <h2 id="release-notes-for-systemds-300">Release notes for SystemDS 3.0.0</h2>

       <p>SystemDS 3.0 is a major release. This is the first release with Java 11 and Spark 3. Release 3.0 contains new features and major improvements to existing features.</p>

       <p>The major changes (compared to SystemDS 2.1/2.2) include:</p>
       <ul>
         <li>Federated Backend: Multi-tenancy support with tenants isolation and reuse of intermediates across tenants for federated workers. Compression support for federated workloads. Extended support for the cost-based federated planner, and various robustness and performance improvements.</li>
         <li>Full support for Top-K cleaning framework – A framework for automatically generating the top-K most effective data cleaning pipelines.</li>
         <li>Initial support for a Unified Memory Manager.</li>
         <li>CUDA code generation and operator fusion [Experimental]</li>
         <li>Robustness and performance improvements for Compressed Linear Algebra.</li>
         <li>Performance and usability improvements for multi-threaded feature transformations.</li>
         <li>Various new built-ins and apply functions for inference workloads.</li>
         <li>Miscellaneous Improvements: Python end-to-end tutorials, improved documentation, and better testing</li>
       </ul>
     </div></div></section>

 </div>


     <!--

 -->
 <footer class="site-footer">
   <div class="ml-container ml-container--horizontally-center">
     <div class="footer-col-wrapper">
       <div style="margin-top: 20px; margin-bottom: 20px;">
         <a href="https://www.apache.org"><img src="/assets/img/apache-foundation-logo.png" alt="Apache Incubator" /></a>
       </div>
       <!--Footer copyright year update credit: http://updateyourfooter.com/-->
       <div>
         Copyright &copy; 2015
         <script>new Date().getFullYear() > 2015 && document.write("-" + new Date().getFullYear());</script>
         <a href="https://www.apache.org">The Apache Software Foundation</a>.
         Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
         <br>
         Apache and the Apache Feather logo are trademarks of The Apache Software Foundation.
       </div>
     </div>
   </div>
 </footer> <!-- GLOBAL FOOTER-->
     <script src="assets/js/bundle.min.js"></script>
   </body>
 </html>
	<!--

	-->
	<!--

	-->
	<!DOCTYPE html>
	<html lang="en">
	<!--

	-->

	<head>
	<meta charset="utf-8">
	<meta http-equiv="X-UA-Compatible" content="IE=edge">

	<title>SystemDS 3.0.0 Release Notes</title>

	<meta name="description" content="Project Release Notes">
	<meta name="author" content="Apache SystemDS">

	<!-- Enable responsive viewport -->
	<meta name="HandheldFriendly" content="True">
	<meta name="viewport" content="width=device-width, initial-scale=1.0">

	<!-- You can use Open Graph tags to customize link previews.
	Learn more: https://developers.facebook.com/docs/sharing/webmasters -->
	<meta property="og:url" content="https://systemds.apache.org/" />
	<meta property="og:type" content="website" />
	<meta property="og:title" content="SystemDS 3.0.0 Release Notes" />
	<meta property="og:description" content="Apache SystemDS is an open source ML system for the end-to-end data science lifecycle" />
	<meta property="og:image" content="" />

	<!-- Le HTML5 shim, for IE6-8 support of HTML elements -->
	<!--[if lt IE 9]>
	<script src="http://html5shim.googlecode.com/svn/trunk/html5.js"></script>
	<![endif]-->

	<!-- Le styles -->
	<link rel="stylesheet" href="/assets/css/main.css">

	<!-- favicons -->
	<link rel="shortcut icon" href="/assets/img/favicon.png">
	</head> <!-- META -->
	<body class="vcard">
	<!--

	-->
	<header class="site-header site-header--not-home">
	<h1 class="logo"><a class="url" href="/"><i class="logo-mark"></i><span class="fn org">Apache SystemDS<sup
	id="trademark">™</sup></span></a></h1>
	<nav class="main-nav">
	<ul>

	<li role="presentation">


	<a href="/download" target="_self">Download</a>

	</li>

	<li role="presentation">


	<a href="/get-started" target="_self">Get Started</a>

	</li>

	<li role="presentation">

	<a class="nav-link--hover">Docs <i class="icon icon-chevron-down"></i></a>
	<ul>


	<li><a href="https://apache.github.io/systemds/" target="_blank">latest</a></li>


	<li><a href="https://systemds.apache.org/docs/3.2.0/" target="_blank">3.2.0 (stable)</a></li>


	<li><a href="https://systemds.apache.org/release-notes/systemds-release-notes-3.2.0" target="_blank">Release Notes 3.2.0</a></li>

	</ul>

	</li>

	<li role="presentation">

	<a class="nav-link--hover">Community <i class="icon icon-chevron-down"></i></a>
	<ul>


	<li><a href="/community" target="_self">Get Involved</a></li>


	<li><a href="https://issues.apache.org/jira/browse/SYSTEMDS" target="_blank">Issue Tracker</a></li>


	<li><a href="https://github.com/apache/systemds" target="_blank">Source Code</a></li>


	<li><a href="https://github.com/apache/systemds-website" target="_blank">Website Source Code</a></li>

	</ul>

	</li>

	<li role="presentation">

	<a class="nav-link--hover">Apache <i class="icon icon-chevron-down"></i></a>
	<ul>


	<li><a href="https://www.apache.org/foundation/how-it-works" target="_blank">Apache Software Foundation</a></li>


	<li><a href="https://www.apache.org/licenses/" target="_blank">Apache License</a></li>


	<li><a href="https://www.apache.org/foundation/sponsorship" target="_blank">Sponsorship</a></li>


	<li><a href="https://www.apache.org/foundation/thanks" target="_blank">Thanks</a></li>


	<li><a href="/privacy-policy" target="_self">Privacy Policy</a></li>


	<li><a href="/security" target="_self">Security</a></li>

	</ul>

	</li>

	</ul>
	</nav>
	</header> <!-- GLOBAL HEADER -->
	<!--

	-->
	<!--

	-->
	<div>
	<!--

	-->

	<section class="full-stripe full-stripe--subpage-header clear-header">
	<div class="ml-container ml-container--horizontally-center">
	<div class="col col-12 content-group content-group--center-content content-group--center-align">
	<h1>Apache SystemDS<sup id="trademark">™</sup> 3.0.0 Release Notes</h1>
	</div>
	</div>
	</section>

	<section class="full-stripe full-stripe--alternate">
	<div class="ml-container">
	<div class="col col-12 content-group content-group--medium-bottom-margin">

	<h2 id="release-notes-for-systemds-300">Release notes for SystemDS 3.0.0</h2>

	<p>SystemDS 3.0 is a major release. This is the first release with Java 11 and Spark 3. Release 3.0 contains new features and major improvements to existing features.</p>

	<p>The major changes (compared to SystemDS 2.1/2.2) include:</p>
	<ul>
	<li>Federated Backend: Multi-tenancy support with tenants isolation and reuse of intermediates across tenants for federated workers. Compression support for federated workloads. Extended support for the cost-based federated planner, and various robustness and performance improvements.</li>
	<li>Full support for Top-K cleaning framework – A framework for automatically generating the top-K most effective data cleaning pipelines.</li>
	<li>Initial support for a Unified Memory Manager.</li>
	<li>CUDA code generation and operator fusion [Experimental]</li>
	<li>Robustness and performance improvements for Compressed Linear Algebra.</li>
	<li>Performance and usability improvements for multi-threaded feature transformations.</li>
	<li>Various new built-ins and apply functions for inference workloads.</li>
	<li>Miscellaneous Improvements: Python end-to-end tutorials, improved documentation, and better testing</li>
	</ul>
	</div></div></section>

	</div>


	<!--

	-->
	<footer class="site-footer">
	<div class="ml-container ml-container--horizontally-center">
	<div class="footer-col-wrapper">
	<div style="margin-top: 20px; margin-bottom: 20px;">
	<a href="https://www.apache.org"><img src="/assets/img/apache-foundation-logo.png" alt="Apache Incubator" /></a>
	</div>
	<!--Footer copyright year update credit: http://updateyourfooter.com/-->
	<div>
	Copyright © 2015
	<script>new Date().getFullYear() > 2015 && document.write("-" + new Date().getFullYear());</script>
	<a href="https://www.apache.org">The Apache Software Foundation</a>.
	Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
	<br>
	Apache and the Apache Feather logo are trademarks of The Apache Software Foundation.
	</div>
	</div>
	</div>
	</footer> <!-- GLOBAL FOOTER-->
	<script src="assets/js/bundle.min.js"></script>
	</body>
	</html>