An open source ML system for the end-to-end data science lifecycle

Clone this repo:
  1. b82911b Bump codecov/codecov-action from 7.0.0 to 7.1.1 (#2618) by dependabot[bot] · 26 hours ago main
  2. 9c3c8a1 [MINOR] Fix off-by-one in Spark CSV frame header writing (#2557) by t99-i · 26 hours ago
  3. 4ebbdae [SYSTEMDS-3972] Add differential privacy builtin functions as a new experimental feature. by Maya Anderson · 2 days ago
  4. b42b641 Bump codecov/codecov-action from 5.5.1 to 7.0.0 (#2612) by dependabot[bot] · 6 days ago
  5. c3a39f1 Bump actions/download-artifact from 6 to 8 (#2609) by dependabot[bot] · 6 days ago

Apache SystemDS

Overview: Apache SystemDS is an open-source machine learning (ML) system for the end-to-end data science lifecycle from data preparation and cleaning, over efficient ML model training, to debugging and serving. ML algorithms or pipelines are specified in a high-level language with R-like syntax or related Python and Java APIs (with many builtin primitives), and the system automatically generates hybrid runtime plans of local, in-memory operations and distributed operations on Apache Spark. Additional backends exist for GPUs and federated learning.

ResourceLinks
Quick StartInstall, Quick Start and Hello World
Documentation:SystemDS Documentation
Python DocumentationPython SystemDS Documentation
Issue TrackerJira Dashboard

Status and Build: SystemDS is renamed from SystemML which is an Apache Top Level Project. To build from source visit SystemDS Install from source

Build Documentation LicenseCheck Java Tests Java Coverage Python Test Python Coverage Total PyPI downloads Monthly PyPI downloads