Apache MADlib (Incubating)

Clone this repo:
  1. 0ed2faf Path: Update online help with overlapping patterns usage by Xiaocheng Tang · 1 year, 1 month ago master
  2. 3b1e67b Build: Add support for PG 9.5 and 9.6 by Satoshi Nagayasu · 1 year, 1 month ago
  3. 0151812 Path: Add examples to online help. by Nandish Jayaram · 1 year, 1 month ago
  4. 195ad64 Path: Add support for overlapping patterns by Xiaocheng Tang · 1 year, 1 month ago
  5. 628560a DT: Remove quote_ident due to mismatch in names by Rahul Iyer · 1 year, 1 month ago

MADlib® is an open-source library for scalable in-database analytics. It provides data-parallel implementations of mathematical, statistical and machine learning methods for structured and unstructured data.

Installation and Contribution

See the project webpage MADlib Home for links to the latest binary and source packages. For installation and contribution guides, please see MADlib Wiki

User and Developer Documentation

The latest documentation of MADlib modules can be found at MADlib Docs or can be accessed directly from the MADlib installation directory by opening doc/user/html/index.html.

Architecture

The following block-diagram gives a high-level overview of MADlib's architecture.

MADlib Architecture

Third Party Components

MADlib incorporates material from the following third-party components

  1. argparse 1.2.1 “provides an easy, declarative interface for creating command line tools”
  2. Boost 1.47.0 (or newer) “provides peer-reviewed portable C++ source libraries”
  3. Eigen 3.2.2 “is a C++ template library for linear algebra”
  4. PyYAML 3.10 “is a YAML parser and emitter for Python”
  5. PyXB 1.2.4 “is a Python library for XML Schema Bindings”

Licensing

License information regarding MADlib and included third-party libraries can be found inside the license directory.

Release Notes

Changes between MADlib versions are described in the ReleaseNotes.txt file.

Papers and Talks

Related Software

  • PivotalR - PivotalR also lets the user run the functions of the open-source big-data machine learning package MADlib directly from R.
  • PyMADlib - PyMADlib is a python wrapper for MADlib, which brings you the power and flexibility of python with the number crunching power of MADlib.