Coder Social home page Coder Social logo

Parallel ML System (PMLS) v1.1

To install PMLS, please refer to the PMLS wiki manual: http://docs.petuum.com/en/latest/

Website: http://sailing-lab.wixsite.com/sailing-pmls

For support, or to report bugs, please send email to [email protected]. Please provide your name and affiliation when requesting support; we do not support anonymous inquiries.

Overview

Parallel ML System (PMLS) is a distributed machine learning framework. It takes care of the difficult system "plumbing work", allowing you to focus on the ML. PMLS runs efficiently at scale on research clusters and cloud compute like Amazon EC2 and Google GCE.

PMLS provides essential distributed programming tools to tackle the challenges of running ML at scale: Big Data (many data samples) and Big Models (very large parameter and intermediate variable spaces). Unlike general-purpose distributed programming platforms, PMLS is designed specifically for ML algorithms. This means that PMLS takes advantage of data correlation, staleness, and other statistical properties to maximize the performance for ML algorithms, realized through core features such as Bösen, a bounded-asynchronous key-value store, and Strads, a scheduler for iterative ML computations.

In addition to distributed ML programming tools, PMLS comes with many distributed ML algorithms, all implemented on top of the PMLS framework for speed and scalability. Please refer to the PMLS documentation for a full listing: http://docs.petuum.com/en/latest

This repository contains the Bösen parameter server of PMLS. More details can be found in section 3.1 and 3.2 of our paper published in SoCC'15.

Petuum's Projects

adaptdl icon adaptdl

Resource-adaptive cluster scheduler for deep learning training.

autodist icon autodist

Simple Distributed Deep Learning on TensorFlow

gzsl_text icon gzsl_text

Code for Generalized Zero-Shot Text Classification for ICD Coding (IJCAI 2020)

nni icon nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

tuun icon tuun

Hyperparameter tuning via uncertainty modeling

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.