Golem Unlimited

Golem Unlimited utilizes trusted heterogeneous computing resources which are part time idle. It is meant for data center-like setup (e.g., render farms, or desktops within organisation LAN) where network participants trust each other, but it will also support trusted P2P subnetworks (e.g., distributed team machines).

It features the hub acting as a requestor and additional worker nodes in the hub’s trusted network acting as providers.

Trust within Golem Unlimited subnetwork allows simplifying its design and taking care of only the computation layer. Other components such as economic layers, reputation systems, verification algorithms, and sandboxing (in contrast to the public Golem Network) can be skipped altogether or implemented optionally.

Golem Unlimited joint resources can be used to perform tasks for internal requestor - the hub operator - with no fee. At the same time the hub will be able to expose its subordinate trusted providers to the public Golem Network. In such a setting hub will act as a provider and earn GNTs.

The latter broadens Golem Network reach, because it currently supports just single machine nodes. With Golem Unlimited it would allow more complex components, such as a whole subnetworks.

Golem Unlimited offers three execution environments:

host direct -- which does not provide any sandboxing, and requires application integrator to prepare binaries for every operating system
docker -- integrator needs to prepare single docker image with application
gWASM -- integrator needs to compile desired app to WASM target and conform to gWASM format

Use cases

Most current integration for Golem Unlimited is gwasm-runner which utlise gWASM execution environment and provides simplistic API that resembles map-reduce paradigm. It enables developers to easily implement simple applications and run them on top of the Golem Unlimited and also on Brass Golem 0.21 and later.

There are more integrations being prepared (outside Golem Unlimited team by with our support). To list a few:

gumpi - MPI implemented on top of Golem Unlimited, utilising docker execution environment
Hoard Compiler - Distributed C++ compiler for Visual Studio 2017 and 2019, which supports host direct mode only for Windows 10.

Initially we have prepared plugins for two use cases:

Integer factorization - a "Hello World" for Golem Unlimited
Mining - just to showcase the Golem Unlimited, not a industry grade minig solution

Here you can watch a short demo with above two: https://youtu.be/J0LBdg2j6Tk They are not maitained any more.

Installing and testing

Please bear in mind that Golem Unlimited is in its Alpha stage.

Hub

Currently we support Hub only on Ubuntu 16.04 LTS and later.

To install Hub you can use the released Ubuntu deb.

from source

To run Hub on other OS Plaforms refer the Hub README.

Provider

To install Provider you can use the released MacOs dmg, Windows msi or Ubuntu deb packages.

from source

See the Provider README for build instructions.

Usage

Both hub and provider can be configured via CLI. Invoke them with help command to see what's possible.

The hub comes also with web UI at:

http://<hub-ip>:61622/app/index.html

Project layout

ethkey: Ethereum keys management
gu-actix: small util crate defining flatten trait for ActixWeb future
gu-base: implementation of common parts of Provider and Hub servers
gu-event-bus: event-bus implementation - publish-subscribe communication between components
gu-hardware: discovery of hardware resources - GPU, disk space, RAM
gu-hub: binary of Hub server
gu-lan: mDNS services discovery
gu-net: network layer of the application
gu-persist: filesystem, persistent storage of files
gu-provider: binary of Provider service
gu-envman-api: data structures used in communication with execution enviroment component on provider side.

How to Contribute to Unlimited

Here you can find information in order to give us feedback and contribute to the project.

UI Plugin Manager

UI Plugin package format

ZIP file:

 [ / ]
  +-- gu-plugin.json
  +-- <plugin-name>
        +- app.js
        + .... other js and html files

gu-plugin.json

{
  "name": "Mining", // plugin name
  "version": "0.1.0", // plugin version
  "author": "...", // plugin version
  "description": "", // plugin description
  "gu-version-req": "*", // required golem unlimited app version
  "load": [ "app.js" ] // scripts to load on startup
}

Other fields should be ignored.

Role of the plugin manager

UC1: Plugin installation

with running server

$ gu-hub plugin install Mining.zip

Validate plugin package format.
Copy package to <work_dir>/plugins/
(optional) Add plugin to app config

UC2: List installed plugins

$ gu-hub plugin list

Expected result is table with columns:

plugin - plugin name
version - plugin version
status - active, installed, error

UC3: Uninstall a plugin

$ gu-hub plugin uninstall Mining

Serving metadata

GET /app/plug -> should return array or plugin metadata

GET /app/plug/<plugin-name>/<any-file-name>
Should return contents of file / in plugin package.

Suported mime-types:

*.js application/json
*.html text/html

golemfactory / golem-unlimited Goto Github PK

golem-unlimited's Introduction

Golem Unlimited

Use cases

Installing and testing

Hub

from source

Provider

from source

Usage

Project layout

How to Contribute to Unlimited

golem-unlimited's People

Contributors

Stargazers

Watchers

Forkers

golem-unlimited's Issues

UI Plugin package format

Role of the plugin manager

UC1: Plugin installation

UC2: List installed plugins

UC3: Uninstall a plugin

Serving metadata

Running in the foreground

Running in the background

Stopping server

Recommend Projects

Recommend Topics

Recommend Org