jaytoday / prem-app Goto Github PK

View Code? Open in Web Editor NEW

This project forked from bit-gpt/app

0.0 0.0 0.0 5.73 MB

Prem provides a unified environment to develop AI applications and deploy AI models on your infrastructure

Home Page: https://premai.io

License: MIT License

Shell 0.68% JavaScript 0.62% Rust 2.97% TypeScript 82.71% CSS 12.71% HTML 0.24% Dockerfile 0.07%

prem-app's Introduction

🤖 Prem - Self Sovereign AI Infrastructure

Prem provides a unified environment to develop AI applications and deploy AI models on your infrastructure. Abstracting away all technical complexities for AI deployment and ushering in a new era of privacy-centric AI applications - users can finally retain control and ownership of their models.

🚀 Getting started

Install Prem on your MacOS (16GB+ RAM required) - Dowload the latest Prem App
Install Prem on your Linux sever (Ubuntu,Debian) - Installer script
Try out on the live demo instance - app.prem.ninja

Demo

ScreenStudio1App.mp4

Install on Linux

Install everything needed to run Prem on Ubuntu/Debian server

wget -q https://get.prem.ninja/install.sh -O install.sh; sudo bash ./install.sh

If you encounter issues or you want to build the Prem App docker image inside your Linux server

CPU

git clone https://github.com/premAI-io/prem-app.git
cd ./prem-app
docker-compose up -d

GPU (Nvidia)

git clone https://github.com/premAI-io/prem-app.git
cd ./prem-app
docker-compose up -f docker-compose.yml -f docker-compose.gpu.yml -d

Product Roadmap

The AI services expose an HTTP API interface, standardized for their interface type. For example, all models of type Chat expose the OpenAI API for easy of integration of existing tool and AI app ecosystem. Each service we support it's published on the Prem Registry.

Anyone can prepare, package and publish an AI service on Prem. Instructions coming soon.

Interfaces

Contributing

Run the app with Tauri

Make sure to remove any value in the .env file.

npm i
npm run tauri dev

Run the app with React

# run the daemon
docker-compose up -d premd

# copy .env.example file in .env
cp .env.example

npm i
npm run dev

Environment Variables

VITE_BACKEND_URL : destination of the premd
VITE_DESTINATION : browser | desktop
IS_PACKAGED : true | false used for server packaging.

Contributing to Prem Daemon

Running the Daemon locally

git clone https://github.com/premAI-io/prem-daemon.git
cd ./prem-daemon

# create a python virtual environment and activate it
virtualenv venv -p=3.10
source ./venv/bin/activate

# install the necessary dependencies
pip install -r requirements.txt

# configure pre-commit hooks
pre-commit install

# run the webserver
cp .env.example .env
python main.py

Mock Registry

In order to use the mock registry, you can specify the REGISTRY_URL environment variable as following:

PREM_REGISTRY_URL=https://raw.githubusercontent.com/premAI-io/prem-daemon/main/resources/mocks/manifests.json

The mock registry is not fully tested. Few interfaces could be broken.

Running the test cases

pytest

Release Checklist

Create a tag with the new version in prem-daemon
Update the version in prem-box here
Create a tag with the new version in prem-app
Update the version in prem-box here

Acknowledgments

Thank You ❤️

Recommend Projects