remondethan / nitro Goto Github PK
View Code? Open in Web Editor NEWThis project forked from janhq/cortex
An inference server on top of llama.cpp. OpenAI-compatible API, queue, & scaling. Embed a prod-ready, local inference engine in your apps. Powers Jan
Home Page: https://nitro.jan.ai/
License: GNU Affero General Public License v3.0