Comments (1)
Update:
- As a new user, I can list all available engines with
cortex engines list
![image](https://private-user-images.githubusercontent.com/133622055/345359189-a8c7237a-bdf7-4442-bdcd-b8ff284ab23b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE0NjU4NjEsIm5iZiI6MTcyMTQ2NTU2MSwicGF0aCI6Ii8xMzM2MjIwNTUvMzQ1MzU5MTg5LWE4YzcyMzdhLWJkZjctNDQ0Mi1iZGNkLWI4ZmYyODRhYjIzYi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyMFQwODUyNDFaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT05MWJiOGNlNTJhYWYxNDBiZmZlZjk0MjI1ZmE5YjcxNTcxY2JiODgxYTY3YjJiYWM3MGFiN2JiYmU0YTMxNWZiJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.yFzopyfRFMH0Vaq0R1O-BKjD9PRc1v4ww9DCElEznYg)
- As a new user, I can install any engine with the engine name:
cortex engines init cortex.tensorrt-llm
![image](https://private-user-images.githubusercontent.com/133622055/345382835-f5190269-1ff4-4590-aedd-b2870824b329.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE0NjU4NjEsIm5iZiI6MTcyMTQ2NTU2MSwicGF0aCI6Ii8xMzM2MjIwNTUvMzQ1MzgyODM1LWY1MTkwMjY5LTFmZjQtNDU5MC1hZWRkLWIyODcwODI0YjMyOS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyMFQwODUyNDFaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1mNTMzNzI3MTc1NjFiNTVjMjI5MmFjYzRmZDNmNzFkYmE3YWUwOGIxODQ1ZDQyYTM5OWU3ZGY3MWUyN2Q4OTU4JlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.2QwF5RkeLinV5t0CZ2-YohlpWIKK8-j797PeT-Lf00s)
- When pulling or starting any model, if the engine is not initialized, it will be installed beforehand:
![image](https://private-user-images.githubusercontent.com/133622055/345387244-cc0faded-b95e-4362-99ec-5b1a2c115d9e.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE0NjU4NjEsIm5iZiI6MTcyMTQ2NTU2MSwicGF0aCI6Ii8xMzM2MjIwNTUvMzQ1Mzg3MjQ0LWNjMGZhZGVkLWI5NWUtNDM2Mi05OWVjLTViMWEyYzExNWQ5ZS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyMFQwODUyNDFaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1mYjRiZDNkNjBiYzRlZWE0ZjBjZDY2MTI4OWNhNGE4NGE0Zjk4ZWYwNTM1YzI0Y2JmODhhMjFjODllMmNhY2IyJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.LWNPgpzpIVpX_o1SMs9Qc9pgc8NuC6Ud3iYs3yL359w)
from nitro.
Related Issues (20)
- feat: Cortex supports Vulkan? HOT 1
- bug: CPU Info not found HOT 1
- Cortex Website: Some small nits
- epic: support tensorrt-llm batch manager
- feat: Support Anthropic engine HOT 1
- bug: cortex models should run -h by defaults HOT 1
- epic: Engine Compatibility Table
- feat: Better chat output - markdown support?
- feat: inline chat help? /?
- feat: show token speed on chat
- bug: cortex engines version is not correct
- feat: launch at system startup - auto run models - config schema
- feat: `cortex ps` with system resources information HOT 1
- feat: cortex-cpp node binding
- bug: Improvement for Cortex stdout
- bug: cortex is missing zlib.dll file
- feat: Add a section for the Cortex engines in README HOT 3
- bug: cortex v1/chat/completions endpoint is broken
- bug: telemetry creates weird user data folder path HOT 1
- bug: cortex embeddings or Chat could use a wrong active model when it is not pulled. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nitro.