Comments (4)
squidarth
commented on June 12, 2024
Hi @aus70! By best guess from the error message that you're seeing is that the Trussis running out of memory and then crashing. Could you try running this on a larger instance? You can change this via the UI on baseten.
I'll also look into improving the error message here.
from truss.
squidarth
commented on June 12, 2024
If you take a look at the "metrics" tab, you can see the CPU memory usage below
from truss.
aus70
commented on June 12, 2024
Memory was indeed the problem, I increased the RAM to 16GB (likely more than what's needed), and it works well. Thanks!
from truss.
squidarth
commented on June 12, 2024
no problem!
from truss.
Related Issues (20)
- Make CLI commands more beginner-friendly HOT 1
- Ensure `truss predict --published` gets the right version HOT 1
- Streaming -- validate user's responses
- local_data_dir in external_data should allow more than one level of directory HOT 3
- Docker Image for Linux/arm64 HOT 1
- Error out when python requirements conflict w/ base requirements
- Builds were broken for custom docker image
- Issue in starting Truss HOT 1
- GPU Inferencing using GGML HOT 1
- Truss Predict -d error HOT 2
- Can we specify custom .truss_ignore? HOT 2
- Verbose option for cli push command
- baseten python package HOT 3
- Small Bug : API key Prompt appearing only for first time when using truss push HOT 1
- truss push Error HOT 2
- pip install --upgrade truss not working HOT 9
- Config 'model_cache' type: Truss push expects a list while baseten docker build seems to expect a dict when using Google Cloud Storage HOT 3
- Can I deploy a Truss app on my own infra? HOT 3
- I follow the Quickstart to classify text but when I: $ truss predict -d '"Truss is awesome!"' . I get the error as follow, but when check log, it run normal HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from truss.