Comments (1)
Hello, thank you for reporting this issue in the LocalAI repository. I'm a bot, an experiment of @mudler, designed to help audit the tickets opened here.
Based on the information provided, we understand that you are experiencing an issue with the curl
command on your Mac when attempting to load a model using the LocalAI version 2.12.4 in Docker AMD64 emulation. You've noticed that using escaped double quotes instead of single quotes does not work on your Mac, while it does work on Ubuntu (WSL), as well as Windows cmd & PowerShell with different argument names, all against the same Windows WSL Docker with GPU & CUDA 12.
The error you're encountering is: {"error":{"code":500,"message":"could not load model: rpc error: code = Unavailable desc = error reading from server: EOF","type":""}}
. Meanwhile, Docker on PC displays successful loading of the model, and Docker on Mac shows a different model being loaded.
To help better investigate this issue, please provide the following information:
- Is there any specific reason you are using escaped double quotes instead of single quotes when running the
curl
command? - Are there any other command-line differences between your Mac and other environments that could potentially impact this process?
- Have you attempted reinstalling LocalAI or Docker on your Mac?
- Do you have any logs to share while running LocalAI in debug mode (
--debug
orDEBUG=true
)? This may help in understanding the problem better.
By providing these additional details, we'll be better equipped to assist you in resolving this issue. Please remember to avoid using any tool or external services to maintain the integrity of the audit process.
from localai.
Related Issues (20)
- Distributed Llama.cpp Inferencing option `llamacpp-worker` not working HOT 2
- animagine-xl not working on latest-cpu
- Site missing "WEBUI" info
- Chat WebUI stops updating HOT 1
- Rerank API not accessible: {"error":{"code":500,"message":"grpc service not ready","type":""}} HOT 1
- Parler-tts doesn't work when installed from gallery, documentation unhelpful
- coqui tts: change to better maintained fork HOT 2
- Transformers backend supports mps
- API appears to hang forever if a response is interrupted HOT 1
- support models from OCI registry
- Timeout
- add zsh/bash autocompletion to local-ai CLI
- Feature request: Request the ability to upload a private SSL certificate provided by a secure solution for downloading models HOT 1
- Feature request: Request the ability to upload a private SSL certificate provided by a secure solution for downloading models HOT 1
- Quickstart not working HOT 7
- model qwen2-7b-instruct HOT 6
- Branding
- do not depend on libraries installed with brew on macOS: include libraries in binary HOT 9
- Create translation
- Build from source failed on a mac (arm64) with protoc version mismatch. HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from localai.