Comments (6)
hi, can you specify what behaviour do you expect and what is wrong? what do you mean by "it said"?
what do you mean by the 3 lines below?
from whisper_streaming.
hi, can you specify what behaviour do you expect and what is wrong? what do you mean by "it said"?
what do you mean by the 3 lines below?
Thank you for your response. I'm using a Dockerfile to build my application, and I am encountering issues when specifying the model directory in the Dockerfile's CMD
instruction. Here's a clearer explanation of what I'm trying to achieve and the issues I'm facing:
I need to use a local model for Whisper rather than fetching it from a Hugging Face repository each time. However, when I attempt to specify the local model path, the application seems to insist on a Hugging Face repository path instead. Below are the variations of the CMD
instruction I tried, all of which resulted in errors indicating that a Hugging Face repository path is required:
-
Directly specifying the path to the model binary:
CMD ["python", "whisper_online_server.py", "--model_dir", "/app/models/faster-distil-whisper-large-v3/model.bin", "--backend", "faster-whisper"]
-
Attempting to use
--model_cache_dir
with the binary's path:CMD ["python", "whisper_online_server.py", "--model_cache_dir", "/app/models/faster-distil-whisper-large-v3/model.bin", "--backend", "faster-whisper"]
-
Using
--model_cache_dir
with just the directory path:CMD ["python", "whisper_online_server.py", "--model_cache_dir", "/app/models/faster-distil-whisper-large-v3", "--backend", "faster-whisper"]
Could you please provide guidance on how to correctly configure the Dockerfile to use a locally stored model? I'm looking to avoid repeated downloads from the internet due to bandwidth limitations.
Thank you for your assistance.
from whisper_streaming.
How could I rewrite this file?
FROM nvidia/cuda:12.0.0-cudnn8-runtime-ubuntu20.04
# 设置工作目录
WORKDIR /app
# 安装系统依赖和Python依赖
RUN apt-get update && apt-get install -y \
libsndfile1 \
python3.8 \
python3-pip \
git \
&&
pip install --no-cache-dir librosa soundfile av faster-whisper ctranslate2==3.24.0
# 克隆whisper_streaming仓库
RUN git clone https://github.com/ufal/whisper_streaming.git
# 切换到仓库目录
WORKDIR /app/whisper_streaming
# 暴露端口,如果有需要的话
EXPOSE 8000
# 运行whisper_streaming服务
CMD ["python", "whisper_online_server.py", "--backend", "faster-whisper"]
from whisper_streaming.
the application seems to insist on a Hugging Face repository path instead.
Can you specify from what evidence did you conclude this? What was the error or log message?
Could you please provide guidance on how to correctly configure the Dockerfile to use a locally stored model? I'm looking to avoid repeated downloads from the internet due to bandwidth limitations.
How could I rewrite this file?
I don't know., I can't help with Docker. Make it working inside docker, or locally, then put it to dockerfile.
Maybe you're confusing model.bin file for a dir where model.bin and other necessary files are located?
from whisper_streaming.
the application seems to insist on a Hugging Face repository path instead.
Can you specify from what evidence did you conclude this? What was the error or log message?
Could you please provide guidance on how to correctly configure the Dockerfile to use a locally stored model? I'm looking to avoid repeated downloads from the internet due to bandwidth limitations.
How could I rewrite this file?I don't know., I can't help with Docker. Make it working inside docker, or locally, then put it to dockerfile.
Maybe you're confusing model.bin file for a dir where model.bin and other necessary files are located?
Thank you for your help; I have solved the issue.
The problem was that it required an absolute path and the use of the --model_dir
parameter. The final command is:
CMD ["python3", "whisper_online_server.py", "--backend", "faster-whisper", "--host", "0.0.0.0", "--port", "41007", "--model", "large-v3", "--model_dir", "/app/models/faster-distil-whisper-large-v3"]
Thanks to your suggestion, I found the key to resolving the issue.
from whisper_streaming.
yes
from whisper_streaming.
Related Issues (20)
- Help to to run the program to transcirbe real time audio from mic HOT 1
- [BUG] Unnecessary socket re-creation inside with statement in whisper_online_server.py HOT 3
- Use of another backend HOT 2
- OpenAi Api not adding punctuation HOT 11
- OpenAI Whisper is not working anymore as a backend for whisper_streaming HOT 7
- Could this impletemented with micphone as voice input? HOT 1
- unexpected slow speed HOT 3
- [Quesion] about embedding whisper on deivce? HOT 1
- bilgi/ instructions notice learning HOT 2
- Server and Client for Web App HOT 1
- How to start the command correctly:whisper_online_server.py HOT 1
- Occasional Increasing Delay and Hallucination Issues HOT 5
- How to stream mic input on Windows? HOT 1
- can anyone tell me how to exactly run this project on windows from srarting as i dont know k=nothing how to run it HOT 1
- New Fork: Web client + WebSocket + own VAD impl. HOT 7
- Why does "whisper_online_server.py" close after I disconnect the client? HOT 3
- Getting this error on windows , any idea why ? HOT 1
- Cannot use finetuned model from huggingface HOT 4
- Unable to get sentences, only segments HOT 5
- t HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from whisper_streaming.