[BUG] Transcription not working at all --- SOLVED --- about whishper

[mikele1976]

I've been able to use CPU on Debian 12 (install via docker), but GPU loads are now not appearing to work and fail straight away.

$ uname -a Linux tragicomix 6.4.0-0.deb12.2-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.4.4-3~bpo12+1 (2023-08-08) x86_64 GNU/Linux $ cat /etc/debian_version 12.4

Hi,
could you share your configuration files:
docker-compose-yml, nginx.conf and .env

thans

[mikele1976]

HI everyone,
i tried also with ferret option
docker-compose.override.yml, compiled with the command docker compose up -d --pull=always

version: "3.9"

services:
  postgres:
    image: postgres
    env_file:
      - .env
    environment:
      - POSTGRES_USER=${DB_USER:-whishper}
      - POSTGRES_PASSWORD=${DB_PASS:-whishper}
      - POSTGRES_DB=whishper
    volumes:
      - ./whishper_data/db_data/ferret:/var/lib/postgresql/data

  mongo:
    image: ghcr.io/ferretdb/ferretdb
    restart: on-failure
    expose:
      - 27017
    env_file:
      - .env
    environment:
      - FERRETDB_POSTGRESQL_URL=postgres://${DB_USER:-whishper}:${DB_PASS:-whishper}@postgres:5432/whishper
    command: ["--telemetry=disable"]

  whishper:
    environment:
      FERRETDB_ENABLED: "true"

and i got the same result, the web ui is working great but when i tried to use it nothing happens.

docker compose ps

NAME                     IMAGE                                  COMMAND
   SERVICE     CREATED         STATUS                   PORTS
whishper                 pluja/whishper:latest                  "supervisord -c /etc/supervisor/conf.d/supervisord.conf"   whishper    6 minutes ago   Up 6 minutes             3000/tcp, 5000/tcp, 8080/tcp, 0.0.0.0:8082->80/tcp, :::8082->80/tcp
whisper-libretranslate   libretranslate/libretranslate:latest   "./venv/bin/libretranslate --host 0.0.0.0"
   translate   6 minutes ago   Up 6 minutes (healthy)   5000/tcp
whsp-mongo-1             ghcr.io/ferretdb/ferretdb              "/ferretdb --telemetry=disable"
   mongo       6 minutes ago   Up 6 minutes             8080/tcp, 27017-27018/tcp
whsp-postgres-1          postgres                               "docker-entrypoint.sh postgres"
   postgres    6 minutes ago   Up 6 minutes             5432/tcp

I did this test in order to prove that it is not a matter related to a missing avx support .

[xvag]

I can confirm the exactly same behavior. Deployment done without errors, all logs are not showing any errors. It just doesn't do anything.
(Same issue I guess, here: #61)

[originade]

Same here. Running on Windows 11 with manual installation. I can see web UI but when uploading I get an error on the web UI (but no error in console) and then a "Waiting for transcription" on the file name after a moment, but no transcription occurs.

[vanderheyde]

Experiencing the same issue on Debian 11 using the quick install setup.

[tdobson]

I've been able to use CPU on Debian 12 (install via docker), but GPU loads are now not appearing to work and fail straight away.

$ uname -a
Linux tragicomix 6.4.0-0.deb12.2-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.4.4-3~bpo12+1 (2023-08-08) x86_64 GNU/Linux
$ cat /etc/debian_version
12.4

[zezretro]

I confirm the same behavior on debian 11. Fresh install via docker, once you click start the dialog does away and nothing happens.

Whishper logs don't show anything

Mongo logs show

WARNING: MongoDB 5.0+ requires a CPU with AVX support, and your current system does not appear to have that!

see https://jira.mongodb.org/browse/SERVER-54407

see also https://www.mongodb.com/community/forums/t/mongodb-5-0-cpu-intel-g4650-compatibility/116610/2

see also docker-library/mongo#485 (comment)

[tdobson]

Hi, could you share your configuration files: docker-compose-yml, nginx.conf and .env

Where will I find nginx.conf? Still finding my way around docker :)

here's my config files below, and also what I'm getting in my logs when I try to convert something with small, in english on GPU
https://pastebin.com/raw/c9TPP7JU

tdobson@tragicomix:~/dev/whispher$ cat .env
# Libretranslate Configuration
## Check out https://github.com/LibreTranslate/LibreTranslate#configuration-parameters for more libretranslate configuration options
LT_LOAD_ONLY=es,en,fr

# Whisper Configuration
WHISPER_MODELS=tiny,small
WHISHPER_HOST=http://127.0.0.1:8082

# Database Configuration
DB_USER=whishper
DB_PASS=whishper

tdobson@tragicomix:~/dev/whispher$ cat docker-compose.yml 
version: "3.9"

services:
  mongo:
    image: mongo
    env_file:
      - .env
    restart: unless-stopped
    volumes:
      - ./whishper_data/db_data:/data/db
      - ./whishper_data/db_data/logs/:/var/log/mongodb/
    environment:
      MONGO_INITDB_ROOT_USERNAME: ${DB_USER:-whishper}
      MONGO_INITDB_ROOT_PASSWORD: ${DB_PASS:-whishper}
    expose:
      - 27017
    command: ['--logpath', '/var/log/mongodb/mongod.log']

  translate:
    container_name: whisper-libretranslate
    image: libretranslate/libretranslate:latest-cuda
    restart: unless-stopped
    volumes:
      - ./whishper_data/libretranslate/data:/home/libretranslate/.local/share
      - ./whishper_data/libretranslate/cache:/home/libretranslate/.local/cache
    env_file:
      - .env
    user: root
    tty: true
    environment:
      LT_DISABLE_WEB_UI: True
      LT_LOAD_ONLY: ${LT_LOAD_ONLY:-en,fr,es}
      LT_UPDATE_MODELS: True
    expose:
      - 5000
    networks:
      default:
        aliases:
          - translate
    deploy:
      resources:
        reservations:
          devices:
          - driver: nvidia
            count: all
            capabilities: [gpu]

  whishper:
    pull_policy: always
    image: pluja/whishper:${WHISHPER_VERSION:-latest-gpu}
    env_file:
      - .env
    volumes:
      - ./whishper_data/uploads:/app/uploads
      - ./whishper_data/logs:/var/log/whishper
    container_name: whishper
    restart: unless-stopped
    networks:
      default:
        aliases:
          - whishper
    ports:
      - 8082:80
    depends_on:
      - mongo
      - translate
    environment:
      PUBLIC_INTERNAL_API_HOST: "http://127.0.0.1:80"
      PUBLIC_TRANSLATION_API_HOST: ""
      PUBLIC_API_HOST: ${WHISHPER_HOST:-}
      PUBLIC_WHISHPER_PROFILE: gpu
      WHISPER_MODELS_DIR: /app/models
      UPLOAD_DIR: /app/uploads
    deploy:
      resources:
        reservations:
          devices:
          - driver: nvidia
            count: all
            capabilities: [gpu]

[mikele1976]

Hi, could you share your configuration files: docker-compose-yml, nginx.conf and .env

Where will I find nginx.conf? Still finding my way around docker :)

Thnx for your reply, the nginx.conf should be int same folder of the docker-compose.yml.

here's my config files below, and also what I'm getting in my logs when I try to convert something with small, in english on GPU https://pastebin.com/raw/c9TPP7JU

after a close look to your file i think that you got it working because you are using the GPU version and not the CPU one.
thanks a lot and have a nice day.