netease-youdao / qanything Goto Github PK

View Code? Open in Web Editor NEW

10.4K 10.4K 994.0 94.29 MB

Question and Answer based on Anything.

Home Page: https://qanything.ai

License: Apache License 2.0

Python 80.03% Shell 18.67% Dockerfile 1.30%

qanything's People

Contributors

Stargazers

Watchers

Forkers

liwenju0 onmygame zinjoyce clarence5 asmoker itsliupeng phpcws bitcodepot jmaigc xiesiyang sholway ai-jie01 e024 strategist922 ai-mou flowerjunjie knightcn1983 liuxiaocs7 chaizhongming lizeyuan-z angelzhan carlziess tyrozhang lihuibng ecafe8 qingkongzhiqian devon-ye jsoncode superguy021 jangocheng kerneltravel ganjunhong alleniver linecode kou-bin gshan4056 mqlww zhoumz123 poeticmedia wjmboss yangbaoquan youndoldman mmyuan1020 mofancity itsharex brding-rookie huiguyy blackwhites techthiyanes gerrampard liudunxu oiunt zineos jlchen4 fsinbad rollingmydice young17 fwing1987 loveritsu929re hljxiaojiang liucr kekewind quduoduo zollty chaoa yubobo yidahu fanqi dony1031 fangcao1314 gcxamy hanky111 rainsongsky dxcarl ericsongyl road2018 leeeex louhongyu sasukegu xunnew leetsen alanmoleapfive johnson7788 jfanfung quantjia nanqiai issone wwwcodelovecn huguanglong yshulin fswzb ciertou m13810859213 skyzhao3q alex-ibb steveyg pikachule thinking-and-coding jjim180730 gaojing8500

qanything's Issues

请问微调后的llm是基于的千问模型的参数是多少？

如题，请问是几B参数的模型

[BUG] npm run install报错failed to install npm dependencies

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

run_for_local.sh 脚本1/8-4/8项均正常启动，在5/8报错，应该是node的有个依赖包无法安装：

2118 timing command:install Completed in 45793ms
2119 verbose stack Error: command failed
2119 verbose stack at ChildProcess. (/usr/local/lib/nodejs/node-v18.19.0-linux-x64/lib/node_modules/npm/node_modules/@npmcli/promis
e-spawn/lib/index.js:53:27)
2119 verbose stack at ChildProcess.emit (node:events:517:28)
2119 verbose stack at maybeClose (node:internal/child_process:1098:16)
2119 verbose stack at ChildProcess._handle.onexit (node:internal/child_process:303:5)
2120 verbose pkgid [email protected]
2121 verbose cwd /workspace/qanything_local/front_end
2122 verbose Linux 3.10.0-1160.el7.x86_64
2123 verbose node v18.19.0
2124 verbose npm v10.2.3
2125 error code 1
2126 error path /workspace/qanything_local/front_end/node_modules/esbuild
2127 error command failed
2128 error command sh -c node install.js
2129 error node:internal/errors:865
2129 error const err = new Error(message);
2129 error ^
2129 error
2129 error Error: Command failed: /workspace/qanything_local/front_end/node_modules/esbuild/bin/esbuild --version
2129 error at checkExecSyncError (node:child_process:890:11)
2129 error at Object.execFileSync (node:child_process:926:15)
2129 error at validateBinaryVersion (/workspace/qanything_local/front_end/node_modules/esbuild/install.js:99:28)
2129 error at /workspace/qanything_local/front_end/node_modules/esbuild/install.js:286:5 {
2129 error status: null,
2129 error signal: 'SIGSEGV',
2129 error output: [ null, Buffer(0) [Uint8Array] [], Buffer(0) [Uint8Array] [] ],
2129 error pid: 2003,
2129 error stdout: Buffer(0) [Uint8Array] [],
2129 error stderr: Buffer(0) [Uint8Array] []
2129 error }
2129 error
2129 error Node.js v18.19.0
2130 verbose exit 1
2131 timing npm Completed in 46052ms

期望行为 | Expected Behavior

正确启动

运行环境 | Environment

- OS: CentOS 7.9
- NVIDIA Driver:535.129.03
- CUDA:12.2
- Docker Compose: 2.24.1
- NVIDIA GPU Memory: 24G+24G

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

[BUG] qanything-container-local容器里的sanic_api服务一直起不来，是显存不足么？

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

修改npm**源地址后，可以正常运行，docker log无相关报错，提示准备就绪，但8777端口服务一直没运行，过二十多分钟后该sanic_api近程会自己退出，日志如下。

期望行为 | Expected Behavior

sanic_api服务应该可以正常启动

运行环境 | Environment

- OS:Ubuntu 18.04
- NVIDIA Driver:535.146.02
- CUDA:12.2
- Docker Compose:v2.24.0-birthday.10
- NVIDIA GPU Memory:RTX 2080Ti (11G) x2

QAnything日志 | QAnything logs

nohup: ignoring input
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 8001
embed_port: 9001
[2024-01-23 13:54:07 +0800] [6768] [INFO] Sanic v23.6.0
[2024-01-23 13:54:07 +0800] [6768] [INFO] Goin' Fast @ http://0.0.0.0:8777
[2024-01-23 13:54:07 +0800] [6768] [INFO] mode: production, w/ 4 workers
[2024-01-23 13:54:07 +0800] [6768] [INFO] server: sanic, HTTP/1.1
[2024-01-23 13:54:07 +0800] [6768] [INFO] python: 3.10.12
[2024-01-23 13:54:07 +0800] [6768] [INFO] platform: Linux-5.4.0-150-generic-x86_64-with-glibc2.35
[2024-01-23 13:54:07 +0800] [6768] [INFO] packages: sanic-routing==23.12.0, sanic-ext==23.6.0
[2024-01-23 14:20:47 +0800] [6768] [ERROR] Not all workers acknowledged a successful startup. Shutting down.

It seems that one or more of your workers failed to come online in the allowed time. Sanic is shutting down to avoid a deadlock. The current threshold is 600.0s. If this problem persists, please check out the documentation https://sanic.dev/en/guide/deployment/manager.html#worker-ack.
[2024-01-23 14:20:47 +0800] [6768] [INFO] Killing Sanic-Server-0-0 [7943]
[2024-01-23 14:20:47 +0800] [6768] [INFO] Killing Sanic-Server-1-0 [7944]
[2024-01-23 14:20:47 +0800] [6768] [INFO] Killing Sanic-Server-2-0 [7945]
[2024-01-23 14:20:47 +0800] [6768] [INFO] Killing Sanic-Server-3-0 [7946]
[2024-01-23 14:20:47 +0800] [6768] [INFO] Server Stopped
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 8001
embed_port: 9001

复现方法 | Steps To Reproduce

bash run.sh 0,1

备注 | Anything else?

日志里有以下提示信息：
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.

docker启动失败

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

No response

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:
- NVIDIA Driver:545.23.06
- CUDA:12.3
- Docker Compose:2.18.1
- NVIDIA GPU Memory:24G

QAnything日志 | QAnything logs

qanything-container-local |
qanything-container-local | =============================
qanything-container-local | == Triton Inference Server ==
qanything-container-local | =============================
qanything-container-local |
qanything-container-local | NVIDIA Release 23.05 (build 61161506)
qanything-container-local | Triton Server Version 2.34.0
qanything-container-local |
qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License.
qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license:
qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
qanything-container-local |
qanything-container-local | /opt/nvidia/nvidia_entrypoint.sh: line 49: /workspace/qanything_local/scripts/run_for_local.sh: Permission denied
qanything-container-local | /opt/nvidia/nvidia_entrypoint.sh: line 49: exec: /workspace/qanything_local/scripts/run_for_local.sh: cannot execute: Permission denied
qanything-container-local exited with code 126

复现方法 | Steps To Reproduce

docker compose -f docker-compose-linux.yaml up qanything_local

备注 | Anything else?

No response

部署后的问答效果和官网上的网页差别太大，原因是啥？

同样的知识库，在官网上的网页上回答的很好，在本地部署的却像在胡言乱语，是因为开源的模型太小了么？有啥办法不？

Windows OS - Recommand using QAnything in Win11 instead of Win10

FasterTransformer can be blocked and TensorRT-LLM can crash in Win10.
But everything will be OK in Win11.

Windows WSL2 
docker version 24.0.7 
CUDA version 12.3 
Driver version 545.36
GPU RTX3090/RTX3080Ti
Windows version that we have tested:
Win11 HOME 22H2 22621.3007
Win11 Enterprise 23H2 22631.3007

triton-inference-server/server#6782
NVIDIA/TensorRT-LLM#886

显存只能使用大显存显卡吗？3070ti 8g 可以尝试部署吗？win系统下

[BUG] Upload file and parse error

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

2024-01-22 11:07:18,232 - asyncio - ERROR - Task exception was never retrieved
future: <Task finished name='Task-6' coro=<LocalDocQA.insert_files_to_milvus() done, defined at /workspace/qanything_local/qanything_kernel/core/local_doc_qa.py:89> exception=AttributeError("'NoneType' object has no attribute 'schema'")>
Traceback (most recent call last):
  File "/workspace/qanything_local/qanything_kernel/core/local_doc_qa.py", line 123, in insert_files_to_milvus
    ret = await milvus_kv.insert_files(local_file.file_id, local_file.file_name, local_file.file_path,
  File "/workspace/qanything_local/qanything_kernel/connector/database/milvus/milvus_client.py", line 136, in insert_files
    data = [[] for _ in range(len(self.sess.schema))]
AttributeError: 'NoneType' object has no attribute 'schema'

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

[BUG] 启动Triton服务超时

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

m profiles took 544ms.
(base) PS E:\QAnything> bash run.sh
models 文件夹已存在，无需下载。
Checking model directories...
检查模型目录...
检查模型版本成功，当前版本为 v2.1.0。
Model directories check passed. (0/8)
模型路径和模型版本检查通过. (0/8)
Do you want to use the previous host: localhost? (yes/no) 是否使用上次的host: localhost？(yes/no) 回车默认选yes，请输入:yes
Running under WSL
Container qanything-container-local Stopping
Container qanything-container-local Stopped
Container qanything-container-local Removing
Container qanything-container-local Removed
Container milvus-standalone-local Stopping
Container mysql-container-local Stopping
Container milvus-standalone-local Stopped
Container milvus-standalone-local Removing
Container mysql-container-local Stopped
Container mysql-container-local Removing
Container milvus-standalone-local Removed
Container milvus-minio-local Stopping
Container milvus-etcd-local Stopping
Container mysql-container-local Removed
Container milvus-etcd-local Stopped
Container milvus-etcd-local Removing
Container milvus-minio-local Stopped
Container milvus-minio-local Removing
Container milvus-etcd-local Removed
Container milvus-minio-local Removed
Network qanything_milvus_mysql_local Removing
Network qanything_milvus_mysql_local Removed
[+] Running 6/6
✔ Network qanything_milvus_mysql_local Created 0.1s
✔ Container milvus-minio-local Started 0.2s
✔ Container mysql-container-local Started 0.2s
✔ Container milvus-etcd-local Started 0.2s
✔ Container milvus-standalone-local Started 0.1s
✔ Container qanything-container-local Started 0.2s
qanything-container-local |
qanything-container-local | =============================
qanything-container-local | == Triton Inference Server ==
qanything-container-local | =============================
qanything-container-local |
qanything-container-local | NVIDIA Release 23.05 (build 61161506)
qanything-container-local | Triton Server Version 2.34.0
qanything-container-local |
qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License.
qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license:
qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
qanything-container-local |
qanything-container-local | GPU ID: 0, 0
qanything-container-local | The triton server will start on 0 GPU
qanything-container-local | The llm transfer service is ready! (1/8)
qanything-container-local | 大模型中转服务已就绪! (1/8)
qanything-container-local | The rerank service is ready! (2/8)
qanything-container-local | rerank服务已就绪! (2/8)
qanything-container-local | The ocr service is ready! (3/8)
qanything-container-local | OCR服务已就绪! (3/8)
qanything-container-local | The qanything backend service is ready! (4/8)
qanything-container-local | qanything后端服务已就绪! (4/8)
qanything-container-local | Waiting for [npm run install]（5/8)

qanything-container-local | up to date in 5s
qanything-container-local |
qanything-container-local | 177 packages are looking for funding
qanything-container-local | run npm fund for details
qanything-container-local | [npm run install] Installed successfully（5/8)
qanything-container-local | Waiting for npm run build
qanything-container-local |
qanything-container-local | > [email protected] build
qanything-container-local | > vite build
qanything-container-local |
qanything-container-local | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details.
qanything-container-local | vite v5.0.12 building for production...

qanything-container-local | ~@/styles/fonts/FZLanTingHeiS-L-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
qanything-container-local |
qanything-container-local | ~@/styles/fonts/FZYaSongS-B-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local | 44:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local | 47:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local | 44:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local | 47:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local | 44:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local | 47:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/AddInput.vue
qanything-container-local | 39:5 warning Unexpected console statement no-console
qanything-container-local | 47:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local | 95:3 warning Unexpected console statement no-console
qanything-container-local | 120:3 warning Unexpected console statement no-console
qanything-container-local | 125:3 warning Unexpected console statement no-console
qanything-container-local | 146:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local | 73:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local | 40:3 warning Unexpected console statement no-console
qanything-container-local | 59:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/store/useKnowledgeModal.ts
qanything-container-local | 55:7 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/store/useOptiionList.ts
qanything-container-local | 43:7 warning Unexpected console statement no-console
qanything-container-local | 45:9 warning Unexpected console statement no-console
qanything-container-local | 52:9 warning Unexpected console statement no-console
qanything-container-local | 55:7 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/AddInput.vue
qanything-container-local | 39:5 warning Unexpected console statement no-console
qanything-container-local | 47:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local | 95:3 warning Unexpected console statement no-console
qanything-container-local | 120:3 warning Unexpected console statement no-console
qanything-container-local | 125:3 warning Unexpected console statement no-console
qanything-container-local | 146:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local | 73:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local | 40:3 warning Unexpected console statement no-console
qanything-container-local | 59:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local | 73:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local | 40:3 warning Unexpected console statement no-console
qanything-container-local | 59:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local | 95:3 warning Unexpected console statement no-console
qanything-container-local | 120:3 warning Unexpected console statement no-console
qanything-container-local | 125:3 warning Unexpected console statement no-console
qanything-container-local | 146:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local | 40:3 warning Unexpected console statement no-console
qanything-container-local | 59:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue
qanything-container-local | 72:1 warning Unexpected console statement no-console
qanything-container-local | 97:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local | (x2)
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/autoRetry.ts
qanything-container-local | 17:7 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/forceRetry.ts
qanything-container-local | 5:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue
qanything-container-local | 72:1 warning Unexpected console statement no-console
qanything-container-local | 97:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
✓ 3390 modules transformed.
dist/qanything/index.html 0.81 kB │ gzip: 0.48 kB
qanything-container-local | dist/qanything/assets/ai-avatar-Mfa3nGpi.png 4.48 kB
qanything-container-local | dist/qanything/assets/logo-small-G9Aimh5e.png 7.12 kB
qanything-container-local | dist/qanything/assets/icon-file-cc9GkaT6.png 12.36 kB
qanything-container-local | dist/qanything/assets/index-N7ZRDdsa.css 4.72 kB │ gzip: 1.54 kB
qanything-container-local | dist/qanything/assets/Home-fBCPtTdS.css 10.80 kB │ gzip: 2.43 kB
qanything-container-local | dist/qanything/assets/index-qS-55NZJ.css 11.60 kB │ gzip: 2.39 kB
qanything-container-local | dist/qanything/assets/index-RapwEZsc.js 88.21 kB │ gzip: 31.34 kB
qanything-container-local | dist/qanything/assets/index-LKprbnns.js 280.95 kB │ gzip: 94.50 kB
qanything-container-local | dist/qanything/assets/useOptiionList-x3dMi9Nk.js 294.00 kB │ gzip: 102.64 kB
qanything-container-local | dist/qanything/assets/Home-zTKfjtjJ.js 560.19 kB │ gzip: 157.61 kB
qanything-container-local |
qanything-container-local | (!) Some chunks are larger than 500 kB after minification. Consider:
qanything-container-local | - Using dynamic import() to code-split the application
qanything-container-local | - Use build.rollupOptions.output.manualChunks to improve chunking: https://rollupjs.org/configuration-options/#output-manualchunks
qanything-container-local | - Adjust chunk size limit for this warning via build.chunkSizeWarningLimit.
qanything-container-local | ✓ built in 19m 33s
qanything-container-local |
qanything-container-local | > [email protected] postbuild
qanything-container-local | > node writeVersion.js
qanything-container-local |
qanything-container-local | file:///workspace/qanything_local/front_end/writeVersion.js:1
qanything-container-local | const fs = require('fs');
qanything-container-local | ^
qanything-container-local |
qanything-container-local | ReferenceError: require is not defined in ES module scope, you can use import instead
qanything-container-local | This file is being treated as an ES module because it has a '.js' file extension and '/workspace/qanything_local/front_end/package.json' contains "type": "module". To treat it as a CommonJS script, rename it to use the '.cjs' file extension.
qanything-container-local | at file:///workspace/qanything_local/front_end/writeVersion.js:1:12
qanything-container-local | at ModuleJob.run (node:internal/modules/esm/module_job:195:25)
qanything-container-local | at async ModuleLoader.import (node:internal/modules/esm/loader:336:24)
qanything-container-local | at async loadESM (node:internal/process/esm_loader:34:7)
qanything-container-local | at async handleMainPromise (node:internal/modules/run_main:106:12)
qanything-container-local |
qanything-container-local | Node.js v18.19.0
qanything-container-local | Failed to build the front end.
qanything-container-local exited with code 1
(base) PS E:\QAnything> bash run.sh
models 文件夹已存在，无需下载。
Checking model directories...
检查模型目录...
检查模型版本成功，当前版本为 v2.1.0。
Model directories check passed. (0/8)
模型路径和模型版本检查通过. (0/8)
Do you want to use the previous host: localhost? (yes/no) 是否使用上次的host: localhost？(yes/no) 回车默认选yes，请输入:yes
Running under WSL
Container qanything-container-local Stopping
Container qanything-container-local Stopped
Container qanything-container-local Removing
Container qanything-container-local Removed
Container mysql-container-local Stopping
Container milvus-standalone-local Stopping
Container milvus-standalone-local Stopped
Container milvus-standalone-local Removing
Container milvus-standalone-local Removed
Container milvus-minio-local Stopping
Container milvus-etcd-local Stopping
Container milvus-etcd-local Stopped
Container milvus-etcd-local Removing
Container milvus-etcd-local Removed
Container milvus-minio-local Stopped
Container milvus-minio-local Removing
Container milvus-minio-local Removed
Container mysql-container-local Stopped
Container mysql-container-local Removing
Container mysql-container-local Removed
Network qanything_milvus_mysql_local Removing
Network qanything_milvus_mysql_local Removed
[+] Running 6/6
✔ Network qanything_milvus_mysql_local Created 0.1s
✔ Container milvus-minio-local Started 0.4s
✔ Container milvus-etcd-local Started 0.4s
✔ Container mysql-container-local Started 0.4s
✔ Container milvus-standalone-local Started 0.1s
✔ Container qanything-container-local Started 0.1s
qanything-container-local |
qanything-container-local | =============================
qanything-container-local | == Triton Inference Server ==
qanything-container-local | =============================
qanything-container-local |
qanything-container-local | NVIDIA Release 23.05 (build 61161506)
qanything-container-local | Triton Server Version 2.34.0
qanything-container-local |
qanything-container-local | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
qanything-container-local |
qanything-container-local | This container image and its contents are governed by the NVIDIA Deep Learning Container License.
qanything-container-local | By pulling and using the container, you accept the terms and conditions of this license:
qanything-container-local | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
qanything-container-local |
qanything-container-local | GPU ID: 0, 0
qanything-container-local | The triton server will start on 0 GPU
qanything-container-local | The llm transfer service is ready! (1/8)
qanything-container-local | 大模型中转服务已就绪! (1/8)
qanything-container-local | The rerank service is ready! (2/8)
qanything-container-local | rerank服务已就绪! (2/8)
qanything-container-local | The ocr service is ready! (3/8)
qanything-container-local | OCR服务已就绪! (3/8)
qanything-container-local | The qanything backend service is ready! (4/8)
qanything-container-local | qanything后端服务已就绪! (4/8)
qanything-container-local | Waiting for [npm run install]（5/8)

qanything-container-local | up to date, audited 887 packages in 8s
qanything-container-local |
qanything-container-local | 177 packages are looking for funding
qanything-container-local | run npm fund for details
qanything-container-local |
qanything-container-local | 7 moderate severity vulnerabilities
qanything-container-local |
qanything-container-local | To address all issues (including breaking changes), run:
qanything-container-local | npm audit fix --force
qanything-container-local |
qanything-container-local | Run npm audit for details.
qanything-container-local | npm notice
qanything-container-local | npm notice New minor version of npm available! 10.2.3 -> 10.3.0
qanything-container-local | npm notice Changelog: https://github.com/npm/cli/releases/tag/v10.3.0
qanything-container-local | npm notice Run npm install -g [email protected] to update!
qanything-container-local | npm notice
qanything-container-local | [npm run install] Installed successfully（5/8)
qanything-container-local | Waiting for npm run build
qanything-container-local |
qanything-container-local | > [email protected] build
qanything-container-local | > vite build
qanything-container-local |
qanything-container-local | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details.
qanything-container-local | vite v5.0.12 building for production...

qanything-container-local | ~@/styles/fonts/FZLanTingHeiS-L-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
qanything-container-local |
qanything-container-local | ~@/styles/fonts/FZYaSongS-B-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local | 47:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local | 44:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local | 47:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local | 44:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local | 44:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local | 47:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local | 187:5 warning Unexpected console statement no-console
qanything-container-local | 197:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local | 265:7 warning Unexpected console statement no-console
qanything-container-local | 267:9 warning Unexpected console statement no-console
qanything-container-local | 280:13 warning Unexpected console statement no-console
qanything-container-local | 286:7 warning Unexpected console statement no-console
qanything-container-local | 288:7 warning Unexpected console statement no-console
qanything-container-local | 304:7 warning Unexpected console statement no-console
qanything-container-local | 305:7 warning Unexpected console statement no-console
qanything-container-local | 315:7 warning Unexpected console statement no-console
qanything-container-local | 330:3 warning Unexpected console statement no-console
qanything-container-local | 361:5 warning Unexpected console statement no-console
qanything-container-local | 381:7 warning Unexpected console statement no-console
qanything-container-local | 385:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local | 95:3 warning Unexpected console statement no-console
qanything-container-local | 120:3 warning Unexpected console statement no-console
qanything-container-local | 125:3 warning Unexpected console statement no-console
qanything-container-local | 146:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/AddInput.vue
qanything-container-local | 39:5 warning Unexpected console statement no-console
qanything-container-local | 47:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local | 73:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local | 40:3 warning Unexpected console statement no-console
qanything-container-local | 59:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/store/useKnowledgeModal.ts
qanything-container-local | 55:7 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/store/useOptiionList.ts
qanything-container-local | 43:7 warning Unexpected console statement no-console
qanything-container-local | 45:9 warning Unexpected console statement no-console
qanything-container-local | 52:9 warning Unexpected console statement no-console
qanything-container-local | 55:7 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local | 95:3 warning Unexpected console statement no-console
qanything-container-local | 120:3 warning Unexpected console statement no-console
qanything-container-local | 125:3 warning Unexpected console statement no-console
qanything-container-local | 146:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/AddInput.vue
qanything-container-local | 39:5 warning Unexpected console statement no-console
qanything-container-local | 47:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local | 73:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local | 40:3 warning Unexpected console statement no-console
qanything-container-local | 59:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local | 73:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local | 40:3 warning Unexpected console statement no-console
qanything-container-local | 59:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local | 95:3 warning Unexpected console statement no-console
qanything-container-local | 120:3 warning Unexpected console statement no-console
qanything-container-local | 125:3 warning Unexpected console statement no-console
qanything-container-local | 146:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local | 40:3 warning Unexpected console statement no-console
qanything-container-local | 59:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
[plugin:vite-plugin-eslint]
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue
qanything-container-local | 72:1 warning Unexpected console statement no-console
qanything-container-local | 97:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local | (x2)
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/autoRetry.ts
qanything-container-local | 17:7 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/forceRetry.ts
qanything-container-local | 5:5 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local |
[plugin:vite-plugin-eslint]
qanything-container-local | /workspace/qanything_local/front_end/src/components/UploadInput.vue
qanything-container-local | 72:1 warning Unexpected console statement no-console
qanything-container-local | 97:3 warning Unexpected console statement no-console
qanything-container-local |
qanything-container-local | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local |
✓ 3390 modules transformed.
dist/qanything/index.html 0.81 kB │ gzip: 0.48 kB
qanything-container-local | dist/qanything/assets/ai-avatar-Mfa3nGpi.png 4.48 kB
qanything-container-local | dist/qanything/assets/logo-small-G9Aimh5e.png 7.12 kB
qanything-container-local | dist/qanything/assets/icon-file-cc9GkaT6.png 12.36 kB
qanything-container-local | dist/qanything/assets/index-N7ZRDdsa.css 4.72 kB │ gzip: 1.54 kB
qanything-container-local | dist/qanything/assets/Home-fBCPtTdS.css 10.80 kB │ gzip: 2.43 kB
qanything-container-local | dist/qanything/assets/index-qS-55NZJ.css 11.60 kB │ gzip: 2.39 kB
qanything-container-local | dist/qanything/assets/index-RapwEZsc.js 88.21 kB │ gzip: 31.34 kB
qanything-container-local | dist/qanything/assets/index-LKprbnns.js 280.95 kB │ gzip: 94.50 kB
qanything-container-local | dist/qanything/assets/useOptiionList-x3dMi9Nk.js 294.00 kB │ gzip: 102.64 kB
qanything-container-local | dist/qanything/assets/Home-zTKfjtjJ.js 560.19 kB │ gzip: 157.61 kB
qanything-container-local |
qanything-container-local | (!) Some chunks are larger than 500 kB after minification. Consider:
qanything-container-local | - Using dynamic import() to code-split the application
qanything-container-local | - Use build.rollupOptions.output.manualChunks to improve chunking: https://rollupjs.org/configuration-options/#output-manualchunks
qanything-container-local | - Adjust chunk size limit for this warning via build.chunkSizeWarningLimit.
qanything-container-local | ✓ built in 21m 56s
qanything-container-local |
qanything-container-local | > [email protected] postbuild
qanything-container-local | > node writeVersion.js
qanything-container-local |
qanything-container-local | [npm run build] build successfully(6/8)
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local |
qanything-container-local | > [email protected] serve
qanything-container-local | > vite preview --port 5052
qanything-container-local |
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details.
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | Waiting for the front-end service to start...
qanything-container-local | 等待启动前端服务
qanything-container-local | ➜ Local: http://localhost:5052/qanything
qanything-container-local | ➜ Network: http://172.19.0.6:5052/qanything
qanything-container-local | The front-end service is ready!...(7/8)
qanything-container-local | 前端服务已就绪!...(7/8)
qanything-container-local | Time elapsed: 1440 seconds.
qanything-container-local | 已耗时: 1440 秒.
qanything-container-local | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local | 启动Triton服务超时，请进入容器内检查/model_repos/QAEnsemble_base/QAEnsemble_base.log以获取更多信息。
qanything-container-local exited with code 1

期望行为 | Expected Behavior

期望有解决方法！

运行环境 | Environment

- OS:Windows11
- NVIDIA Driver:546.33
- CUDA:12.3.52
- Docker Compose:Docker Desktop 4.26.1
- NVIDIA GPU Memory:24G

QAnything日志 | QAnything logs

UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
[2024-01-20 16:05:25 +0800] [94] [INFO] Sanic v23.6.0
[2024-01-20 16:05:25 +0800] [94] [INFO] Goin' Fast @ http://0.0.0.0:8777
[2024-01-20 16:05:25 +0800] [94] [INFO] mode: production, w/ 4 workers
[2024-01-20 16:05:25 +0800] [94] [INFO] server: sanic, HTTP/1.1
[2024-01-20 16:05:25 +0800] [94] [INFO] python: 3.10.12
[2024-01-20 16:05:25 +0800] [94] [INFO] platform: Linux-5.15.133.1-microsoft-standard-WSL2-x86_64-with-glibc2.35
[2024-01-20 16:05:25 +0800] [94] [INFO] packages: sanic-routing==23.12.0, sanic-ext==23.6.0
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-20 16:05:37 +0800] [1116] [INFO] Sanic Extensions:
[2024-01-20 16:05:37 +0800] [1116] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-20 16:05:37 +0800] [1116] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-20 16:05:37 +0800] [1116] [INFO] > http
[2024-01-20 16:05:37 +0800] [1116] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
[2024-01-20 16:05:38 +0800] [1116] [INFO] Starting worker [1116]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-20 16:05:38 +0800] [1115] [INFO] Sanic Extensions:
[2024-01-20 16:05:38 +0800] [1115] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-20 16:05:38 +0800] [1115] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-20 16:05:38 +0800] [1115] [INFO] > http
[2024-01-20 16:05:38 +0800] [1115] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-20 16:05:38 +0800] [1117] [INFO] Sanic Extensions:
[2024-01-20 16:05:38 +0800] [1117] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-20 16:05:38 +0800] [1117] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-20 16:05:38 +0800] [1117] [INFO] > http
[2024-01-20 16:05:38 +0800] [1117] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
init local_doc_qa in local
[2024-01-20 16:05:38 +0800] [1115] [INFO] Starting worker [1115]
[2024-01-20 16:05:38 +0800] [1117] [INFO] Starting worker [1117]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-20 16:05:39 +0800] [1118] [INFO] Sanic Extensions:
[2024-01-20 16:05:39 +0800] [1118] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-20 16:05:39 +0800] [1118] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-20 16:05:39 +0800] [1118] [INFO] > http
[2024-01-20 16:05:39 +0800] [1118] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
[2024-01-20 16:05:39 +0800] [1118] [INFO] Starting worker [1118]

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

能否支持CPU的机器部署

该服务支持CPU的机器部署么？还是说目前只支持GPU的机器才能进行部署？后续有该计划么？

[BUG] <title>

最后一步:ERROR: for qanything_local Cannot start service qanything_local: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #1: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy'
nvidia-container-cli: mount error: file creation failed: /var/lib/docker/overlay2/2831fdbf603c479596a0fddb8e0db4662c1a01007068c742619ee5c0c625e83a/merged/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1: file exists: unknown
请问这个项目只能docker部署吗,我看说明是说全程可以拔网线安装的

[BUG] log未见任何异常，但是页面一直loading，也无法创建知识库

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

bash run.sh 后，服务启动正常

登录页面：
http://localhost:5052/qanything#/home

问题：

页面一直loading动画
创建知识库报500错误

期望行为 | Expected Behavior

页面正常，同时可以添加知识库

运行环境 | Environment

- OS: Windows 10 专业
- NVIDIA Driver: docker
- CUDA: docker
- Docker Compose:标准docker
- NVIDIA GPU Memory: 24GB （P6000)

QAnything日志 | QAnything logs

UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-21 14:17:30 +0800] [858] [INFO] Sanic Extensions:
[2024-01-21 14:17:30 +0800] [858] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-21 14:17:30 +0800] [858] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-21 14:17:30 +0800] [858] [INFO] > http
[2024-01-21 14:17:30 +0800] [858] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-21 14:17:30 +0800] [855] [INFO] Sanic Extensions:
[2024-01-21 14:17:30 +0800] [855] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-21 14:17:30 +0800] [855] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-21 14:17:30 +0800] [855] [INFO] > http
[2024-01-21 14:17:30 +0800] [855] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
init local_doc_qa in local
[2024-01-21 14:17:30 +0800] [858] [INFO] Starting worker [858]
[2024-01-21 14:17:30 +0800] [855] [INFO] Starting worker [855]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-21 14:17:30 +0800] [856] [INFO] Sanic Extensions:
[2024-01-21 14:17:30 +0800] [856] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-21 14:17:30 +0800] [856] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-21 14:17:30 +0800] [856] [INFO] > http
[2024-01-21 14:17:30 +0800] [856] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-21 14:17:31 +0800] [857] [INFO] Sanic Extensions:
[2024-01-21 14:17:31 +0800] [857] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-21 14:17:31 +0800] [857] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-21 14:17:31 +0800] [857] [INFO] > http
[2024-01-21 14:17:31 +0800] [857] [INFO] > templating [jinja2==3.1.3]
[2024-01-21 14:17:31 +0800] [856] [INFO] Starting worker [856]
init local_doc_qa in local
[2024-01-21 14:17:31 +0800] [857] [INFO] Starting worker [857]

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

gpt版本部署

Please Describe The Problem To Be Solved
感谢如此精彩的项目。出于效果比较的需要，我正在将这个代码尝试以gpt作为generator部署。

(Optional): Suggest A Solution
我看到scripts文件夹中的run_for_online脚本，功能上是支持api调用的模型参与部署的，所以我在此基础上尝试用这个文件去替换run_for_local来部署，理论上这样替换再docker build就能得到一个online版本的QAnything。但是我在docker build的过程中碰到了

COPY nltk_data /root/nltk_data
COPY paddleocr /root/.paddleocr
COPY qa_ensemble /opt/tritonserver/backends/qa_ensemble

https://github.dev/netease-youdao/QAnything/blob/65d84c693a7d8b2243f2b1eaac294246666f66f7/Dockerfile#L57-L59
这三个文件夹的缺失。其中我并不清楚qa_ensemble的由来，目前打算从现有的docker镜像中复制文件，但是直觉上说是不是有更好的方法来做到这件事情？因此提了这个issue来询问贵团队的解决方法，烦请解答！

请问有计划支持Qwen之外的LLM模型吗？

我搜索了代码，看起来现在是在代码中hard code了使用Qwen的模型进行内容生成。请问有计划支持别的模型吗？或者支持以接口调用的形式集成其它LLM推理服务吗？

在线体验不行，直接报错[BUG] <title>

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

No response

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

[BUG] <title>terminate called after throwing an instance of 'std::runtime_error' what(): [FT][ERROR] Assertion fail: /home/local/llama_inference/llm_serve/fastertransformer_backend/build/_deps/repo-ft-src/src/fastertransformer/triton_backend/llama/LlamaTritonModel.cc:89

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

bash run.sh一直等待，很久之后提示
启动Triton服务超时，请进入容器内检查model_reposQAEnsemble_baseQAEnsemble_base.log以获取更多信息。
然后去models下面查看QAEnsemble.log文件，发现报错

期望行为 | Expected Behavior

bash run.sh能正常启动容器，并能访问5052

运行环境 | Environment

OS: Windows 11 WSL2(ubuntu 22.04)
NVIDIA Driver: 546.65
CUDA: 12.3
docker desktop: v4.26.1
NVIDIA GPU Memory: 8GB

QAnything日志 | QAnything logs

I0123 10:46:22.146296 91 cache_manager.cc:478] Create CacheManager with cache_dir: '/opt/tritonserver/caches'
I0123 10:46:23.234552 91 pinned_memory_manager.cc:240] Pinned memory pool is created at '0x205000000' with size 268435456
I0123 10:46:23.235645 91 cuda_memory_manager.cc:105] CUDA memory pool is created on device 0 with size 67108864
I0123 10:46:27.309790 91 model_config_utils.cc:647] Server side auto-completed config: name: "base"
max_batch_size: 1
input {
name: "input_ids"
data_type: TYPE_UINT32
dims: -1
allow_ragged_batch: true
}
input {
name: "start_id"
data_type: TYPE_UINT32
dims: 1
reshape {
}
optional: true
}
input {
name: "end_id"
data_type: TYPE_UINT32
dims: 1
reshape {
}
optional: true
}
input {
name: "input_lengths"
data_type: TYPE_UINT32
dims: 1
reshape {
}
}
input {
name: "request_output_len"
data_type: TYPE_UINT32
dims: -1
}
input {
name: "runtime_top_k"
data_type: TYPE_UINT32
dims: 1
reshape {
}
optional: true
}
input {
name: "runtime_top_p"
data_type: TYPE_FP32
dims: 1
reshape {
}
optional: true
}
input {
name: "beam_search_diversity_rate"
data_type: TYPE_FP32
dims: 1
reshape {
}
optional: true
}
input {
name: "temperature"
data_type: TYPE_FP32
dims: 1
reshape {
}
optional: true
}
input {
name: "len_penalty"
data_type: TYPE_FP32
dims: 1
reshape {
}
optional: true
}
input {
name: "repetition_penalty"
data_type: TYPE_FP32
dims: 1
reshape {
}
optional: true
}
input {
name: "random_seed"
data_type: TYPE_UINT64
dims: 1
reshape {
}
optional: true
}
input {
name: "is_return_log_probs"
data_type: TYPE_BOOL
dims: 1
reshape {
}
optional: true
}
input {
name: "beam_width"
data_type: TYPE_UINT32
dims: 1
reshape {
}
optional: true
}
input {
name: "bad_words_list"
data_type: TYPE_INT32
dims: 2
dims: -1
optional: true
}
input {
name: "stop_words_list"
data_type: TYPE_INT32
dims: 2
dims: -1
optional: true
}
input {
name: "prompt_learning_task_name_ids"
data_type: TYPE_UINT32
dims: 1
reshape {
}
optional: true
}
input {
name: "top_p_decay"
data_type: TYPE_FP32
dims: 1
reshape {
}
optional: true
}
input {
name: "top_p_min"
data_type: TYPE_FP32
dims: 1
reshape {
}
optional: true
}
input {
name: "top_p_reset_ids"
data_type: TYPE_UINT32
dims: 1
reshape {
}
optional: true
}
output {
name: "output_ids"
data_type: TYPE_UINT32
dims: -1
dims: -1
}
output {
name: "sequence_length"
data_type: TYPE_UINT32
dims: -1
}
output {
name: "cum_log_probs"
data_type: TYPE_FP32
dims: -1
}
output {
name: "output_log_probs"
data_type: TYPE_FP32
dims: -1
dims: -1
}
instance_group {
count: 1
kind: KIND_CPU
}
default_model_filename: "base"
dynamic_batching {
max_queue_delay_microseconds: 50000
}
parameters {
key: "data_type"
value {
string_value: "fp16"
}
}
parameters {
key: "enable_custom_all_reduce"
value {
string_value: "0"
}
}
parameters {
key: "int8_mode"
value {
string_value: "1"
}
}
parameters {
key: "model_checkpoint_path"
value {
string_value: "/model_repos/QAEnsemble/base/1/1-gpu/"
}
}
parameters {
key: "model_type"
value {
string_value: "Llama"
}
}
parameters {
key: "pipeline_para_size"
value {
string_value: "1"
}
}
parameters {
key: "tensor_para_size"
value {
string_value: "1"
}
}
backend: "qa_ensemble"
model_transaction_policy {
decoupled: true
}
batch_input {
kind: BATCH_ITEM_SHAPE
target_name: "input_ids_item_shape"
data_type: TYPE_INT32
source_input: "input_ids"
}

I0123 10:46:27.405802 91 model_config_utils.cc:647] Server side auto-completed config: name: "embed"
platform: "onnxruntime_onnx"
max_batch_size: 16
input {
name: "token_type_ids"
data_type: TYPE_INT64
dims: -1
}
input {
name: "attention_mask"
data_type: TYPE_INT64
dims: -1
}
input {
name: "input_ids"
data_type: TYPE_INT64
dims: -1
}
output {
name: "1607"
data_type: TYPE_FP32
dims: 768
}
output {
name: "output"
data_type: TYPE_FP32
dims: -1
dims: 768
}
instance_group {
name: "embed"
count: 1
gpus: 0
kind: KIND_GPU
}
default_model_filename: "model.onnx"
backend: "onnxruntime"

I0123 10:46:27.506715 91 model_config_utils.cc:647] Server side auto-completed config: name: "rerank"
platform: "onnxruntime_onnx"
max_batch_size: 16
input {
name: "attention_mask"
data_type: TYPE_INT64
dims: -1
}
input {
name: "token_type_ids"
data_type: TYPE_INT64
dims: -1
}
input {
name: "input_ids"
data_type: TYPE_INT64
dims: -1
}
output {
name: "logits"
data_type: TYPE_FP16
dims: 1
}
instance_group {
name: "rerank"
count: 1
gpus: 0
kind: KIND_GPU
}
default_model_filename: "model.onnx"
backend: "onnxruntime"

I0123 10:46:27.514646 91 model_lifecycle.cc:462] loading: rerank:1
I0123 10:46:27.521593 91 backend_model.cc:362] Adding default backend config setting: default-max-batch-size,4
I0123 10:46:27.522299 91 shared_library.cc:112] OpenLibraryHandle: /opt/tritonserver/backends/onnxruntime/libtriton_onnxruntime.so
I0123 10:46:27.524456 91 onnxruntime.cc:2504] TRITONBACKEND_Initialize: onnxruntime
I0123 10:46:27.525273 91 onnxruntime.cc:2514] Triton TRITONBACKEND API version: 1.12
I0123 10:46:27.526272 91 onnxruntime.cc:2520] 'onnxruntime' TRITONBACKEND API version: 1.12
I0123 10:46:27.526966 91 model_lifecycle.cc:462] loading: embed:1
I0123 10:46:27.527105 91 onnxruntime.cc:2550] backend configuration:
{"cmdline":{"auto-complete-config":"true","backend-directory":"/opt/tritonserver/backends","min-compute-capability":"6.000000","default-max-batch-size":"4"}}
I0123 10:46:27.532334 91 backend_model.cc:362] Adding default backend config setting: default-max-batch-size,4
I0123 10:46:27.538006 91 model_lifecycle.cc:462] loading: base:1
I0123 10:46:27.543958 91 backend_model.cc:362] Adding default backend config setting: default-max-batch-size,4
I0123 10:46:27.544678 91 onnxruntime.cc:2608] TRITONBACKEND_ModelInitialize: embed (version 1)
I0123 10:46:27.544679 91 onnxruntime.cc:2608] TRITONBACKEND_ModelInitialize: rerank (version 1)
I0123 10:46:27.544696 91 shared_library.cc:112] OpenLibraryHandle: /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so
I0123 10:46:27.546190 91 model_config_utils.cc:1839] ModelConfig 64-bit fields:
I0123 10:46:27.548000 91 model_config_utils.cc:1841] ModelConfig::dynamic_batching::default_queue_policy::default_timeout_microseconds
I0123 10:46:27.548654 91 model_config_utils.cc:1841] ModelConfig::dynamic_batching::max_queue_delay_microseconds
I0123 10:46:27.549343 91 model_config_utils.cc:1841] ModelConfig::dynamic_batching::priority_queue_policy::value::default_timeout_microseconds
I0123 10:46:27.550300 91 model_config_utils.cc:1841] ModelConfig::ensemble_scheduling::step::model_version
I0123 10:46:27.551567 91 model_config_utils.cc:1841] ModelConfig::input::dims
I0123 10:46:27.552558 91 model_config_utils.cc:1841] ModelConfig::input::reshape::shape
I0123 10:46:27.553423 91 model_config_utils.cc:1841] ModelConfig::instance_group::secondary_devices::device_id
I0123 10:46:27.554198 91 model_config_utils.cc:1841] ModelConfig::model_warmup::inputs::value::dims
I0123 10:46:27.554934 91 model_config_utils.cc:1841] ModelConfig::optimization::cuda::graph_spec::graph_lower_bound::input::value::dim
I0123 10:46:27.555914 91 model_config_utils.cc:1841] ModelConfig::optimization::cuda::graph_spec::input::value::dim
I0123 10:46:27.556738 91 model_config_utils.cc:1841] ModelConfig::output::dims
I0123 10:46:27.557425 91 model_config_utils.cc:1841] ModelConfig::output::reshape::shape
I0123 10:46:27.558244 91 model_config_utils.cc:1841] ModelConfig::sequence_batching::direct::max_queue_delay_microseconds
I0123 10:46:27.559788 91 model_config_utils.cc:1841] ModelConfig::sequence_batching::max_sequence_idle_microseconds
I0123 10:46:27.561145 91 model_config_utils.cc:1841] ModelConfig::sequence_batching::oldest::max_queue_delay_microseconds
I0123 10:46:27.562226 91 model_config_utils.cc:1841] ModelConfig::sequence_batching::state::dims
I0123 10:46:27.563091 91 model_config_utils.cc:1841] ModelConfig::sequence_batching::state::initial_state::dims
I0123 10:46:27.564123 91 model_config_utils.cc:1841] ModelConfig::version_policy::specific::versions
I0123 10:46:27.565304 91 onnxruntime.cc:666] skipping model configuration auto-complete for 'embed': inputs and outputs already specified
I0123 10:46:27.565324 91 onnxruntime.cc:666] skipping model configuration auto-complete for 'rerank': inputs and outputs already specified
I0123 10:46:27.571452 91 onnxruntime.cc:2651] TRITONBACKEND_ModelInstanceInitialize: embed (GPU device 0)
I0123 10:46:27.572770 91 backend_model_instance.cc:105] Creating instance embed on GPU 0 (8.9) using artifact 'model.onnx'
I0123 10:46:27.572862 91 onnxruntime.cc:2651] TRITONBACKEND_ModelInstanceInitialize: rerank (GPU device 0)
I0123 10:46:27.574404 91 backend_model_instance.cc:105] Creating instance rerank on GPU 0 (8.9) using artifact 'model.onnx'
I0123 10:46:27.609262 91 onnxruntime.cc:553] CUDA Execution Accelerator is set for 'embed' on device 0
2024-01-23 18:46:27.610434750 [I:onnxruntime:, inference_session.cc:271 operator()] Flush-to-zero and denormal-as-zero are off
2024-01-23 18:46:27.611009267 [I:onnxruntime:, inference_session.cc:279 ConstructorCommon] Creating and using per session threadpools since use_per_session_threads_ is true
2024-01-23 18:46:27.611487659 [I:onnxruntime:, inference_session.cc:297 ConstructorCommon] Dynamic block base set to 0
I0123 10:46:27.611815 91 onnxruntime.cc:553] CUDA Execution Accelerator is set for 'rerank' on device 0
2024-01-23 18:46:27.613208123 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 680, index: 0, mask: {2, 3, }
2024-01-23 18:46:27.613278646 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 681, index: 1, mask: {4, 5, }
2024-01-23 18:46:27.613498790 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 682, index: 2, mask: {6, 7, }
2024-01-23 18:46:27.613506331 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 683, index: 3, mask: {8, 9, }
2024-01-23 18:46:27.613572767 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 684, index: 4, mask: {10, 11, }
2024-01-23 18:46:27.614362624 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 685, index: 5, mask: {12, 13, }
2024-01-23 18:46:27.614924025 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 686, index: 6, mask: {14, 15, }
2024-01-23 18:46:27.615095580 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 687, index: 7, mask: {16, 17, }
2024-01-23 18:46:27.625392156 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 690, index: 10, mask: {22, 23, }
2024-01-23 18:46:27.625307692 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 689, index: 9, mask: {20, 21, }
2024-01-23 18:46:27.625455150 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 688, index: 8, mask: {18, 19, }
2024-01-23 18:46:27.625564354 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 691, index: 11, mask: {24, 25, }
2024-01-23 18:46:27.625701625 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 693, index: 13, mask: {28, 29, }
2024-01-23 18:46:27.625727190 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 694, index: 14, mask: {30, 31, }
2024-01-23 18:46:27.625805541 [V:onnxruntime:log, env.cc:246 ThreadMain] pthread_setaffinity_np succeed for thread: 692, index: 12, mask: {26, 27, }
I0123 10:46:27.960071 91 libfastertransformer.cc:1848] TRITONBACKEND_Initialize: qa_ensemble
I0123 10:46:27.961065 91 libfastertransformer.cc:1858] Triton TRITONBACKEND API version: 1.12
I0123 10:46:27.961748 91 libfastertransformer.cc:1864] 'qa_ensemble' TRITONBACKEND API version: 1.10
I0123 10:46:27.962404 91 libfastertransformer.cc:1896] TRITONBACKEND_ModelInitialize: base (version 1)
I0123 10:46:27.964034 91 libfastertransformer.cc:364] model configuration:
{
"name": "base",
"platform": "",
"backend": "qa_ensemble",
"version_policy": {
"latest": {
"num_versions": 1
}
},
"max_batch_size": 1,
"input": [
{
"name": "input_ids",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
-1
],
"is_shape_tensor": false,
"allow_ragged_batch": true,
"optional": false
},
{
"name": "start_id",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "end_id",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "input_lengths",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": false
},
{
"name": "request_output_len",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
-1
],
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": false
},
{
"name": "runtime_top_k",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "runtime_top_p",
"data_type": "TYPE_FP32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "beam_search_diversity_rate",
"data_type": "TYPE_FP32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "temperature",
"data_type": "TYPE_FP32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "len_penalty",
"data_type": "TYPE_FP32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "repetition_penalty",
"data_type": "TYPE_FP32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "random_seed",
"data_type": "TYPE_UINT64",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "is_return_log_probs",
"data_type": "TYPE_BOOL",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "beam_width",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "bad_words_list",
"data_type": "TYPE_INT32",
"format": "FORMAT_NONE",
"dims": [
2,
-1
],
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "stop_words_list",
"data_type": "TYPE_INT32",
"format": "FORMAT_NONE",
"dims": [
2,
-1
],
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "prompt_learning_task_name_ids",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "top_p_decay",
"data_type": "TYPE_FP32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "top_p_min",
"data_type": "TYPE_FP32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
},
{
"name": "top_p_reset_ids",
"data_type": "TYPE_UINT32",
"format": "FORMAT_NONE",
"dims": [
1
],
"reshape": {
"shape": []
},
"is_shape_tensor": false,
"allow_ragged_batch": false,
"optional": true
}
],
"output": [
{
"name": "output_ids",
"data_type": "TYPE_UINT32",
"dims": [
-1,
-1
],
"label_filename": "",
"is_shape_tensor": false
},
{
"name": "sequence_length",
"data_type": "TYPE_UINT32",
"dims": [
-1
],
"label_filename": "",
"is_shape_tensor": false
},
{
"name": "cum_log_probs",
"data_type": "TYPE_FP32",
"dims": [
-1
],
"label_filename": "",
"is_shape_tensor": false
},
{
"name": "output_log_probs",
"data_type": "TYPE_FP32",
"dims": [
-1,
-1
],
"label_filename": "",
"is_shape_tensor": false
}
],
"batch_input": [
{
"kind": "BATCH_ITEM_SHAPE",
"target_name": [
"input_ids_item_shape"
],
"data_type": "TYPE_INT32",
"source_input": [
"input_ids"
]
}
],
"batch_output": [],
"optimization": {
"priority": "PRIORITY_DEFAULT",
"input_pinned_memory": {
"enable": true
},
"output_pinned_memory": {
"enable": true
},
"gather_kernel_buffer_threshold": 0,
"eager_batching": false
},
"dynamic_batching": {
"preferred_batch_size": [
1
],
"max_queue_delay_microseconds": 50000,
"preserve_ordering": false,
"priority_levels": 0,
"default_priority_level": 0,
"priority_queue_policy": {}
},
"instance_group": [
{
"name": "base_0",
"kind": "KIND_CPU",
"count": 1,
"gpus": [],
"secondary_devices": [],
"profile": [],
"passive": false,
"host_policy": ""
}
],
"default_model_filename": "base",
"cc_model_filenames": {},
"metric_tags": {},
"parameters": {
"model_type": {
"string_value": "Llama"
},
"pipeline_para_size": {
"string_value": "1"
},
"data_type": {
"string_value": "fp16"
},
"model_checkpoint_path": {
"string_value": "/model_repos/QAEnsemble/base/1/1-gpu/"
},
"int8_mode": {
"string_value": "1"
},
"tensor_para_size": {
"string_value": "1"
},
"enable_custom_all_reduce": {
"string_value": "0"
}
},
"model_warmup": [],
"model_transaction_policy": {
"decoupled": true
}
}
I0123 10:46:27.965026 91 libfastertransformer.cc:387] Instance group type: KIND_CPU count: 1
I0123 10:46:27.965873 91 libfastertransformer.cc:417] Sequence Batching: disabled
I0123 10:46:27.966620 91 libfastertransformer.cc:427] Dynamic Batching: enabled
terminate called after throwing an instance of 'std::runtime_error'
what(): [FT][ERROR] Assertion fail: /home/local/llama_inference/llm_serve/fastertransformer_backend/build/_deps/repo-ft-src/src/fastertransformer/triton_backend/llama/LlamaTritonModel.cc:89

[65ef5ebd6c73:00091] *** Process received signal ***
[65ef5ebd6c73:00091] Signal: Aborted (6)
[65ef5ebd6c73:00091] Signal code: (-6)
[65ef5ebd6c73:00091] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f8a2ce94520]
[65ef5ebd6c73:00091] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f8a2cee89fc]
[65ef5ebd6c73:00091] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f8a2ce94476]
[65ef5ebd6c73:00091] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f8a2ce7a7f3]
[65ef5ebd6c73:00091] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f8a2d11db9e]
[65ef5ebd6c73:00091] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f8a2d12920c]
[65ef5ebd6c73:00091] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f8a2d129277]
[65ef5ebd6c73:00091] [ 7] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae4d8)[0x7f8a2d1294d8]
[65ef5ebd6c73:00091] [ 8] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(_ZN17fastertransformer17throwRuntimeErrorEPKciRKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x27f)[0x7f89e37c4c5f]
[65ef5ebd6c73:00091] [ 9] /opt/tritonserver/backends/qa_ensemble/libtransformer-shared.so(_ZN16LlamaTritonModelI6__halfEC1EmmiNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEi+0x70e)[0x7f89e3a9fdae]
[65ef5ebd6c73:00091] [10] /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so(+0x275ca)[0x7f8a13be05ca]
[65ef5ebd6c73:00091] [11] /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so(+0x2f0d9)[0x7f8a13be80d9]
[65ef5ebd6c73:00091] [12] /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so(+0x35f56)[0x7f8a13beef56]
[65ef5ebd6c73:00091] [13] /opt/tritonserver/backends/qa_ensemble/libtriton_qa_ensemble.so(TRITONBACKEND_ModelInitialize+0x4c2)[0x7f8a13bef732]
[65ef5ebd6c73:00091] [14] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x174497)[0x7f8a2d85e497]
[65ef5ebd6c73:00091] [15] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x252d80)[0x7f8a2d93cd80]
[65ef5ebd6c73:00091] [16] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x2563c3)[0x7f8a2d9403c3]
[65ef5ebd6c73:00091] [17] /opt/tritonserver/bin/../lib/libtritonserver.so(+0x39a052)[0x7f8a2da84052]
[65ef5ebd6c73:00091] [18] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xdc253)[0x7f8a2d157253]
[65ef5ebd6c73:00091] [19] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x94ac3)[0x7f8a2cee6ac3]
[65ef5ebd6c73:00091] [20] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x126850)[0x7f8a2cf78850]
[65ef5ebd6c73:00091] *** End of error message ***

复现方法 | Steps To Reproduce

terminate called after throwing an instance of 'std::runtime_error'
what(): [FT][ERROR] Assertion fail: /home/local/llama_inference/llm_serve/fastertransformer_backend/build/_deps/repo-ft-src/src/fastertransformer/triton_backend/llama/LlamaTritonModel.cc:89

备注 | Anything else?

No response

[BUG]docker logs 一直提示Triton 正在启动

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

从日志来看所有的服务均启动成功，但curl -s -w "%{http_code}" http://localhost:10000/v2/health/ready -o /dev/null) 检测一直不通过。超时后容器停止后也没有/model_repos/QAEnsemble_base/QAEnsemble_base.log 这个日志文件。

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS: ubuntu 22.04 x86
- NVIDIA Driver: 535.146.02
- CUDA:12.2
- Docker Compose:v2.24.0-birthday.10
- NVIDIA GPU Memory:16GB

QAnything日志 | QAnything logs

root@f1376869a3c5:/workspace/qanything_local# cat api.log
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 09:56:17 +0800] [91] [INFO] Sanic v23.6.0
[2024-01-19 09:56:17 +0800] [91] [INFO] Goin' Fast @ http://0.0.0.0:8777
[2024-01-19 09:56:17 +0800] [91] [INFO] mode: production, w/ 4 workers
[2024-01-19 09:56:17 +0800] [91] [INFO] server: sanic, HTTP/1.1
[2024-01-19 09:56:17 +0800] [91] [INFO] python: 3.10.12
[2024-01-19 09:56:17 +0800] [91] [INFO] platform: Linux-6.5.0-14-generic-x86_64-with-glibc2.35
[2024-01-19 09:56:17 +0800] [91] [INFO] packages: sanic-routing==23.12.0, sanic-ext==23.6.0
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 09:56:27 +0800] [658] [INFO] Sanic Extensions:
[2024-01-19 09:56:27 +0800] [658] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-19 09:56:27 +0800] [658] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-19 09:56:27 +0800] [658] [INFO] > http
[2024-01-19 09:56:27 +0800] [658] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 09:56:27 +0800] [657] [INFO] Sanic Extensions:
[2024-01-19 09:56:27 +0800] [657] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-19 09:56:27 +0800] [657] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-19 09:56:27 +0800] [657] [INFO] > http
[2024-01-19 09:56:27 +0800] [657] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 09:56:27 +0800] [659] [INFO] Sanic Extensions:
[2024-01-19 09:56:27 +0800] [659] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-19 09:56:27 +0800] [659] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-19 09:56:27 +0800] [659] [INFO] > http
[2024-01-19 09:56:27 +0800] [659] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
init local_doc_qa in local
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 09:56:27 +0800] [660] [INFO] Sanic Extensions:
[2024-01-19 09:56:27 +0800] [660] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-19 09:56:27 +0800] [660] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-19 09:56:27 +0800] [660] [INFO] > http
[2024-01-19 09:56:27 +0800] [660] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
init local_doc_qa in local
[2024-01-19 09:56:27 +0800] [658] [INFO] Starting worker [658]
[2024-01-19 09:56:27 +0800] [657] [INFO] Starting worker [657]
[2024-01-19 09:56:27 +0800] [659] [INFO] Starting worker [659]
[2024-01-19 09:56:27 +0800] [660] [INFO] Starting worker [660]

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

项目部署报错

milvus-standalone-local | [2024/01/05 08:31:22.854 +00:00] [ERROR] [grpcclient/client.go:429] ["retry func failed"] ["retry time"=8] [error="rpc error: code = Unknown desc = expectedNodeID=4, actualNodeID=5: node not match"] [stack="github.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).call\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:429\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).Call\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:513\ngithub.com/milvus-io/milvus/internal/util/grpcclient.(*ClientBase[...]).ReCall\n\t/go/src/github.com/milvus-io/milvus/internal/util/grpcclient/client.go:529\ngithub.com/milvus-io/milvus/internal/distributed/proxy/client.wrapGrpcCall[...]\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/proxy/client/client.go:76\ngithub.com/milvus-io/milvus/internal/distributed/proxy/client.(*Client).RefreshPolicyInfoCache\n\t/go/src/github.com/milvus-io/milvus/internal/distributed/proxy/client/client.go:142\ngithub.com/milvus-io/milvus/internal/rootcoord.(*proxyClientManager).RefreshPolicyInfoCache.func1\n\t/go/src/github.com/milvus-io/milvus/internal/rootcoord/proxy_client_manager.go:242\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\t/go/pkg/mod/golang.org/x/[email protected]/errgroup/errgroup.go:75"]

docker-compose报错日志如上

[BUG] 拉取镜像时qanything_local这个文件下载不下来，进度条的第5位置下载不下来

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

拉取镜像时qanything_local这个文件下载不下来，进度条的第5和13位置下载不下来。
试过很多次到最后就是进度条卡着不动了。

期望行为 | Expected Behavior

希望能正常拉取镜像

运行环境 | Environment

- OS:Windows11
- NVIDIA Driver:546.33
- CUDA:12.3.52
- Docker Compose:Docker Desktop 4.26.1
- NVIDIA GPU Memory:24G

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

[BUG] 启动Triton服务超时，请进入容器内检查/model_repos/QAEnsemble_base/QAEnsemble_base.log以获取更多信息。

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

从日志来看所有的服务均启动成功，但curl -s -w "%{http_code}" http://localhost:10000/v2/health/ready -o /dev/null) 检测一直不通过。
报错：[ERROR] Can't load '/model_repos/QAEnsemble/base/1/1-gpu//config.ini'

(base) [root@localhost QAnything]# ./run.sh 1
models 文件夹已存在，无需下载。
Checking model directories...
检查模型目录...
检查模型版本成功，当前版本为 v2.1.0。
Model directories check passed. (0/8)
模型路径和模型版本检查通过. (0/8)
Do you want to use the previous host: localhost? (yes/no) 是否使用上次的host: localhost？(yes/no) 回车默认选yes，请输入:yes
Running under native Linux
 Container qanything-container-local  Stopping
 Container qanything-container-local  Stopped
 Container qanything-container-local  Removing
 Container qanything-container-local  Removed
 Container milvus-standalone-local  Stopping
 Container mysql-container-local  Stopping
 Container milvus-standalone-local  Stopped
 Container milvus-standalone-local  Removing
 Container milvus-standalone-local  Removed
 Container milvus-etcd-local  Stopping
 Container milvus-minio-local  Stopping
 Container milvus-etcd-local  Stopped
 Container milvus-etcd-local  Removing
 Container milvus-etcd-local  Removed
 Container mysql-container-local  Stopped
 Container mysql-container-local  Removing
 Container mysql-container-local  Removed
 Container milvus-minio-local  Stopped
 Container milvus-minio-local  Removing
 Container milvus-minio-local  Removed
 Network qanything_milvus_mysql_local  Removing
 Network qanything_milvus_mysql_local  Removed
[+] Running 5/6
 ⠴ Network qanything_milvus_mysql_local  Created                                                                                                   3.5s 
 ✔ Container milvus-minio-local          Started                                                                                                   1.7s 
 ✔ Container mysql-container-local       Started                                                                                                   1.7s 
 ✔ Container milvus-etcd-local           Started                                                                                                   1.6s 
 ✔ Container milvus-standalone-local     Started                                                                                                   1.5s 
 ✔ Container qanything-container-local   Started                                                                                                   2.1s 
qanything-container-local  | 
qanything-container-local  | =============================
qanything-container-local  | == Triton Inference Server ==
qanything-container-local  | =============================
qanything-container-local  | 
qanything-container-local  | NVIDIA Release 23.05 (build 61161506)
qanything-container-local  | Triton Server Version 2.34.0
qanything-container-local  | 
qanything-container-local  | Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES.  All rights reserved.
qanything-container-local  | 
qanything-container-local  | Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES.  All rights reserved.
qanything-container-local  | 
qanything-container-local  | This container image and its contents are governed by the NVIDIA Deep Learning Container License.
qanything-container-local  | By pulling and using the container, you accept the terms and conditions of this license:
qanything-container-local  | https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
qanything-container-local  | 
qanything-container-local  | GPU ID: 1, 1
qanything-container-local  | The triton server will start on 1 GPU
qanything-container-local  | The llm transfer service is ready! (1/8)
qanything-container-local  | 大模型中转服务已就绪! (1/8)
qanything-container-local  | The rerank service is ready! (2/8)
qanything-container-local  | rerank服务已就绪! (2/8)
qanything-container-local  | The ocr service is ready! (3/8)
qanything-container-local  | OCR服务已就绪! (3/8)
qanything-container-local  | The qanything backend service is ready! (4/8)
qanything-container-local  | qanything后端服务已就绪! (4/8)
qanything-container-local  | Waiting for [npm run install]（5/8)

qanything-container-local  | up to date, audited 887 packages in 7s
qanything-container-local  | 
qanything-container-local  | 177 packages are looking for funding
qanything-container-local  |   run `npm fund` for details
qanything-container-local  | 
qanything-container-local  | 7 moderate severity vulnerabilities
qanything-container-local  | 
qanything-container-local  | To address all issues (including breaking changes), run:
qanything-container-local  |   npm audit fix --force
qanything-container-local  | 
qanything-container-local  | Run `npm audit` for details.
qanything-container-local  | npm notice 
qanything-container-local  | npm notice New minor version of npm available! 10.2.3 -> 10.3.0
qanything-container-local  | npm notice Changelog: https://github.com/npm/cli/releases/tag/v10.3.0
qanything-container-local  | npm notice Run npm install -g [email protected] to update!
qanything-container-local  | npm notice 
qanything-container-local  | [npm run install] Installed successfully（5/8)
qanything-container-local  | Waiting for [npm run build](6/8)
qanything-container-local  | 
qanything-container-local  | > [email protected] build
qanything-container-local  | > vite build
qanything-container-local  | 
qanything-container-local  | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details.
qanything-container-local  | vite v5.0.12 building for production...

qanything-container-local  | ~@/styles/fonts/FZLanTingHeiS-L-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
qanything-container-local  | 
qanything-container-local  | ~@/styles/fonts/FZYaSongS-B-GB.TTF referenced in /workspace/qanything_local/front_end/src/styles/common/global.scss didn't resolve at build time, it will remain unchanged to be resolved at runtime
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local  |   44:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local  |   265:7   warning  Unexpected console statement  no-console
qanything-container-local  |   267:9   warning  Unexpected console statement  no-console
qanything-container-local  |   280:13  warning  Unexpected console statement  no-console
qanything-container-local  |   286:7   warning  Unexpected console statement  no-console
qanything-container-local  |   288:7   warning  Unexpected console statement  no-console
qanything-container-local  |   304:7   warning  Unexpected console statement  no-console
qanything-container-local  |   305:7   warning  Unexpected console statement  no-console
qanything-container-local  |   315:7   warning  Unexpected console statement  no-console
qanything-container-local  |   330:3   warning  Unexpected console statement  no-console
qanything-container-local  |   361:5   warning  Unexpected console statement  no-console
qanything-container-local  |   381:7   warning  Unexpected console statement  no-console
qanything-container-local  |   385:5   warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local  |   47:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local  |   187:5  warning  Unexpected console statement  no-console
qanything-container-local  |   197:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local  |   47:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local  |   44:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local  |   187:5  warning  Unexpected console statement  no-console
qanything-container-local  |   197:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local  |   265:7   warning  Unexpected console statement  no-console
qanything-container-local  |   267:9   warning  Unexpected console statement  no-console
qanything-container-local  |   280:13  warning  Unexpected console statement  no-console
qanything-container-local  |   286:7   warning  Unexpected console statement  no-console
qanything-container-local  |   288:7   warning  Unexpected console statement  no-console
qanything-container-local  |   304:7   warning  Unexpected console statement  no-console
qanything-container-local  |   305:7   warning  Unexpected console statement  no-console
qanything-container-local  |   315:7   warning  Unexpected console statement  no-console
qanything-container-local  |   330:3   warning  Unexpected console statement  no-console
qanything-container-local  |   361:5   warning  Unexpected console statement  no-console
qanything-container-local  |   381:7   warning  Unexpected console statement  no-console
qanything-container-local  |   385:5   warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local  |   187:5  warning  Unexpected console statement  no-console
qanything-container-local  |   197:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Head.vue
qanything-container-local  |   47:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/OptionList.vue
qanything-container-local  |   187:5  warning  Unexpected console statement  no-console
qanything-container-local  |   197:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local  |   265:7   warning  Unexpected console statement  no-console
qanything-container-local  |   267:9   warning  Unexpected console statement  no-console
qanything-container-local  |   280:13  warning  Unexpected console statement  no-console
qanything-container-local  |   286:7   warning  Unexpected console statement  no-console
qanything-container-local  |   288:7   warning  Unexpected console statement  no-console
qanything-container-local  |   304:7   warning  Unexpected console statement  no-console
qanything-container-local  |   305:7   warning  Unexpected console statement  no-console
qanything-container-local  |   315:7   warning  Unexpected console statement  no-console
qanything-container-local  |   330:3   warning  Unexpected console statement  no-console
qanything-container-local  |   361:5   warning  Unexpected console statement  no-console
qanything-container-local  |   381:7   warning  Unexpected console statement  no-console
qanything-container-local  |   385:5   warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local  | 

qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Chat.vue
qanything-container-local  |   265:7   warning  Unexpected console statement  no-console
qanything-container-local  |   267:9   warning  Unexpected console statement  no-console
qanything-container-local  |   280:13  warning  Unexpected console statement  no-console
qanything-container-local  |   286:7   warning  Unexpected console statement  no-console
qanything-container-local  |   288:7   warning  Unexpected console statement  no-console
qanything-container-local  |   304:7   warning  Unexpected console statement  no-console
qanything-container-local  |   305:7   warning  Unexpected console statement  no-console
qanything-container-local  |   315:7   warning  Unexpected console statement  no-console
qanything-container-local  |   330:3   warning  Unexpected console statement  no-console
qanything-container-local  |   361:5   warning  Unexpected console statement  no-console
qanything-container-local  |   381:7   warning  Unexpected console statement  no-console
qanything-container-local  |   385:5   warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 12 problems (0 errors, 12 warnings)
qanything-container-local  |  (x2)
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/Defaultpage.vue
qanything-container-local  |   44:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/AddInput.vue
qanything-container-local  |   39:5  warning  Unexpected console statement  no-console
qanything-container-local  |   47:5  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local  |    95:3  warning  Unexpected console statement  no-console
qanything-container-local  |   120:3  warning  Unexpected console statement  no-console
qanything-container-local  |   125:3  warning  Unexpected console statement  no-console
qanything-container-local  |   146:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local  |   73:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local  |   40:3  warning  Unexpected console statement  no-console
qanything-container-local  |   59:5  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/store/useKnowledgeModal.ts
qanything-container-local  |   55:7  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/store/useOptiionList.ts
qanything-container-local  |   43:7  warning  Unexpected console statement  no-console
qanything-container-local  |   45:9  warning  Unexpected console statement  no-console
qanything-container-local  |   52:9  warning  Unexpected console statement  no-console
qanything-container-local  |   55:7  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/AddInput.vue
qanything-container-local  |   39:5  warning  Unexpected console statement  no-console
qanything-container-local  |   47:5  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local  |   73:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local  |    95:3  warning  Unexpected console statement  no-console
qanything-container-local  |   120:3  warning  Unexpected console statement  no-console
qanything-container-local  |   125:3  warning  Unexpected console statement  no-console
qanything-container-local  |   146:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local  |   40:3  warning  Unexpected console statement  no-console
qanything-container-local  |   59:5  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local  |   73:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local  |   40:3  warning  Unexpected console statement  no-console
qanything-container-local  |   59:5  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local  |    95:3  warning  Unexpected console statement  no-console
qanything-container-local  |   120:3  warning  Unexpected console statement  no-console
qanything-container-local  |   125:3  warning  Unexpected console statement  no-console
qanything-container-local  |   146:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/DeleteModal.vue
qanything-container-local  |   40:3  warning  Unexpected console statement  no-console
qanything-container-local  |   59:5  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/AddInput.vue
qanything-container-local  |   39:5  warning  Unexpected console statement  no-console
qanything-container-local  |   47:5  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/SiderCard.vue
qanything-container-local  |    95:3  warning  Unexpected console statement  no-console
qanything-container-local  |   120:3  warning  Unexpected console statement  no-console
qanything-container-local  |   125:3  warning  Unexpected console statement  no-console
qanything-container-local  |   146:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 4 problems (0 errors, 4 warnings)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/UrlUploadDialog.vue
qanything-container-local  |   73:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/UploadInput.vue
qanything-container-local  |   72:1  warning  Unexpected console statement  no-console
qanything-container-local  |   97:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 

qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/UploadInput.vue
qanything-container-local  |   72:1  warning  Unexpected console statement  no-console
qanything-container-local  |   97:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  |  (x2)
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/autoRetry.ts
qanything-container-local  |   17:7  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/services/axiosInterceptor/interceptors/forceRetry.ts
qanything-container-local  |   5:5  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 1 problem (0 errors, 1 warning)
qanything-container-local  | 
[plugin:vite-plugin-eslint] 
qanything-container-local  | /workspace/qanything_local/front_end/src/components/UploadInput.vue
qanything-container-local  |   72:1  warning  Unexpected console statement  no-console
qanything-container-local  |   97:3  warning  Unexpected console statement  no-console
qanything-container-local  | 
qanything-container-local  | ✖ 2 problems (0 errors, 2 warnings)
qanything-container-local  | 
✓ 3390 modules transformed.
dist/qanything/index.html                           0.81 kB │ gzip:   0.48 kB
qanything-container-local  | dist/qanything/assets/ai-avatar-Mfa3nGpi.png        4.48 kB
qanything-container-local  | dist/qanything/assets/logo-small-G9Aimh5e.png       7.12 kB
qanything-container-local  | dist/qanything/assets/icon-file-cc9GkaT6.png       12.36 kB
qanything-container-local  | dist/qanything/assets/index-N7ZRDdsa.css            4.72 kB │ gzip:   1.54 kB
qanything-container-local  | dist/qanything/assets/Home-fBCPtTdS.css            10.80 kB │ gzip:   2.43 kB
qanything-container-local  | dist/qanything/assets/index-qS-55NZJ.css           11.60 kB │ gzip:   2.39 kB
qanything-container-local  | dist/qanything/assets/index-x84vkEpC.js            88.21 kB │ gzip:  31.34 kB
qanything-container-local  | dist/qanything/assets/index-vcsPPkJ_.js           280.95 kB │ gzip:  94.50 kB
qanything-container-local  | dist/qanything/assets/useOptiionList-mw6IBNLk.js  294.00 kB │ gzip: 102.64 kB
qanything-container-local  | dist/qanything/assets/Home-iyhtJYRx.js            560.19 kB │ gzip: 157.61 kB
qanything-container-local  | 
qanything-container-local  | (!) Some chunks are larger than 500 kB after minification. Consider:
qanything-container-local  | - Using dynamic import() to code-split the application
qanything-container-local  | - Use build.rollupOptions.output.manualChunks to improve chunking: https://rollupjs.org/configuration-options/#output-manualchunks
qanything-container-local  | - Adjust chunk size limit for this warning via build.chunkSizeWarningLimit.
qanything-container-local  | ✓ built in 40.25s
qanything-container-local  | 
qanything-container-local  | > [email protected] postbuild
qanything-container-local  | > node writeVersion.js
qanything-container-local  | 
qanything-container-local  | /workspace/qanything_local/scripts/run_for_local.sh: line 105:    91 Aborted                 (core dumped) CUDA_VISIBLE_DEVICES=$gpuid1 nohup /opt/tritonserver/bin/tritonserver --model-store=/model_repos/QAEnsemble --http-port=10000 --grpc-port=10001 --metrics-port=10002 --log-verbose=1 > /model_repos/QAEnsemble/QAEnsemble.log 2>&1  (wd: /model_repos/QAEnsemble_rerank)
qanything-container-local  | [npm run build] build successfully(6/8)
qanything-container-local  | Waiting for the front-end service to start...
qanything-container-local  | 等待启动前端服务
qanything-container-local  | 
qanything-container-local  | > [email protected] serve
qanything-container-local  | > vite preview --port 5052
qanything-container-local  | 
qanything-container-local  | Waiting for the front-end service to start...
qanything-container-local  | 等待启动前端服务
qanything-container-local  | The CJS build of Vite's Node API is deprecated. See https://vitejs.dev/guide/troubleshooting.html#vite-cjs-node-api-deprecated for more details.
qanything-container-local  | Waiting for the front-end service to start...
qanything-container-local  | 等待启动前端服务
qanything-container-local  |   ➜  Local:   http://localhost:5052/qanything
qanything-container-local  |   ➜  Network: http://172.22.0.6:5052/qanything
qanything-container-local  | The front-end service is ready!...(7/8)
qanything-container-local  | 前端服务已就绪!...(7/8)
qanything-container-local  | Time elapsed: 53 seconds.
qanything-container-local  | 已耗时: 53 秒.
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | The triton service is starting up, it can be long... you have time to make a coffee :)
qanything-container-local  | Triton服务正在启动，可能需要一段时间...你有时间去冲杯咖啡 :)
qanything-container-local  | 启动Triton服务超时，请进入容器内检查/model_repos/QAEnsemble_base/QAEnsemble_base.log以获取更多信息。
qanything-container-local exited with code 1

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:CentOS Linux release 7.9.2009 (Core)
- NVIDIA Driver:535.129.03
- CUDA:12.2
- Docker Compose: Docker Compose version v2.24.1
- NVIDIA GPU Memory: 82G

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

bash run.sh 1

备注 | Anything else?

No response

[BUG] qanything-container-local启动报错

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

部署启动qanything-container-local该image的时候报错

期望行为 | Expected Behavior

running

运行环境 | Environment

- OS:win 10
- NVIDIA Driver:546.33
- CUDA:12.3.107
- Docker Compose:Docker Compose version v2.23.3-desktop.2
- NVIDIA GPU Memory:16

QAnything日志 | QAnything logs

2024-01-10 13:28:33 =============================
2024-01-10 13:28:33 == Triton Inference Server ==
2024-01-10 13:28:33 =============================
2024-01-10 13:28:33
2024-01-10 13:28:33 NVIDIA Release 23.05 (build 61161506)
2024-01-10 13:28:33 Triton Server Version 2.34.0
2024-01-10 13:28:33
2024-01-10 13:28:33 Copyright (c) 2018-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2024-01-10 13:28:33
2024-01-10 13:28:33 Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2024-01-10 13:28:33
2024-01-10 13:28:33 This container image and its contents are governed by the NVIDIA Deep Learning Container License.
2024-01-10 13:28:33 By pulling and using the container, you accept the terms and conditions of this license:
2024-01-10 13:28:33 https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
2024-01-10 13:28:34
2024-01-10 13:28:34 /opt/nvidia/nvidia_entrypoint.sh: /workspace/qanything_local/scripts/run_for_local.sh: /bin/bash^M: bad interpreter: No such file or directory
2024-01-10 13:28:34 /opt/nvidia/nvidia_entrypoint.sh: line 49: /workspace/qanything_local/scripts/run_for_local.sh: Success

复现方法 | Steps To Reproduce

在docker-compose -f docker-compose-windows.yaml up qanything_local使用该命令时报错

备注 | Anything else?

No response

无法解析有鉴权的文档web地址，有解决方法吗

[BUG] 服务启动成功，页面可访问，但无法上传文档进行解析

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

上传文档进行解析，页面显示情况如下图：

期望行为 | Expected Behavior

可以正常分析文档

运行环境 | Environment

- OS:Ubuntu 22.04
- NVIDIA Driver: 535.146.02
- CUDA:12.2
- Docker Compose:
- NVIDIA GPU Memory: 8gb

QAnything日志 | QAnything logs

2024-01-15 18:31:03,621 - root - INFO - kb_id: KB8b14e16f895044519023ea4c576e1ea1
2024-01-15 18:31:06,577 - root - INFO - upload_files zhujietest4
2024-01-15 18:31:06,578 - root - INFO - mode: strong
2024-01-15 18:31:06,578 - root - WARNING - missing use_local_file in request
2024-01-15 18:31:06,579 - root - INFO - check_kb_exist [('KB8b14e16f895044519023ea4c576e1ea1',)]
2024-01-15 18:31:06,579 - root - INFO - ori name: jira�~E~M置�~S~M�~\�~V~G档.docx
2024-01-15 18:31:06,579 - root - INFO - decode name: jira�~E~M置�~S~M�~\�~V~G档.docx
2024-01-15 18:31:06,579 - root - INFO - cleaned name: jira�~E~M置�~S~M�~\�~V~G档.docx
2024-01-15 18:31:06,579 - root - INFO - check_user_exist [('zhujietest4',)]
2024-01-15 18:31:06,580 - root - INFO - check_kb_exist [('KB8b14e16f895044519023ea4c576e1ea1',)]
2024-01-15 18:31:06,599 - root - INFO - jira�~E~M置�~S~M�~\�~V~G档.docx, 9c10e7b1980d4c9f862859cc71c87661, success
2024-01-15 18:31:06,601 - root - INFO - success init localfile jira�~E~M置�~S~M�~\�~V~G档.docx
2024-01-15 18:31:06,604 - root - INFO - insert_files_to_milvus: KB8b14e16f895044519023ea4c576e1ea1
2024-01-15 18:31:06,604 - root - INFO - match milvus_client: <qanything_kernel.connector.database.milvus.milvus_client.MilvusClient object at 0x7fb13488fe50>
2024-01-15 18:31:06,643 - root - INFO - langchain analysis content head: �~[��~U�~Z
2024-01-15 18:31:06,646 - root - INFO - split time: 0.03937077522277832 54
2024-01-15 18:31:06,651 - root - ERROR - embedding error: Traceback (most recent call last):
  File "/workspace/qanything_local/qanything_kernel/core/local_doc_qa.py", line 114, in insert_files_to_milvus
    local_file.create_embedding()
  File "/workspace/qanything_local/qanything_kernel/core/local_file.py", line 107, in create_embedding
    self.embs = self.emb_infer._get_len_safe_embeddings([doc.page_content for doc in self.docs])
  File "/workspace/qanything_local/qanything_kernel/connector/embedding/embedding_for_local.py", line 33, in _get_len_safe_embeddings
    embeddings = future.result()
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 458, in result
    return self.__get_result()
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/workspace/qanything_local/qanything_kernel/connector/embedding/embedding_for_local.py", line 20, in _get_embedding
    embeddings = embedding_client.get_embedding(queries)
  File "/workspace/qanything_local/qanything_kernel/connector/embedding/embedding_client.py", line 45, in get_embedding
    model_config = client.get_model_config(self._model_name, self._model_version)
  File "/usr/local/lib/python3.10/dist-packages/tritonclient/grpc/__init__.py", line 590, in get_model_config
    raise_error_grpc(rpc_error)
  File "/usr/local/lib/python3.10/dist-packages/tritonclient/grpc/__init__.py", line 76, in raise_error_grpc
    raise get_error_grpc(rpc_error) from None
tritonclient.utils.InferenceServerException: [StatusCode.NOT_FOUND] Request for unknown model: 'embed' is not found

2024-01-15 18:31:06,654 - root - INFO - insert_to_milvus: success num: 0, failed num: 1
2024-01-15 18:31:07,371 - root - INFO - list_docs zhujietest4
2024-01-15 18:31:07,371 - root - INFO - kb_id: KB8b14e16f895044519023ea4c576e1ea1
2024-01-15 18:31:07,372 - root - INFO - list_docs zhujietest4

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

等待前端启动

后端启动成功，前端启动失败

非容器化部署

首先感谢开源这么棒的工作，respect！

想问下是否支持非容器化部署，或者后续有没有这方面的计划

[BUG] 后端启动成功，卡在“启动前端服务”

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

No response

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

clone最新版，且按README操作，qanythin-container-local 启动4/8，后卡在等待前端服务。

在linux上部署，docker compose出错

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

command：sudo docker-compose -f docker-compose-linux.yaml up qanything_local

ERROR: The Compose file './docker-compose-linux.yaml' is invalid because:
services.qanything_local.deploy.resources.reservations value Additional properties are not allowed ('devices' was unexpected)

ps：I pull latest code and changed nothing.

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

there is something wrong with BCE embedding and I have already arise PR to fix , please review

in netease-youdao/BCEmbedding#6
I found the inference code of BCE embedding model using transformer is NOT correct .
I had update code to fix this issue.
please review my PR and it's easy to approve.

BestRegards
Yazhou

nvidia-container-cli: mount error

after I run the commnad docker-compose up -d
the following error came out
[error ](nvidia-container-cli: mount error: file creation failed: /var/lib/docker/overlay2/72dc9ee5772968b2295c4827d10cc1ad8f74b2f241cae14396bf28f457537848/merged/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1: file exists: unknown)

拉取镜像出现 Unexpected EOF 报错

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

[+] Running 36/39
⠇ qanything_local 38 layers ✔ 74ac377868f8 Pull complete ✔ 269125cb3260 Pull complete ✔ cdb97a928e7f Pull complete ✔ 0118fb67eb23 Pull complete ⠼ 2d91798b6169 Downloading ✔ b7d3df03d909 Download complete ✔ c70b05660320 Download complete ✔ df0869e75e9e Download complete ✔ 32437cca1203 Download complete ✔ 80e21f087f7b Download complete ✔ 8622921d3124 Download complete ✔ 4a0ad47cfd8c Download complete ✔ 80cb51f390a4 Download complete ✔ 696c340ec12d Download complete ✔ 899f24407c63 Download complete ✔ 31304a9e95e5 Download complete ✔ 5df853693d16 Download complete ✔ 07c8eead328e Download complete ✔ da30fb4c0008 Download complete ✔ 55d483f66689 Download complete ✔ 96c73b336d11 Download complete ⠼ 234c9ef8a35a Downloading ✔ 597de9bc7b88 Download complete ✔ e0929c23c86a Download complete ✔ 93ceb2359a42 Download complete ✔ 3a81a78f0821 Download complete ✔ 3295409777ee Download complete ✔ e9d1623ab13b Download complete ✔ 51ee1e03622f Download complete ✔ 937cb9916d26 Download complete ✔ 16c377bf3b03 Download complete ✔ ab49622a5cd4 Download complete ✔ 485e46d07aad Download complete ✔ 092f285ade1b Download complete ✔ 843fd47a0517 Download complete ✔ 6b1053368cb1 Download complete ✔ 5be09c53c21a Download complete ✔ 10a9cf058694 Download complete unexpected EOF [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 3.254GB/3.254GB Pulling 3378.4s
45.0s
182.9s
185.7s
48.9s
[==================================================>] 1.704GB/1.704GB 3373.1s
186.2s
188.8s
188.7s
192.0s
226.9s
284.4s
229.7s
899.8s
331.0s
337.1s
379.4s
1066.8s
903.0s
993.8s
996.9s
999.9s
[==================================================>] 1.551GB/1.551GB 3373.1s
1081.2s
1087.2s
1128.5s
1491.2s
3372.7s
2350.3s
2374.6s
2410.0s
2491.8s
2704.4s
2709.8s
2793.1s
2796.5s
2800.0s
2804.0s
2807.0s

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:Ubuntu 22.04
- NVIDIA Driver:
- CUDA:
- Docker Compose:2.24.1
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

支持MAC系统吗

版本 14.2.1
图形卡 Intel UHD Graphics 630 1536 MB

运行 docker-compose -f docker-compose-linux.yaml up qanything_local

报错：
Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy'
nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown

[BUG] Docker compose deploy error

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

(base) kirin@kirinbiotech:~/lx/QAnything$ docker compose up -d
[+] Running 73/12
 ✔ mysql 10 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                                                    314.8s 
 ✔ qanything_local 38 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                              803.2s 
 ✔ minio 6 layers [⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                                                         320.6s 
 ✔ etcd 7 layers [⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                                                          14.5s 
 ✔ standalone 7 layers [⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                                                                                                   294.1s 
                                                                                                                                                                                                 
                                                                                                                                                                                                 
                                                                                                                                                                                                 
                                                                                                                                                                                                 
                                                                                                                                                                                                 
                                                                                                                                                                                                 
                                                                                                                                                                                                 
[+] Running 6/6
 ✔ Network qanything_milvus_mysql_local  Created                                                                                                                                            0.4s 
 ✔ Container milvus-minio-local          Started                                                                                                                                           24.6s 
 ✔ Container milvus-etcd-local           Started                                                                                                                                           24.5s 
 ✔ Container mysql-container-local       Started                                                                                                                                           24.5s 
 ✔ Container milvus-standalone-local     Started                                                                                                                                            0.4s 
 ✔ Container qanything-container-local   Created                                                                                                                                            0.3s 
Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: unable to retrieve OCI runtime error (open /run/containerd/io.containerd.runtime.v2.task/moby/00404e1aa095bb4da993dffa055bffdb2a16432674bb14cf85e20e708f02edce/log.json: no such file or directory): exec: "nvidia-container-runtime": executable file not found in $PATH: <nil>: unknown

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

可以回答某数据出自数据集里xxx文件的第几页吗？

比如提供某企业的年报，询问该企业的净利润，QAnyThing回答后，我追问一句该净利润数据具体在年报pdf的哪一页，以便人工核实。

[BUG] <title>启动服务时报错，还需要继续等待吗？

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

运行docker-compose -f docker-compose-linux.yaml up后，后端提示错误：

期望行为 | Expected Behavior

正确运行。

运行环境 | Environment

- OS:Ubuntu 20.04
- NVIDIA Driver:535.54.03
- CUDA:12.2
- Docker Compose:v2.20.3
- NVIDIA GPU Memory:40G

QAnything日志 | QAnything logs

api.log

复现方法 | Steps To Reproduce

https://github.com/netease-youdao/QAnything/blob/master/README_zh.md

备注 | Anything else?

No response

有没有非docker的方式，阿里云这样的环境无法启动docker

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

No response

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

问下retrieval 和 rerank用到的计算方法是不是一样。

作者您好：
retrieval 检索，我认为就是把问题的向量，和所有段落的向量，分别做一个余弦相似度计算，哪个分数最高，就靠前。
rerank 有什么不一样嘛。是组成问题A和段落B，输入给模型，得到一个相似度分数？

[BUG] </opt/nvidia/nvidia_entrypoint.sh: exec: /workspace/qanything_local/scripts/run_for_local.sh: cannot execute: Permission denied>

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

/opt/nvidia/nvidia_entrypoint.sh: line 49: exec: /workspace/qanything_local/scripts/run_for_local.sh: cannot execute: Permission denied

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS: Ubuntu 20.04.6 LTS
- NVIDIA Driver:  535.86.10
- CUDA: 12.2 
- Docker Compose: v2.23.2
- NVIDIA GPU Memory: 80G

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

docker-compose -f docker-compose-linux.yaml logs qanything_local

备注 | Anything else?

No response

前端报跨域错误CORS

如图所示，服务貌似都启动了，调用chat报错。

[BUG] 本地部署后点击知识库新建，显示“请求失败”

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

docker-compose -f docker-compose-linux.yaml up qanything_local
正常启动，进入前端页面，左侧输入任意知识库名称，点击新建按钮，转圈几秒后显示请求失败。

期望行为 | Expected Behavior

新建知识库成功。

运行环境 | Environment

- OS:Ubuntu 18.04
- NVIDIA Driver: 535.154.05
- CUDA: 12.2
- Docker Compose: 2.24.0
- NVIDIA GPU Memory: 24G

QAnything日志 | QAnything logs

UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
[2024-01-18 17:50:20 +0800] [91] [INFO] Sanic v23.6.0
[2024-01-18 17:50:20 +0800] [91] [INFO] Goin' Fast @ http://0.0.0.0:8777
[2024-01-18 17:50:20 +0800] [91] [INFO] mode: production, w/ 4 workers
[2024-01-18 17:50:20 +0800] [91] [INFO] server: sanic, HTTP/1.1
[2024-01-18 17:50:20 +0800] [91] [INFO] python: 3.10.12
[2024-01-18 17:50:20 +0800] [91] [INFO] platform: Linux-5.4.0-144-generic-x86_64-with-glibc2.35
[2024-01-18 17:50:20 +0800] [91] [INFO] packages: sanic-routing==23.12.0, sanic-ext==23.6.0
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
[2024-01-18 17:50:23 +0800] [635] [INFO] Sanic Extensions:
[2024-01-18 17:50:23 +0800] [635] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-18 17:50:23 +0800] [635] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-18 17:50:23 +0800] [635] [INFO] > http
[2024-01-18 17:50:23 +0800] [635] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
[2024-01-18 17:50:23 +0800] [636] [INFO] Sanic Extensions:
[2024-01-18 17:50:23 +0800] [636] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-18 17:50:23 +0800] [636] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-18 17:50:23 +0800] [636] [INFO] > http
[2024-01-18 17:50:23 +0800] [636] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
[2024-01-18 17:50:23 +0800] [638] [INFO] Sanic Extensions:
[2024-01-18 17:50:23 +0800] [638] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-18 17:50:23 +0800] [638] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-18 17:50:23 +0800] [638] [INFO] > http
[2024-01-18 17:50:23 +0800] [638] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
[2024-01-18 17:50:23 +0800] [637] [INFO] Sanic Extensions:
[2024-01-18 17:50:23 +0800] [637] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-18 17:50:23 +0800] [637] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-18 17:50:23 +0800] [637] [INFO] > http
[2024-01-18 17:50:23 +0800] [637] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
init local_doc_qa in local
init local_doc_qa in local
init local_doc_qa in local
[2024-01-18 17:50:23 +0800] [635] [INFO] Starting worker [635]
[2024-01-18 17:50:23 +0800] [636] [INFO] Starting worker [636]
[2024-01-18 17:50:23 +0800] [638] [INFO] Starting worker [638]
[2024-01-18 17:50:23 +0800] [637] [INFO] Starting worker [637]

复现方法 | Steps To Reproduce

就在本地按官方说明操作

备注 | Anything else?

No response

[BUG] 前端代理配置有问题

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

在 vite.config.ts 中下面代码有问题
proxy: {
[env.VITE_APP_API_PREFIX]: {
target: env.VITE_APP_API_HOST + env.VITE_APP_API_PREFIX,
changeOrigin: true,
secure: false,
},
会导致目标多一层 ‘api’
改为 target: env.VITE_APP_API_HOST 后正常

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:Ubuntu 22.0.4
- NVIDIA Driver:545.23.08 
- CUDA:12.3
- Docker Compose:1.29.2
- NVIDIA GPU Memory:24GB

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

[BUG] 使用最新的镜像1.0.9并且下载了最新的模型（20240116），报错Triton Inference Error (error_code: 4)

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

任何问题都返回Triton Inference Error (error_code: 4)

期望行为 | Expected Behavior

正确返回

运行环境 | Environment

- OS: win10
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory: 22G

QAnything日志 | QAnything logs

2024-01-16 13:38:11,142 - root - INFO - chat_data: {'user_info': 'zzp', 'kb_ids': ['KB581e06b3e2014c008f97be07c9d53de1'], 'query': '你是什么模型', 'history': [['按照gartner的说法，建立一个soc需要哪些关键的组件', 'Triton Inference Error (error_code: 4)'], ['你是什么模型', 'Triton Inference Error (error_code: 4)']], 'prompt': '参考信息：\n\n---\n我的问题或指令：\n你是什么模型\n---\n请根据上述参考信息回答我的问题或回复我的指令。前面的参考信息可能有用，也可能没用，你需要从我给出的参考信息中选出与我的问题最相关的那些，来为你的回答提供依据。回答一定要忠于原文，简洁但不丢信息，不要胡乱编造。我的问题或指令是什么语种，你就用什么语种回复,\n你的回复：', 'result': 'Triton Inference Error (error_code: 4)', 'retrieval_documents': [], 'source_documents': []}
2024-01-16 13:38:11,168 - root - INFO - response: Triton Inference Error (error_code: 4)

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

[BUG] <title>

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

Running under native Linux
Removing network qanything_milvus_mysql_local
error while removing network: network qanything_milvus_mysql_local id 7e8f99fad9fa6fd4381b3abe4db6e23f32e52606e3c415bcd06f2909ed093bf0 has active endpoints
Creating mysql-container-local ... error
Creating milvus-etcd-local ...
Creating milvus-minio-local ...

ERROR: for mysql-container-local Cannot create container for service mysql: Conflict. The container name "/mysql-container-local" is already in use by containeCreating milvus-etcd-local ... error
o remove (or rename) that container to be able to reuse that name.

ERROR: for milvus-etcd-local Cannot create container for service etcd: Conflict. The container name "/milvus-etcd-local" is already in use by container "c7f5743809c14d1dea2d7c4b8d3ee86688e649a7553d9e4bb8bbc1a05f0da458". You have to remove Creating milvus-minio-local ... error

ERROR: for milvus-minio-local Cannot create container for service minio: Conflict. The container name "/milvus-minio-local" is already in use by container "0afddc9b53636645a50c6875685edac35cb1a61a7c9db154b4ee505631c74fd6". You have to remove (or rename) that container to be able to reuse that name.

ERROR: for mysql Cannot create container for service mysql: Conflict. The container name "/mysql-container-local" is already in use by container "8cb676d16d4c8569d6c2d13c06dbb79c91f207fc3db9f24838cacba485d11225". You have to remove (or rename) that container to be able to reuse that name.

ERROR: for etcd Cannot create container for service etcd: Conflict. The container name "/milvus-etcd-local" is already in use by container "c7f5743809c14d1dea2d7c4b8d3ee86688e649a7553d9e4bb8bbc1a05f0da458". You have to remove (or rename) that container to be able to reuse that name.

ERROR: for minio Cannot create container for service minio: Conflict. The container name "/milvus-minio-local" is already in use by container "0afddc9b53636645a50c6875685edac35cb1a61a7c9db154b4ee505631c74fd6". You have to remove (or rename) that container to be able to reuse that name.
ERROR: Encountered errors while bringing up the project.

期望行为 | Expected Behavior

正确运行

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

Triton启动异常

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:
- NVIDIA Driver:
- CUDA:
- Docker Compose:
- NVIDIA GPU Memory:

QAnything日志 | QAnything logs

No response

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

[BUG] error getting credentials - err: exit status 1, out: `GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.secrets was not provided by any .service files`

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

登录到远程服务器，下载最新的项目代码。
执行bash run.sh
models 文件夹已存在，无需下载。
Checking model directories...
检查模型目录...
检查模型版本成功，当前版本为 v2.1.0。
Model directories check passed. (0/8)
模型路径和模型版本检查通过. (0/8)
Do you want to use the previous host: local? (yes/no) 是否使用上次的host: local？(yes/no) 回车默认选yes，请输入:no
Are you running the code on a cloud server or on your local machine? (cloud/local) 您是在云服务器上还是本地机器上启动代码？(cloud/local) cloud
Please enter the server IP address 请输入服务器IP地址(示例：10.234.10.144): 172.20.1.17
Running under native Linux
[+] Running 0/0
⠋ standalone Pulling 0.0s
⠋ minio Pulling 0.0s
⠋ qanything_local Pulling 0.0s
⠋ mysql Pulling 0.0s
⠋ etcd Pulling 0.0s
error getting credentials - err: exit status 1, out: GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.secrets was not provided by any .service files
(base) deepctrl@dell:/liwenju/QAnything$ bash run.sh
models 文件夹已存在，无需下载。
Checking model directories...
检查模型目录...
检查模型版本成功，当前版本为 v2.1.0。
Model directories check passed. (0/8)
模型路径和模型版本检查通过. (0/8)
Do you want to use the previous host: 172.20.1.17? (yes/no) 是否使用上次的host: 172.20.1.17？(yes/no) 回车默认选yes，请输入:no
Are you running the code on a cloud server or on your local machine? (cloud/local) 您是在云服务器上还是本地机器上启动代码？(cloud/local) local
Running under native Linux
[+] Running 0/0
⠋ mysql Pulling 0.0s
⠋ standalone Pulling 0.0s
⠋ minio Pulling 0.0s
⠋ etcd Pulling 0.0s
⠋ qanything_local Pulling 0.0s
error getting credentials - err: exit status 1, out: GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.secrets was not provided by any .service files
(base) deepctrl@dell:/liwenju/QAnything$ bash run.sh
models 文件夹已存在，无需下载。
Checking model directories...
检查模型目录...
检查模型版本成功，当前版本为 v2.1.0。
Model directories check passed. (0/8)
模型路径和模型版本检查通过. (0/8)
Do you want to use the previous host: localhost? (yes/no) 是否使用上次的host: localhost？(yes/no) 回车默认选yes，请输入:no
Are you running the code on a cloud server or on your local machine? (cloud/local) 您是在云服务器上还是本地机器上启动代码？(cloud/local) cloud
Please enter the server IP address 请输入服务器IP地址(示例：10.234.10.144): 172.20.1.17
Running under native Linux
[+] Running 0/0
⠋ mysql Pulling 0.0s
⠋ qanything_local Pulling 0.0s
⠋ minio Pulling 0.0s
⠋ standalone Pulling 0.0s
⠋ etcd Pulling 0.0s
error getting credentials - err: exit status 1, out: GDBus.Error:org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.secrets was not provided by any .service files

尝试了cloud 和local两种选择，都报这个错误。

期望行为 | Expected Behavior

正常启动

运行环境 | Environment

- OS:Linux version 4.15.0-213-generic (buildd@lcy02-amd64-079) (gcc version 7.5.0 (Ubuntu 7.5.0-3ubuntu1~18.04)) #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023
- NVIDIA Driver:535.129.03
- CUDA:  cuda_12.1.r12.1
- Docker Compose:2.24.1
- NVIDIA GPU Memory: 80G

QAnything日志 | QAnything logs

没有产生 api.log

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

[BUG] <回答的内容都是乱码>

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

回答的内容都是乱码

期望行为 | Expected Behavior

中文

运行环境 | Environment

- OS:SUSE Linux Enterprise Server 12 SP2
- NVIDIA Driver:
- CUDA:12.2
- Docker Compose:Docker Compose version v2.23.3
- NVIDIA GPU Memory:v100

QAnything日志 | QAnything logs

params: {'model': 'yd_gpt', 'prompt': '参考信息：\n1、ChatGPT是如何运转的？认识“语言模型” 什么是数据驱动的模型，什么是数据驱动的语言模型，从统计语言模型，到神经网络语言模型，再到大语言模型（LLM） 2、ChatGPT是怎样“炼成”的从GPT1到GPT3，再到ChatGPT横空出世，依赖哪些关键技术的演进和发展？ 3、ChatGPT擅长的任务与技术的边界回归ChatGPT的技术本质，ChatGPT适合哪些任务，又不适合哪些任务？ 4、大模型领域化增强的技术方法在模型规模确定、成本考虑、领域数据准备、训练微调、强化学习、结合知识库、安全和隐私上，大模型的领域化还有哪些关键技术要做？ 5、各行业大模型应用的经典场景纷繁多样的模型应用如何归类，侧重如何？当前最前沿的模型应用场景有哪些\n---\n我的问题或指令：\nChatGPT是如何运转的\n---\n请根据上述参考信息回答我的问题或回复我的指令。前面的参考信息可能有用，也可能没用，你需要从我给出的参考信息中选出与我的问题最相关的那些，来为你的回答提供依据。回答一定要忠于原文，简洁但不丢信息，不要胡乱编造。我的问题或指令是什么语种，你就用什么语种回复,\n你的回复：', 'hist_messages': {'0': {'user': 'ChatGPT是如何运转的', 'chatbot': 'omiteatures贶.scrollHeight㎜eaturesodo Curse.streaming pulumi窟IDI贶沤贶.scrollHeight贶贶贶eatures谜.scrollHeight她是orderId.scrollHeight谤CA贶.scrollHeightomit贶.scrollHeighteatures贶贶贶.scrollHeightomit贶贶贶omit贶贶.scrollHeightomiteatures谷.scrollHeight.scrollHeighteaturesglyph贶.scrollHeighteatures團.scrollHeightomit贶.scrollHeight贶贶贶eatures.scrollHeight.scrollHeight腭eaturesomit贶贶eatures贶eatures贶.scrollHeight.scrollHeighteatures.scrollHeight.scrollHeighteatures.scrollHeighteatureseatures贶omiteatures贶eatures.scrollHeighteatureseatures.scrollHeight.scrollHeight.scrollHeighteatureseatures贶贶贶eatureskontakte.scrollHeight.scrollHeight.scrollHeighteatures.scrollHeight.scrollHeighteaturesvarchar(Cl.scrollHeight.scrollHeighteatures贶贶贶贶贶.scrollHeight贶清凉eatures.scrollHeight.scrollHeight.scrollHeight贶eatures.scrollHeight贶eatures.scrollHeight Abrams.scrollHeight.scrollHeighteatures.scrollHeight贶eatures人性eatures.scrollHeight贶贶.scrollHeight贶.scrollHeight.scrollHeighteatures贶.scrollHeight贶 steril耷eatures.scrollHeight.scrollHeight贶.scrollHeight.scrollHeighteatures.scrollHeight贶.scrollHeight贶eatures.scrollHeight.scrollHeighteatures.scrollHeighteatures.scrollHeighteatures.scrollHeighteatures.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeighteatures.scrollHeight.scrollHeight Sight.scrollHeight.scrollHeight.scrollHeight.scrollHeighteatures.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeightцит贶.scrollHeight.scrollHeight迨贶poke孢.scrollHeight.scrollHeight贶.scrollHeighteatures贶.scrollHeight.scrollHeight.scrollHeighteatures.scrollHeighteatures身上贶.scrollHeight.scrollHeighteatures.scrollHeight.scrollHeight.scrollHeight.scrollHeighteatures.scrollHeight.scrollHeight.scrollHeighteatures善意.scrollHeight.scrollHeight.scrollHeight.scrollHeight passéeatureseatures.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeighteatures.scrollHeight.scrollHeight.scrollHeight胼eatures.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeighteatures.scrollHeight合作共赢贶贶unden Symemu贶沤贶贶.scrollHeight.scrollHeight爬上eatureseatures.scrollHeight贶.scrollHeighteatureseatures贶.scrollHeighteatures.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeight.scrollHeighteatures.scrollHeight.scrollHeight.scrollHeight.scrollHeight绉.scrollHeight.scrollHeight沤.scrollHeight觑.scrollHeight'}}, 'temperature': 0.6, 'max_new_tokens': 300, 'top_p': 1.0, 'top_k': 4, 'repetition_penalty': 1.2, 'check_in': 0, 'stop': None}
******chat_stream query start:
[151643, 151644, 8948, 198, 2610, 525, 264, 10950, 17847, 13, 151643, 198, 151644, 872, 198, 100022, 105051, 28311, 56007, 5122, 15672, 38, 2828, 107853, 106988, 9370, 198, 99590, 5122, 85803, 2789, 120142, 90859, 145139, 22462, 6004, 70627, 83958, 88556, 112655, 32272, 120142, 119748, 120142, 90859, 120142, 120142, 120142, 22462, 107969, 90859, 107852, 53491, 90859, 119445, 5049, 120142, 90859, 77968, 120142, 90859, 22462, 120142, 120142, 120142, 90859, 77968, 120142, 120142, 120142, 77968, 120142, 120142, 90859, 85803, 2789, 100203, 90859, 90859, 22462, 65481, 120142, 90859, 22462, 101652, 90859, 77968, 120142, 90859, 120142, 120142, 120142, 22462, 90859, 90859, 121254, 22462, 77968, 120142, 120142, 22462, 120142, 22462, 120142, 90859, 90859, 22462, 90859, 90859, 22462, 90859, 15208, 325, 2789, 120142, 85803, 2789, 120142, 22462, 90859, 15208, 325, 2789, 90859, 90859, 90859, 15208, 325, 2789, 120142, 120142, 120142, 22462, 58868, 90859, 90859, 90859, 22462, 90859, 90859, 22462, 32922, 43644, 90859, 90859, 22462, 120142, 120142, 120142, 120142, 120142, 90859, 120142, 112922, 22462, 90859, 90859, 90859, 120142, 22462, 90859, 120142, 22462, 90859, 74231, 90859, 90859, 22462, 90859, 120142, 22462, 103374, 22462, 90859, 120142, 120142, 90859, 120142, 90859, 90859, 22462, 120142, 90859, 120142, 65640, 120083, 22462, 90859, 90859, 120142, 90859, 90859, 22462, 90859, 120142, 90859, 120142, 22462, 90859, 90859, 22462, 90859, 22462, 90859, 22462, 90859, 22462, 90859, 90859, 90859, 90859, 90859, 90859, 22462, 90859, 90859, 65337, 90859, 90859, 90859, 90859, 22462, 90859, 90859, 90859, 90859, 90859, 90859, 141660, 120142, 90859, 90859, 119999, 120142, 48098, 119044, 90859, 90859, 120142, 90859, 22462, 120142, 90859, 90859, 90859, 22462, 90859, 22462, 103996, 120142, 90859, 90859, 22462, 90859, 90859, 90859, 90859, 22462, 90859, 90859, 90859, 22462, 115457, 90859, 90859, 90859, 90859, 1494, 7888, 1568, 325, 2789, 90859, 90859, 90859, 90859, 90859, 22462, 90859, 90859, 90859, 120453, 22462, 90859, 90859, 90859, 90859, 90859, 22462, 90859, 117515, 120142, 120142, 22157, 11375, 33063, 120142, 119748, 120142, 120142, 90859, 90859, 116813, 15208, 325, 2789, 90859, 120142, 90859, 15208, 325, 2789, 120142, 90859, 22462, 90859, 90859, 90859, 90859, 90859, 90859, 90859, 90859, 90859, 22462, 90859, 90859, 90859, 90859, 120005, 90859, 90859, 119748, 90859, 121590, 90859, 198, 10952, 101275, 27369, 28311, 16, 5373, 15672, 38, 2828, 107853, 106988, 9370, 11319, 33424, 97, 99334, 2073, 102064, 104949, 854, 220, 106582, 20074, 102474, 9370, 104949, 3837, 106582, 20074, 102474, 109824, 104949, 3837, 45181, 100787, 102064, 104949, 3837, 26939, 102398, 71356, 102064, 104949, 3837, 107947, 26288, 102064, 53772, 4891, 23781, 9909, 4086, 44, 7552, 220, 17, 5373, 15672, 38, 2828, 109287, 2073, 100532, 12857, 97907, 220, 45181, 38, 2828, 16, 26939, 38, 2828, 18, 3837, 107947, 15672, 38, 2828, 101209, 34794, 20221, 99244, 3837, 105537, 102224, 114876, 9370, 99312, 41299, 106344, 11319, 220, 220, 18, 5373, 15672, 38, 2828, 107618, 108530, 57218, 99361, 9370, 108758, 49602, 252, 100040, 15672, 38, 2828, 105535, 101730, 3837, 15672, 38, 2828, 100231, 102224, 88802, 3837, 99518, 110334, 102224, 88802, 11319, 220, 220, 19, 5373, 26288, 104949, 100650, 32108, 101138, 105535, 39907, 73562, 104949, 100176, 60610, 5373, 100665, 101118, 5373, 100650, 20074, 101077, 5373, 104034, 48934, 47872, 5373, 103980, 100134, 5373, 100374, 100032, 44956, 5373, 99464, 33108, 107120, 17447, 3837, 26288, 104949, 9370, 99213, 4891, 253, 253, 32108, 100626, 102224, 114876, 106697, 11319, 220, 220, 20, 5373, 99200, 99717, 26288, 104949, 99892, 111361, 102122, 10236, 118, 115, 100112, 42140, 100535, 104949, 99892, 100007, 100040, 21515, 3837, 114936, 100007, 11319, 84897, 24562, 31235, 106277, 9370, 104949, 116541, 104719, 198, 10952, 97611, 86119, 57191, 109504, 28311, 15672, 38, 2828, 107853, 106988, 9370, 198, 10952, 14880, 100345, 104120, 101275, 27369, 102104, 97611, 86119, 57191, 104787, 97611, 109504, 1773, 104648, 9370, 101275, 27369, 87267, 115404, 3837, 108542, 70927, 11622, 3837, 112735, 45181, 35946, 107485, 9370, 101275, 27369, 15946, 115751, 57218, 97611, 86119, 31235, 105470, 103928, 3837, 36407, 17714, 103929, 102104, 99553, 104282, 1773, 102104, 103962, 101234, 34204, 103283, 3837, 110485, 77288, 16530, 101527, 27369, 3837, 100148, 100693, 100397, 30868, 66078, 1773, 97611, 86119, 57191, 109504, 102021, 72881, 86402, 3837, 105365, 11622, 99245, 72881, 86402, 104787, 345, 103929, 104787, 5122, 151645, 198, 151644, 77091, 198]
******chat_stream query end:

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

无

[BUG] The base folder does not exist under QAnything/models/. Please check your setup

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

When follow the document

bash run.sh

got error

bash run.sh
models 文件夹已存在，无需下载。
Checking model directories...
检查模型目录...
The base folder does not exist under QAnything/models/. Please check your setup.
在QAnything/models/下不存在base文件夹。请检查您的模型文件。

Check the folder models, it is empty

How can I prepare the models? any instruction?

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS: Ubuntu 20.04 / Linux / Amazon ec2 instance g4dn.xlarge
- NVIDIA Driver: 
- CUDA:
- Docker Compose: v2.24.1
- NVIDIA GPU Memory: 

No idea on how to check Nvidia driver , cuda versions, please update in README

QAnything日志 | QAnything logs

Stop at very beginning

复现方法 | Steps To Reproduce

$ git clone https://github.com/netease-youdao/QAnything.git
$ cd QAnything
$ bash run.sh

备注 | Anything else?

No response

QAnything 在Arm机器上进行部署

Qanything 看完简介，是个比较棒的产品，是否支持在Arm机器上进行部署呢？如果要在arm服务器上重新构建镜像，需要安装哪些组件呢？

[BUG] <title>qanything-container-local启动失败

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

我按照指示拉取git后运行了run.sh文件，在安装至"The triton service is starting up"这部分后一段时间，容器qanything-container-local（疑似）报错，并退出（exited with code 1）。stdout返回的信息中由于中文乱码仅有 xxxx Triton xxxxxxx /model_repos/QAEnsemble_base/QAEnsemble_base.log xxxxx。(xxx部分为乱码）
随后我重启了qanything-container-local容器，并进入容器查看进程，容器初期运行正常，但是通过查看进程可以发现容器在运行了npm run serve一段时间后自行退出。

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:ubuntu 20.04
- NVIDIA Driver:470.63.01
- CUDA:11.4
- Docker Compose:1.28.3
- NVIDIA GPU Memory:24G

QAnything日志 | QAnything logs

UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
[2024-01-19 11:23:44 +0800] [124] [INFO] Sanic v23.6.0
[2024-01-19 11:23:44 +0800] [124] [INFO] Goin' Fast @ http://0.0.0.0:8777
[2024-01-19 11:23:44 +0800] [124] [INFO] mode: production, w/ 4 workers
[2024-01-19 11:23:44 +0800] [124] [INFO] server: sanic, HTTP/1.1
[2024-01-19 11:23:44 +0800] [124] [INFO] python: 3.10.12
[2024-01-19 11:23:44 +0800] [124] [INFO] platform: Linux-5.4.0-42-generic-x86_64-with-glibc2.35
[2024-01-19 11:23:44 +0800] [124] [INFO] packages: sanic-routing==23.12.0, sanic-ext==23.6.0
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration and file/data utilities can be used.
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 11:23:54 +0800] [1160] [INFO] Sanic Extensions:
[2024-01-19 11:23:54 +0800] [1160] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-19 11:23:54 +0800] [1160] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-19 11:23:54 +0800] [1160] [INFO] > http
[2024-01-19 11:23:54 +0800] [1160] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 11:23:54 +0800] [1159] [INFO] Sanic Extensions:
[2024-01-19 11:23:54 +0800] [1159] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-19 11:23:54 +0800] [1159] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-19 11:23:54 +0800] [1159] [INFO] > http
[2024-01-19 11:23:54 +0800] [1159] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
init local_doc_qa in local
[2024-01-19 11:23:54 +0800] [1160] [INFO] Starting worker [1160]
[2024-01-19 11:23:54 +0800] [1159] [INFO] Starting worker [1159]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 11:23:54 +0800] [1161] [INFO] Sanic Extensions:
[2024-01-19 11:23:54 +0800] [1161] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-19 11:23:54 +0800] [1161] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-19 11:23:54 +0800] [1161] [INFO] > http
[2024-01-19 11:23:54 +0800] [1161] [INFO] > templating [jinja2==3.1.3]
UPLOAD_ROOT_PATH: /workspace/qanything_local/QANY_DB/content
rerank_port: 10001
embed_port: 10001
[2024-01-19 11:23:54 +0800] [1162] [INFO] Sanic Extensions:
[2024-01-19 11:23:54 +0800] [1162] [INFO] > injection [0 dependencies; 0 constants]
[2024-01-19 11:23:54 +0800] [1162] [INFO] > openapi [http://0.0.0.0:8777/docs]
[2024-01-19 11:23:54 +0800] [1162] [INFO] > http
[2024-01-19 11:23:54 +0800] [1162] [INFO] > templating [jinja2==3.1.3]
init local_doc_qa in local
init local_doc_qa in local
[2024-01-19 11:23:55 +0800] [1162] [INFO] Starting worker [1162]
[2024-01-19 11:23:55 +0800] [1161] [INFO] Starting worker [1161]

复现方法 | Steps To Reproduce

环境如上
运行bash run.sh
等待容器错误退出

备注 | Anything else?

No response

[BUG] 一直卡在<Triton服务正在启动，可能需要一段时间>这里

是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?

我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions

该问题是否在FAQ中有解答？ | Is there an existing answer for this in FAQ?

我已经搜索过FAQ | I have searched FAQ

当前行为 | Current Behavior

前面的步骤都没问题，直到出现Triton服务正在启动，可能需要一段时间，等了很久并没什么变化

期望行为 | Expected Behavior

No response

运行环境 | Environment

- OS:Windows 10
- NVIDIA Driver:546.33
- CUDA:12.3
- Docker Compose:v2.23.0-desktop.1
- NVIDIA GPU Memory:22GB

QAnything日志 | QAnything logs

I0116 04:31:36.346519 88 pinned_memory_manager.cc:240] Pinned memory pool is created at '0x304800000' with size 268435456
I0116 04:31:36.347640 88 cuda_memory_manager.cc:105] CUDA memory pool is created on device 0 with size 67108864
I0116 04:31:39.185947 88 model_lifecycle.cc:462] loading: rerank:1
I0116 04:31:39.192572 88 model_lifecycle.cc:462] loading: embed:1
I0116 04:31:39.200466 88 model_lifecycle.cc:462] loading: base:1
I0116 04:31:39.211187 88 onnxruntime.cc:2504] TRITONBACKEND_Initialize: onnxruntime
I0116 04:31:39.211807 88 onnxruntime.cc:2514] Triton TRITONBACKEND API version: 1.12
I0116 04:31:39.212389 88 onnxruntime.cc:2520] 'onnxruntime' TRITONBACKEND API version: 1.12
I0116 04:31:39.213066 88 onnxruntime.cc:2550] backend configuration:
{"cmdline":{"auto-complete-config":"true","backend-directory":"/opt/tritonserver/backends","min-compute-capability":"6.000000","default-max-batch-size":"4"}}
I0116 04:31:39.255971 88 onnxruntime.cc:2608] TRITONBACKEND_ModelInitialize: rerank (version 1)
I0116 04:31:39.256016 88 onnxruntime.cc:2608] TRITONBACKEND_ModelInitialize: embed (version 1)
I0116 04:31:39.259643 88 onnxruntime.cc:666] skipping model configuration auto-complete for 'embed': inputs and outputs already specified
I0116 04:31:39.259731 88 onnxruntime.cc:666] skipping model configuration auto-complete for 'rerank': inputs and outputs already specified
I0116 04:31:39.265515 88 onnxruntime.cc:2651] TRITONBACKEND_ModelInstanceInitialize: embed (GPU device 0)
I0116 04:31:39.266954 88 onnxruntime.cc:2651] TRITONBACKEND_ModelInstanceInitialize: rerank (GPU device 0)
I0116 04:31:39.944943 88 libfastertransformer.cc:459] Before Loading Weights:
terminate called after throwing an instance of 'std::length_error'
what(): basic_string::_M_create
[1a7591640d8d:00088] *** Process received signal ***
[1a7591640d8d:00088] Signal: Aborted (6)
[1a7591640d8d:00088] Signal code: (-6)
[1a7591640d8d:00088] [ 0] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f0b0ae95520]
[1a7591640d8d:00088] [ 1] /usr/lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f0b0aee99fc]
[1a7591640d8d:00088] [ 2] /usr/lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f0b0ae95476]
[1a7591640d8d:00088] [ 3] /usr/lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f0b0ae7b7f3]
[1a7591640d8d:00088] [ 4] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa2b9e)[0x7f0b0b11db9e]
[1a7591640d8d:00088] [ 5] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae20c)[0x7f0b0b12920c]
[1a7591640d8d:00088] [ 6] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae277)[0x7f0b0b129277]
[1a7591640d8d:00088] [ 7] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xae4d8)[0x7f0b0b1294d8]
[1a7591640d8d:00088] [ 8] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(_ZSt20__throw_length_errorPKc+0x40)[0x7f0b0b120449]
[1a7591640d8d:00088] [ 9] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0x14bc69)[0x7f0b0b1c6c69]
[1a7591640d8d:00088] [10] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(+0xa6ba3c)[0x7f0aa5bf2a3c]
[1a7591640d8d:00088] [11] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(_ZN17fastertransformer21loadWeightFromBinFuncI6__halfS1_EEiPT_St6vectorImSaImEENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x187)[0x7f0aa5c0b227]
[1a7591640d8d:00088] [12] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(_ZN17fastertransformer17loadWeightFromBinI6__halfEEiPT_St6vectorImSaImEENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEENS_14FtCudaDataTypeE+0x282)[0x7f0aa5c0ed12]
[1a7591640d8d:00088] [13] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(_ZN17fastertransformer11LlamaWeightI6__halfE16loadEncryptModelENSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE+0x184)[0x7f0aa57cb0b4]
[1a7591640d8d:00088] [14] /opt/tritonserver/backends/qa_ensemble/libqa-shared.so(_ZN16LlamaTritonModelI6__halfE19createSharedWeightsEii+0x2ad)[0x7f0aa57b219d]
[1a7591640d8d:00088] [15] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xdc253)[0x7f0b0b157253]
[1a7591640d8d:00088] [16] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x94ac3)[0x7f0b0aee7ac3]
[1a7591640d8d:00088] [17] /usr/lib/x86_64-linux-gnu/libc.so.6(+0x126660)[0x7f0b0af79660]
[1a7591640d8d:00088] *** End of error message ***

复现方法 | Steps To Reproduce

No response

备注 | Anything else?

No response

建议新建一个.gitignore文件

在项目根目录创建一个名为.gitignore的文件：

文件名：

.gitignore

文件内容：

.venv
.vscode
.idea
venv

以此忽略无关变动引起的文件新增提示。