Coder Social home page Coder Social logo

coderabbit214 / bibliothecarius Goto Github PK

View Code? Open in Web Editor NEW
459.0 459.0 79.0 482 KB

Quickly build services to integrate your local data and AI models.

License: MIT License

Dockerfile 0.91% Java 73.97% HTML 1.38% TypeScript 22.66% JavaScript 0.85% CSS 0.22%

bibliothecarius's People

Contributors

caoshengdong avatar coderabbit214 avatar colin4k avatar cookabc avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

bibliothecarius's Issues

配置后运行问题

配置完成后,按照步骤2.docker-compose启动后端服务,启动后终端显示:
暂存
之后按照步骤3.验证后端服务,点击网址,出现:
image
我想问,是我文件配置出错了,还是配置文件是对的,已经启动后端服务了,但是因为代理问题

在数据集里添加文档后,报400错误,请问是啥原因呢?

系统部署成功后,添加了一个代理,然后从代理装了部梯子才能访问api.openai.com。现在报400了,直接访问openai的那个url也是报400。换了api key还是一样。运行环境:debian10+docker+oracle jdk17+nodeJS18.15。以下为报错日志
2023-05-29T16:37:37.639+08:00 WARN 13834 --- [nio-8080-exec-5] c.b.m.c.t.support.ReflectLambdaMeta : Unable to make field private final java.lang.Class java.lang.invoke.SerializedLambda.capturingClass accessible: module java.base does not "opens java.lang.invoke" to unnamed module @19bb089b
retrofit2.adapter.rxjava2.HttpException: HTTP 400 Bad Request
at retrofit2.adapter.rxjava2.BodyObservable$BodyObserver.onNext(BodyObservable.java:57)
at retrofit2.adapter.rxjava2.BodyObservable$BodyObserver.onNext(BodyObservable.java:38)
at retrofit2.adapter.rxjava2.CallExecuteObservable.subscribeActual(CallExecuteObservable.java:48)
at io.reactivex.Observable.subscribe(Observable.java:10151)
at retrofit2.adapter.rxjava2.BodyObservable.subscribeActual(BodyObservable.java:35)
at io.reactivex.Observable.subscribe(Observable.java:10151)
at io.reactivex.internal.operators.observable.ObservableSingleSingle.subscribeActual(ObservableSingleSingle.java:35)
at io.reactivex.Single.subscribe(Single.java:2517)
at io.reactivex.Single.blockingGet(Single.java:2001)
at com.coderabbit214.bibliothecarius.openai.OpenAiService.execute(OpenAiService.java:83)
at com.coderabbit214.bibliothecarius.openai.OpenAiService.sentEmbeddings(OpenAiService.java:70)
at com.coderabbit214.bibliothecarius.vector.openai.OpenAiVectorService.getVector(OpenAiVectorService.java:64)
at com.coderabbit214.bibliothecarius.document.DocumentService.toVector(DocumentService.java:194)
at com.coderabbit214.bibliothecarius.document.DocumentService.toQdrant(DocumentService.java:166)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:196)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750)
at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
retrofit2.adapter.rxjava2.HttpException: HTTP 400 Bad Request
at retrofit2.adapter.rxjava2.BodyObservable$BodyObserver.onNext(BodyObservable.java:57)
at retrofit2.adapter.rxjava2.BodyObservable$BodyObserver.onNext(BodyObservable.java:38)
at retrofit2.adapter.rxjava2.CallExecuteObservable.subscribeActual(CallExecuteObservable.java:48)
at io.reactivex.Observable.subscribe(Observable.java:10151)
at retrofit2.adapter.rxjava2.BodyObservable.subscribeActual(BodyObservable.java:35)
at io.reactivex.Observable.subscribe(Observable.java:10151)
at io.reactivex.internal.operators.observable.ObservableSingleSingle.subscribeActual(ObservableSingleSingle.java:35)
at io.reactivex.Single.subscribe(Single.java:2517)
at io.reactivex.Single.blockingGet(Single.java:2001)
at com.coderabbit214.bibliothecarius.openai.OpenAiService.execute(OpenAiService.java:83)
at com.coderabbit214.bibliothecarius.openai.OpenAiService.sentEmbeddings(OpenAiService.java:70)
at com.coderabbit214.bibliothecarius.vector.openai.OpenAiVectorService.getVector(OpenAiVectorService.java:64)
at com.coderabbit214.bibliothecarius.document.DocumentService.toVector(DocumentService.java:194)
at com.coderabbit214.bibliothecarius.document.DocumentService.toQdrant(DocumentService.java:166)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:196)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750)
at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
retrofit2.adapter.rxjava2.HttpException: HTTP 400 Bad Request
at retrofit2.adapter.rxjava2.BodyObservable$BodyObserver.onNext(BodyObservable.java:57)
at retrofit2.adapter.rxjava2.BodyObservable$BodyObserver.onNext(BodyObservable.java:38)
at retrofit2.adapter.rxjava2.CallExecuteObservable.subscribeActual(CallExecuteObservable.java:48)
at io.reactivex.Observable.subscribe(Observable.java:10151)
at retrofit2.adapter.rxjava2.BodyObservable.subscribeActual(BodyObservable.java:35)
at io.reactivex.Observable.subscribe(Observable.java:10151)
at io.reactivex.internal.operators.observable.ObservableSingleSingle.subscribeActual(ObservableSingleSingle.java:35)
at io.reactivex.Single.subscribe(Single.java:2517)
at io.reactivex.Single.blockingGet(Single.java:2001)
at com.coderabbit214.bibliothecarius.openai.OpenAiService.execute(OpenAiService.java:83)
at com.coderabbit214.bibliothecarius.openai.OpenAiService.sentEmbeddings(OpenAiService.java:70)
at com.coderabbit214.bibliothecarius.vector.openai.OpenAiVectorService.getVector(OpenAiVectorService.java:64)
at com.coderabbit214.bibliothecarius.document.DocumentService.toVector(DocumentService.java:194)
at com.coderabbit214.bibliothecarius.document.DocumentService.toQdrant(DocumentService.java:166)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:568)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:196)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750)
at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:833)
2023-05-29T16:37:45.343+08:00 ERROR 13834 --- [ task-1] c.c.b.document.DocumentService : txt file converted to qdrant exception

java.lang.RuntimeException: OpenAiService sentEmbeddings failed
at com.coderabbit214.bibliothecarius.openai.OpenAiService.sentEmbeddings(OpenAiService.java:75) ~[classes!/:0.0.1-SNAPSHOT]
at com.coderabbit214.bibliothecarius.vector.openai.OpenAiVectorService.getVector(OpenAiVectorService.java:64) ~[classes!/:0.0.1-SNAPSHOT]
at com.coderabbit214.bibliothecarius.document.DocumentService.toVector(DocumentService.java:194) ~[classes!/:0.0.1-SNAPSHOT]
at com.coderabbit214.bibliothecarius.document.DocumentService.toQdrant(DocumentService.java:166) ~[classes!/:0.0.1-SNAPSHOT]
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:na]
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[na:na]
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:na]
at java.base/java.lang.reflect.Method.invoke(Method.java:568) ~[na:na]
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:343) ~[spring-aop-6.0.6.jar!/:6.0.6]
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:196) ~[spring-aop-6.0.6.jar!/:6.0.6]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-6.0.6.jar!/:6.0.6]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:750) ~[spring-aop-6.0.6.jar!/:6.0.6]
at org.springframework.aop.interceptor.AsyncExecutionInterceptor.lambda$invoke$0(AsyncExecutionInterceptor.java:115) ~[spring-aop-6.0.6.jar!/:6.0.6]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[na:na]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[na:na]
at java.base/java.lang.Thread.run(Thread.java:833) ~[na:na]

环境配置成功,服务运行失败:BeanCreationException: Error creating bean with name 'resultExceptionHandler': Injection of autowired dependencies failed

按照readme文件,对config文件夹中的application.yaml以下几项( MySQL配置,opanai key,Qdrant 服务地址, 存储配置)进行修改。然后启动服务后,运行几秒后报错退出。查看docker的log,可以看到springboot启动后报错,INFO 7 --- [main] c.c.b.BibliothecariusApplication : No active profile set, falling back to 1 default profile: "default"以及WARN 7 --- [ main] ConfigServletWebServerApplicationContext : Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'resultExceptionHandler': Injection of autowired dependencies failed
然后就是ERROR 7 --- [ main] o.s.boot.SpringApplication : Application run failed
Caused by: java.lang.IllegalArgumentException: Could not resolve placeholder 'spring.servlet.multipart.max-file-size' in value "${spring.servlet.multipart.max-file-size}"按照这个报错,应该是配置文件有问题导致的?但已经对教程中配置文件中的对应内容做了更改,而且max-file-size这个参数应该是原文件就默认写好的。

建议

建议弄成exe一键程序

failed to solve: lstat

I run docker-compose up in dir ./bibliothecarius but got

failed to solve: lstat /var/lib/docker/tmp/buildkit-mount3053042581/build/libs: no such file or directory

can you help me get the solutions? Thanks!

貌似curl语句里缺少了size字段

2023-04-14T16:32:16.172+08:00 ERROR 25392 --- [nio-8080-exec-9] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [Request processing failed: jakarta.validation.UnexpectedTypeException: HV000030: No validator could be found for constraint 'jakarta.validation.constraints.NotEmpty' validating type 'java.lang.Integer'. Check configuration for 'size'] with root cause

能否支持本地文件系统?

现在是必须使用oss来存储文件?上传文件就报错。。。application.yaml里面是设置阿里云存储,但是源码里面是amazon s3?

com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure

2023-06-06T11:33:54.412Z INFO 1 --- [nio-8080-exec-1] com.zaxxer.hikari.HikariDataSource : HikariPool-1 - Starting...
bibliothecarius-main-bibliothecarius-1 | 2023-06-06T11:33:55.623Z ERROR 1 --- [nio-8080-exec-1] com.zaxxer.hikari.pool.HikariPool : HikariPool-1 - Exception during pool initialization.
bibliothecarius-main-bibliothecarius-1 |
bibliothecarius-main-bibliothecarius-1 | com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure
bibliothecarius-main-bibliothecarius-1 |
bibliothecarius-main-bibliothecarius-1 | The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
image

image

服务都能正常启动,不知道什么原因连不上数据库,求路过大佬帮忙看下,数据库服务是正常的

你好,诚心请教~

你好,我对你开源的项目很有兴趣,在我花费了一周的时间,终于搭建好了环境,但是在开始测试时,出现一些问题。所以诚心想您请教。
1.我根据你发布的教程,进行测试时,和文档中显示的结果不同,original字段没有内容,请问这个是哪里的问题呢?
20230417173020

2.我这边的目的是想训练一个业务客服的机器人,根据提供的业务文档,回复有关业务的问题。请问我想要实现目的,使用哪种模型更合适,同时如何训练模型呢? (我是一名Android方向的开发者,对于AI 了解的不是很多,所以问题比较多,实在不好意思~~)

期待你的回复,灰常感谢~~

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.