Comments (2)
训练模型转成推理模型可以参考这里 https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/bert#预测 。Paddle Serving等更多预测相关内容暂时还未合入,可以先参考这个PR #164
from paddlenlp.
参照该样例,已经转成推理模型了,非常感谢!!
from paddlenlp.
Related Issues (20)
- [Question]: python rest_api/application.py 不能访问API Documentation接口 HOT 2
- [Question]: text_correct模型什么时候升级到ernie3.0?等了好久了..... HOT 1
- [Question]: UIEX可以直接抽取大段连续内容吗? HOT 3
- [Question]: FAQ模型部署成功以后,经过异常捕获处理后,在多轮次问答过程中,出现一次成功一次失败的现象。 HOT 39
- [Question]: FAQ HOT 3
- [Question]: simcse中的cosine similarity计算 HOT 3
- 少量样本二分类训练,test_loss为0正常吗? HOT 2
- 如何使用SimpleServer进行自定义任务? HOT 3
- keyerror: eval_accuracy,eval_macro_f1
- 关于ERNIE-Layout中的NER模型问题 HOT 1
- 增加新模型:悟道·天鹰(Aquila2) HOT 1
- LAUNCH INFO 2024-03-27 01:54:27,777 Exit code -7
- Failed to load library libonnxruntime_providers_cuda.so with error: libcublasLt.so.11: cannot open shared object file: No such file or directory
- [Question]: Windows环境下部署语义检索系统semantic-search的过程中遇到问题 HOT 2
- 增加 facebook/nllb-200-distilled-600M facebook/nllb-moe-54b HOT 1
- ModuleNotFoundError: No module named 'paddle.fluid' HOT 3
- 百科知识树 HOT 3
- [Bug]: OSError: (External) CUBLAS error(1). [Hint: 'CUBLAS_STATUS_NOT_INITIALIZED'. The cuBLAS library was not initialized. HOT 1
- [Question]: (ResourceExhausted) Fail to alloc memory of 4165888745472 size, error code is 12. [Hint: Expected error == 0, but received error:12 != 0:0.] (at /paddle/paddle/fluid/memory/allocation/cpu_allocator.cc:50) [operator < fill_constant > error] HOT 1
- PaddleNLP/applications/text_classification/multi_class /retrieval_based/中milvus1.1.2替换为milvus2.4报错 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from paddlenlp.