Comments (3)
Yuanlin-Zhao
commented on May 24, 2024
哥们给个联系方式我有一些问题想咨询你
from tensorrt-for-yolo-series.
jhxiang
commented on May 24, 2024
我主页有
from tensorrt-for-yolo-series.
Linaom1214
commented on May 24, 2024
请问一下为什么yolov8 end2end的推理，warmup和没有warmup时间相差这么多吗？没有warmup大概700ms，有warmup只有6ms，Infer函数不都是执行的图片放入gpu，然后推理结果从gpu放到内存吗？难道是warmup之后，图片不需要从内存到gpu了吗？ 另外，如果我是处理视频，需要实时从视频帧读取到gpu，这应该是没办法用warmup吧？这应该怎么处理？
模型load以后 可以warmup， 使用空数据infer几次 然后 业务流来了以后直接推理
from tensorrt-for-yolo-series.
Related Issues (20)
- YOLOv7 Tensorrt converted model inference is equal to PyTorch model HOT 3
- int8 vs fp16 加速倍数能有多少？ HOT 1
- How to use engine in a process or a thread HOT 4
- how to deploy in multiple nvidia card, such as a computer with 8 3060 card?
- Add dynamic batch support for converting from onnx to .engine?
- auto in_dims = engine->getBindingDimensions(engine->getBindingIndex("image_arrays")); HOT 1
- En715 Jetson xaiver Nx Yolov7.trt Not detect HOT 2
- yolov7，official，int8，onnx-> trt报错 HOT 3
- c++ endtoend 关于预测的置信度绘制 HOT 4
- memory leak: Destroy function does not work
- Detection duplicates with fp16 on Jetson Nano (TensorRT v8.2.1.8) HOT 2
- Support for windows?
- License? HOT 4
- 关于V8 tensorrt 出现乱框的情况 HOT 33
- TensorRT Conversion Issue "TypeError: pybind11::init(): factory function returned nullptr" HOT 2
- yolox 自己训练的模型 trt推理 位置不对 HOT 1
- Error Code 1: Serialization (Serialization assertion creator failed.Cannot deserialize plugin since corresponding IPluginCreator not found in Plugin Registry) HOT 2
- wrong confidence score (negative confidence score) on Jetson Nano inference HOT 3
- usage example for image_batch.py HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tensorrt-for-yolo-series.