Comments (6)
这玩意你是怎么想到要去量化它的...只有tensorRT支持吧...
from ppq.
呃呃,,,好吧...
from ppq.
LSTM是个很复杂的算子,里面有多次矩阵乘法以及一堆激活函数,还有mul, add等等算子——请不要忽视这些,在不同的后端上LSTM的量化和所需的量化参数可以是截然不同的,你必须要知道你的后端如何计算这个算子才能够给出正确的量化参数(我猜你并不知道)。
不过有些时候你得网络里虽然有这个LSTM,但你并不希望它被量化,那这个时候你只需要在PPQ的后端执行库里添加一下LSTM的执行函数就行了,PPQ的调度器和Quantizer都不会尝试量化这个算子。
from ppq.
好的,明白勒,感谢😵
from ppq.
在即将发布的ppq 0.6.4版本中我们支持了gru的fp32执行,以及gru的算子拆解,你可以瞅一眼看看它的复杂程度...
from ppq.
听着就很恐怖......近些天我也了解了LSTM内部实现,确实太复杂了,看得眼花
from ppq.
Related Issues (20)
- 请问PPQ支持一维网络模型的量化吗 HOT 1
- [视频资料]使用profiler来分析网络性能,tensorboard无法解析日志文件 HOT 2
- PPQint8CPU量化bug HOT 1
- Op Execution Error MMCVModulatedDeformConv2d
- 关于QAT中的BN? HOT 1
- 是否有计划支持高通QNN(比较新的版本)和海思芯片呢? HOT 1
- ppq使用torch_mlir导出tosa格式的mlir HOT 1
- 这个工具链已经收敛了吗?我看已经比较久没有特性更新了,后续还有新特性计划吗? HOT 1
- 能否支持权重和激活位宽不同的量化? HOT 2
- VIT类模型量化感知训练loss跑飞 HOT 1
- PPQ已经支持了不少后端推理框架(TensorRT,ncnn,mnn等),这些后端的量化规格细节都是怎么获取的呢?现在PPQ与后端量化推理可以完全对齐吗?
- PPQ在画质类任务上(如低光降噪)量化效果咋样呢?
- AttributeError: 'NoneType' object has no attribute 'copy'
- 求助 为什么量化以后模型没有减小?
- ProgramEntrance_2.py读取imagenet图片reshape报错
- RuntimeError: Op Execution Error: /Slice(Type: Slice, Num of Input: 5, Num of Output: 1)
- Quantization for tflite HOT 1
- PPQ can not process parameter variable(PPQ_Variable_108) with multiple destinations HOT 3
- PPQ量化后,不能导出engine(05_QuantizationAgain.py)
- How does PPQ perform real quantization and achieve speed up?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ppq.