Comments (5)
你是想看cuda的实现还是pytorch的实现?
from ppq.
你是想看cuda的实现还是pytorch的实现?
pytorch的
from ppq.
pytorch的实现可以看这个
https://github.com/openppl-public/ppq/blob/master/ppq/quantization/qfunction/linear.py
ppq使用tensor quantization config来控制量化流程,所有量化逻辑都绑定在算子身上,你可以通过op.config来访问这些tensor quantization config结构。ppq.executor在执行到每一个算子的时候,将去读取算子身上绑定的量化信息,并使用 linear.py 中定义的量化函数对数据进行处理。
from ppq.
linear.py 定义的是量化tensor的函数 那么 假设一个卷积 他的weight以及bias全部被量化成uint8类型之后 uint8的输入feature跟这些量化后的权重的卷积过程是调用哪些函数去执行呢?还是说pytorch支持uint8的卷积操作?
from ppq.
pytorch不支持uint8的卷积,linear.py里面量化完了还是浮点数哦,你再仔细看看...
from ppq.
Related Issues (20)
- 量化模型的时候出现TypeError HOT 1
- yolov5_sample报错 HOT 1
- 关于导出平台的报错信息 HOT 2
- 加减类算子类型匹配问题 HOT 3
- 请问 是否可以通过量化后产生的onnx 推理结果可以直观看出量化的情况? HOT 2
- BatchNormalization量化出错 HOT 2
- 执行quantize_torch_model.py后,pytorch模型export出的onnx模型并不是QNN模型 HOT 9
- How to get a Qoperator format ONNX model after quantization? HOT 1
- 请问为什么在运行 ppq/ppq/samples/TensorRT/Benchmark_with_onnx.py 文件时会出现Segmentation Fault的可能原因是什么? HOT 1
- 请问目前支持pytorch模型直接量化(而不是转成onnx),并生成量化后pytorch模型吗 HOT 1
- 请问如何使用ppq量化模型的部分模块,而不是整个模型呢?
- Op Execution Error: Einsum HOT 1
- yolov5量化,在ppq/samples/yolo中运行02_Quantization.py文件出现警告和报错,输出模型只有onnx没有engine文件 HOT 1
- 请问PPQ支持一维网络模型的量化吗 HOT 1
- [视频资料]使用profiler来分析网络性能,tensorboard无法解析日志文件 HOT 2
- PPQint8CPU量化bug HOT 1
- Op Execution Error MMCVModulatedDeformConv2d
- 关于QAT中的BN? HOT 1
- 是否有计划支持高通QNN(比较新的版本)和海思芯片呢? HOT 1
- ppq使用torch_mlir导出tosa格式的mlir HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ppq.