Coder Social home page Coder Social logo

Comments (6)

ZhangZhiPku avatar ZhangZhiPku commented on August 29, 2024

这玩意你是怎么想到要去量化它的...只有tensorRT支持吧...

from ppq.

Menace-Dragon avatar Menace-Dragon commented on August 29, 2024

呃呃，，，好吧...

from ppq.

ZhangZhiPku avatar ZhangZhiPku commented on August 29, 2024

LSTM是个很复杂的算子，里面有多次矩阵乘法以及一堆激活函数，还有mul, add等等算子——请不要忽视这些，在不同的后端上LSTM的量化和所需的量化参数可以是截然不同的，你必须要知道你的后端如何计算这个算子才能够给出正确的量化参数（我猜你并不知道）。

不过有些时候你得网络里虽然有这个LSTM，但你并不希望它被量化，那这个时候你只需要在PPQ的后端执行库里添加一下LSTM的执行函数就行了，PPQ的调度器和Quantizer都不会尝试量化这个算子。

from ppq.

Menace-Dragon avatar Menace-Dragon commented on August 29, 2024

好的，明白勒，感谢😵

from ppq.

ZhangZhiPku avatar ZhangZhiPku commented on August 29, 2024

在即将发布的ppq 0.6.4版本中我们支持了gru的fp32执行，以及gru的算子拆解，你可以瞅一眼看看它的复杂程度...

from ppq.

Menace-Dragon avatar Menace-Dragon commented on August 29, 2024

听着就很恐怖......近些天我也了解了LSTM内部实现，确实太复杂了，看得眼花

from ppq.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.