zjjconan / simam Goto Github PK
View Code? Open in Web Editor NEWThe official pytorch implemention of our ICML-2021 paper "SimAM: A Simple, Parameter-Free Attention Module for Convolutional Neural Networks".
The official pytorch implemention of our ICML-2021 paper "SimAM: A Simple, Parameter-Free Attention Module for Convolutional Neural Networks".
你好,论文中的公式5为了减少每个位置的重复计算,简化为使用所有神经元上的均值和方差,但是在实现代码中,方差除以了H*W-1
。
SimAM/networks/attentions/simam_module.py
Line 25 in a6ee671
I have read your paper, and I found there are regularizer is added, but not explain why adding this, and the introducing of regularizer will bring a hyper-parameter to adjust, this could make this method with a fixed hyper-parameter not generalize to other datasets.
δ²_t is not equal to 1/(M-1) * ∑(x_i - u_t)²,
it is equal to 1/(M-1) * ∑(x²_i - u²_t).
作者您贴出的类激活热力图有代码实现吗
The equation (3) should remove the minus sign
Hi,
you have done a splendid work to introduce the neuroscience finding to the machine learning area, and I have a question about the using of the energy function. In section 3.2, you proposed an energy function for each neuron to get the importances of the neurons, and by minimizing this function, you can get the linear transform which is the best transform to seperate the target neuron and other neurons.
However, I cannot understand your intention to use the minimum value of the energy function to represent the importance value. In my point of view, the energy function is kind of loss function, and the importance value should be the difference between
and
.
Therefore, why the energy function?
It would be very kind of you to answer my question.
Thanks,
Ema1997.
大佬您好,我把github中mmdection文件夹考到了我的mmdection文件夹中,并复制了提供的mask rcnn simam的log中model的config。但是运行的时候提示,ResNetRM is not in the models registry。请问想用mmdection运行您的代码还需要什么?求稍微给点关键词,如果有教程网站就更感激啦?
感谢!
Hi! Thanks for your code. I have a question about the Fast closed-form solution. How did you get this solution?
你好,我想问一下这个simam模块加在网络中的什么位置不会影响网络结构,并能取得不错的效果呢?还有个问题,在测试时候要用到吗?
作者您好!
感谢您的工作!
请问在simam中__repr__
函数作用是什么?
def __repr__(self):
s = self.__class__.__name__ + '('
s += ('lambda=%f)' % self.e_lambda)
return s
谢谢!
Hi, dear author!
Sorry to bother you.
Could you release the *.py of your visualized neuron(attention map/heatmap)?
Thank you!
你好,我在github中打不开预训练模型,您是否能够提供一下SimAM-R50预训练模型呢
It is a neural-free module?
Does the attention value self.activaton(y)
needs to be self.activaton(y).detach()
? Otherwise it will change the input value.
Did you try to convert onnx model or caffe model?
I am Vansin, the technical operator of OpenMMLab. In September of last year, we announced the release of OpenMMLab 2.0 at the World Artificial Intelligence Conference in Shanghai. We invite you to upgrade your algorithm library to OpenMMLab 2.0 using MMEngine, which can be used for both research and commercial purposes. If you have any questions, please feel free to join us on the OpenMMLab Discord at https://discord.gg/amFNsyUBvm or add me on WeChat (van-sin) and I will invite you to the OpenMMLab WeChat group.
Here are the OpenMMLab 2.0 repos branches:
OpenMMLab 1.0 branch | OpenMMLab 2.0 branch | |
---|---|---|
MMEngine | 0.x | |
MMCV | 1.x | 2.x |
MMDetection | 0.x 、1.x、2.x | 3.x |
MMAction2 | 0.x | 1.x |
MMClassification | 0.x | 1.x |
MMSegmentation | 0.x | 1.x |
MMDetection3D | 0.x | 1.x |
MMEditing | 0.x | 1.x |
MMPose | 0.x | 1.x |
MMDeploy | 0.x | 1.x |
MMTracking | 0.x | 1.x |
MMOCR | 0.x | 1.x |
MMRazor | 0.x | 1.x |
MMSelfSup | 0.x | 1.x |
MMRotate | 1.x | 1.x |
MMYOLO | 0.x |
Attention: please create a new virtual environment for OpenMMLab 2.0.
It seems like they are labels of target neuron t and other neurons x_i respectively. But what's the initial meanning of them in Eqn (1)?
Where is your requirements.txt?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.