dreadlord1984 / score-cam

[CVPR 2020 Workshop] Official implementation of Score-CAM in Pytorch

Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks

To appear at IEEE CVPR 2020 Workshop on Fair, Data Efficient and Trusted Computer Vision.

In this paper, we develop a novel post-hoc visual explanation method called Score-CAM based on class activation mapping. Score-CAM is a gradient-free visualization method, extended from Grad-CAM and Grad-CAM++. It achieves better visual performance and fairness for interpreting the decision making process.

Paper: Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks (Haofan Wang, Zifan Wang, Mengnan Du, Fan Yang, Zijian Zhang, Sirui Ding, Piotr Mardziel and Xia Hu.)

Update

2020.5.11: Score-CAM has been merged into utkuozbulak/pytorch-cnn-visualizations.

2020.4.13: First version of Score-CAM code has been released. More implementations will be added later.

Milestone

• • Support for Colab notebook.
• • Support for faster version of Score-CAM.
• • Support for pre-trained model in Pytorch.
• • Support for self-defined model in Pytorch.
• • Add visualization result and quantitive evaluation.
• • Support for other tasks such as object localization task.

Implement Score-CAM into popular visualization tools.

It would be very appreciated for implementing Score-CAM for other popular projects, if any of you are interested.

• • issues #76, Implement in utkuozbulak/pytorch-cnn-visualizations
• • isses #350, Implement in pytorch/captum
• • issues #124, Implement in sicara/tf-explain
• • Implement in PAIR-code/saliency
• • Implement in experiencor/deep-viz-keras

Other implementations

Before we release the official code, some great researchers have implemented Score-CAM on different framework. I am very grateful for the efforts made in their implementation.

Pytorch:

torch-cam by frgfm

ScoreCAM by yiskw713

xdeep by datamllab

Tensorflow:

score-cam by matheushent

Keras:

scam-net by andreysorokin

Score-CAM by tabayashi0117

Score-CAM-VGG16 by bunbunjp

Blog post

paper_summary

Demystifying Convolutional Neural Networks using ScoreCam

kerasでScore-CAM実装．Grad-CAMとの比較

Citation

If you find this work or code is helpful in your research, please cite and star:

@misc{wang2019scorecam,
    title={Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks},
    author={Haofan Wang and Zifan Wang and Mengnan Du and Fan Yang and Zijian Zhang and Sirui Ding and Piotr Mardziel and Xia Hu},
    year={2019},
    eprint={1910.01279},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}

Thanks

Utils are built on flashtorch, thanks for releasing this great work!

Contact

If you have any questions, feel free to contact me via: [email protected]