daoguang-polimi / awasome-cnnpruning

Awasome Papers and Resources in Convolution Neural Network Pruning with Code.

Awasome-CNNPruning

Awasome Research Papers and other Resources in Convolution Neural Network Pruning. This collection is prepared inspired by he-y/Awesome-Pruning.

Notation	Explanation
U	Unstructured, Weight Pruning
S	Structured, Filter/Channel Pruning
A	Official/Author Implementation
O	Unofficial/3rd Party Implementation

Conference

Year	Venue	Title	Type	Code
2023	ICLR	How I Learned to Stop Worrying and Love Retraining	U	PyTorch[A]
2023	ICLR	Revisiting Pruning at Initialization Through the Lens of Ramanujan Graphs	U
2022	CVPR	Interspace Pruning: Using Adaptive Filter Representations To Improve Training of Sparse CNNs	U
2022	CVPR	Revisiting Random Channel Pruning for Neural Network Compression	S	PyTorch[A]
2022	CVPR	Fire Together Wire Together: A Dynamic Pruning Approach With Self-Supervised Mask Prediction	S
2022	CVPR	When to Prune? A Policy towards Early Structural Pruning	S
2022	CVPR	Dreaming to Prune Image Deraining Networks	S
2022	ICLR	SOSP: Efficiently Capturing Global Correlations by Second-Order Structured Pruning	S
2022	ICLR	Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, And No Retraining	U	PyTorch[A]
2022	ICLR	Revisit Kernel Pruning with Lottery Regulated Grouped Convolutions	S	PyTorch[A]
2022	ICLR	Dual Lottery Ticket Hypothesis	U	PyTorch[A]
2022	ACCV	Filter Pruning via Automatic Pruning Rate Search⋆	S
2022	ACCV	Network Pruning via Feature Shift Minimization	S	PyTorch[A]
2022	ACCV	Lightweight Alpha Matting Network Using Distillation-Based Channel Pruning	S	PyTorch[A]
2022	ACCV	Adaptive FSP : Adaptive Architecture Search with Filter Shape Pruning	S
2022	WACV	Hessian-Aware Pruning and Optimal Neural Implant	S	PyTorch[A]
2022	WACV	PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression	S
2022	WACV	Channel Pruning via Lookahead Search Guided Reinforcement Learning	S
2022	WACV	EZCrop: Energy-Zoned Channels for Robust Output Pruning	S	PyTorch[a]
2022	ICIP	One-Cycle Pruning: Pruning Convnets With Tight Training Budget	U
2022	ICIP	RAPID: A Single Stage Pruning Framework	U
2022	ICIP	The Rise of the Lottery Heroes: Why Zero-Shot Pruning is Hard	U
2022	ICIP	Truncated Lottery Ticket for Deep Pruning	U
2022	ICIP	Which Metrics For Network Pruning: Final Accuracy? or Accuracy Drop?	S/U
2022	ISMSI	Structured Pruning with Automatic Pruning Rate Derivation for Image Processing Neural Networks	S
2021	NIPS	Only Train Once: A One-Shot Neural Network Training And Pruning Framework	S	PyTorch[A]
2020	CVPR	HRank: Filter Pruning using High-Rank Feature Map	S	PyTorch[A]
2020	CVPR	Towards efficient model compression via learned global ranking	S	PyTorch[A]
2020	ICLR	Budgeted Training: Rethinking Deep Neural Network Training Under Resource Constraints	U
2020	MLSys	Shrinkbench: What is the State of Neural Network Pruning?		PyTorch[A]
2020	BMBS	Similarity Based Filter Pruning for Efficient Super-Resolution Models	S
2019	CVPR	Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration	S	PyTorch[A]
2019	ICLR	The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks	U	PyTorch[A]
2019	ICLR	SNIP: Single-shot Network Pruning based on Connection Sensitivity	U	Tensorflow[A]
2018	ICIP	Online Filter Clustering and Pruning for Efficient Convnets	S
2018	IJCAI	Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks	S	PyTorch[A]
2017	ICLR	Pruning Filters for Efficient ConvNets	S	PyTorch[O]

Journal

Year	Journal	Title	Type	Code
2022	IEEE Trans. PAMI	1xN Pattern for Pruning Convolutional Neural Networks	S	PyTorch[A]
2022	IEEE Trans. NNLS	Filter Pruning by Switching to Neighboring CNNs With Good Attribute	S
2022	IEEE Trans. NNLS	Model Pruning Enables Efficient Federated Learning on Edge Devices	S
2022	IEEE Trans. NNLS	Network Pruning Using Adaptive Exemplar Filters	S	PyTorch[A]
2022	IEEE Trans. NNLS	Filter Sketch for Network Pruning	S	PyTorch[A]
2022	Neurocomputing	FPFS: Filter-level pruning via distance weight measuring filter similarity	S
2022	Neurocomputing	RUFP: Reinitializing unimportant filters for soft pruning	S
2022	Neural Netw	HRel: Filter pruning based on High Relevance between activation maps and class labels	S	PyTorch[A]*
2022	Comput. Intell. Neurosci.	Differentiable Network Pruning via Polarization of Probabilistic Channelwise Soft Masks	S
2022	J. Syst. Archit.	Optimizing deep neural networks on intelligent edge accelerators via flexible-rate filter pruning	S
2022	Appl. Sci.	Magnitude and Similarity Based Variable Rate Filter Pruning for Efficient Convolution Neural Networks	S	PyTorch[A]
2022	Sensors	Filter Pruning via Measuring Feature Map Information	S
2022	IEEE Access	Automated Filter Pruning Based on High-Dimensional Bayesian Optimization	S
2022	IEEE Signal Process. Lett.	A Low-Complexity Modified ThiNet Algorithm for Pruning Convolutional Neural Networks	S
2020	IEEE Access	Filter Pruning Without Damaging Networks Capacity	S
2020	Electronics	Pruning Convolutional Neural Networks with an Attention Mechanism for Remote Sensing Image Classification	S

Pruning Software/Toolbox

Year	Venue	Title	Type	Code
2022	FasterAI	FasterAI: Prune and Distill your models with FastAI and PyTorch	U	PyTorch[A]
2022	SoftwareX	Simplify: A Python library for optimizing pruned neural networks		PyTorch[A]
2021	github.com	Toolbox: Structural Pruning for Model Acceleration	S	PyTorch[A]
2021	github.com	Toolbox: PyTorchViz [A small package to create visualizations of PyTorch execution graphs]		PyTorch[A]
2020	MLSys	What is the State of Neural Network Pruning?	S/U	PyTorch[A]
2019	PyTorch	Official PyTorch Pruning Tool	S/U	PyTorch[A]