Pruning steps about rethinking-network-pruning

[Eric-mingjie]

I don't quite understand the first question. Are you asking why the test accuracy of pruned model is small? Maybe the model is pruned too much.

out_channels is just the number of filters in the convolutional layer with kernel weight m. start_mask=torch.ones(3) is just to initialize the mask with the first convolution layer that has 3 input channels.

[Afef00]

For the first question, I meant that if I try to run your code to prune VGG model using l1 norm pruning method and CIFAR dataset I should at first run main.py to obtain the accuracy of the model before pruning then I run Vggprune.py for the pruning and lastly to retrain the pruned model I run main_finetune.py.

[Eric-mingjie]

I should at first run main.py to obtain the accuracy of the model before pruning then I run Vggprune.py for the pruning and lastly to retrain the pruned model I run main_finetune.py.

That is correct.