load model issue using pickle about robustbench

[fra31]

Hi,

this is probably related. Please let me know if that helps to solve it.

[lizaitang]

Sorry, but still not fixed, I have tried the method.

[fra31]

Could you please try to delete also the previously downloaded checkpoint (if a file with the same name exists it doesn't get downloaded again)?

[lizaitang]

Sorry but I have also tried.

[lizaitang]

Thank you so much, I just solved it, for anyone with same issue, you need to uninstall robustbench first and reinstall with latest version.
Thanks again!

[fra31]

Ok, good!

[lizaitang]

Thanks, another small issue is that I am using a imagenet dataset generated by GAN , to check the accuracy on the load_model , which preprocessing should be implemented?

[fra31]

I think one usually keeps the same preprocessing used during training. For the models in the Model Zoo we specify for each classifier the preprocessing (see here).

[lizaitang]

Thanks, which means we do not need to do preprocessing by ourselves? Just load the model?

[fra31]

For the models in the Model Zoo, the preprocessing is done automatically when loading the dataset. If you want to evaluate other models, you can either specify one of the predefined preprocessing methods here or pass a customized one with

robustbench/robustbench/eval.py

Line 33 in df31621

preprocessing: Optional[Union[str,

in the benchmark function.