an issue whenever I use a model rather than "Engstrom2019Robustness" about robustbench

[dedeswim]

@lzhimin your issue should have been solved with #74. Can you please confirm that it works now? Setting the environment variable PYTHONUTF8=1 shouldn't be necessary anymore.

I'm re-opening the issue to know also whether installing the latest version from main solved the issue for @Saif-KF?

[max-andr]

Hi,

Can you manually remove that model from your disk and try to use the latest version of RobustBench via pip install git+https://github.com/RobustBench/robustbench.git? I think this should resolve your problem.

Best,
Maksym

[max-andr]

hmm, i see. we'll try to troubleshoot this. as for the models, you can download them directly from here.

[max-andr]

i just checked again in my environment and model checkpoints can be downloaded without any problems in my environment.

can you maybe try to completely remove robustbench via pip uninstall robustbench? and then also remove the folder models (if it exists in your current directory) and then install robustbench again via pip install git+https://github.com/RobustBench/robustbench.git?

not sure what else to suggest. if the issue persists, please share with us more details about how we could reproduce this problem (your environment, the script you are trying to run, exact error message).

cheers,
maksym

[lzhimin]

@dedeswim Yes, the uninstall and install process work great. I also test the new model loading and so far it also works great.

thanks a lot!

[Saif-KF]

Many thanks Maksym for your response.

I tried many times and I only managed to download one model ('Engstrom2019Robustness') successfully.
Is there a shared repository to download the models from it directly?

Best regards

[Saif-KF]

Many thanks Maksym.
I will try your suggestion and get back to you if the issue is still there.

Best regards

[lzhimin]

Hey, I also experienced the similar issue -- "UnpicklingError: invalid load key, '<'.".
I installed this repo a while ago and everything worked fine at that time, but now I have the above issues and have not clue how to fix it.

I followed the instruction to uninstall robustbench and reinstall with the suggest command but the install process complain the following problem:

####################################################
####################################################
Collecting git+https://github.com/RobustBench/robustbench.git
Cloning https://github.com/RobustBench/robustbench.git to c:\users\xxxx\appdata\local\temp\pip-req-build-t03d_fgg
Running command git clone --filter=blob:none --quiet https://github.com/RobustBench/robustbench.git 'C:\Users\xxxx\AppData\Local\Temp\pip-req-build-t03d_fgg'
Resolved https://github.com/RobustBench/robustbench.git to commit 08d20a2
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [8 lines of output]
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\xxxx\AppData\Local\Temp\pip-req-build-t03d_fgg\setup.py", line 4, in
long_description = fh.read()
File "C:\users\xxxx\appdata\local\programs\python\python38\lib\encodings\cp1252.py", line 23, in decode
return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 502: character maps to
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
####################################################
####################################################

[max-andr]

Hi,

Your installation error seems like something Windows-specific to me. This is what I found on the internet:

• https://stackoverflow.com/a/70923999
• https://forums.fast.ai/t/10-nlp-unicodedecodeerror-charmap-codec-cant-decode-byte-0x9d-in-position-1757/82899/4

So could you maybe try to set the environment variable PYTHONUTF8=1? Seems like it could help.

Best,
Maksym

[max-andr]

great that this is solved! @Saif-KF please let us know if your issue is resolved as well.

[Saif-KF]

Great! I have checked and found it worked.
Thanks for you all for your support.

[max-andr]

perfect, that's great to hear! then i'll close this issue.