camelop / nlp-robustness Goto Github PK

Hello,
thanks for publishing the code used in your interesting paper!
I am wondering if this repo also contains the code for the OOD Detection part, i.e. for recording the confidence scores on the SST-2 dataset and on the 5 validation datasets. I am curious how you calculated the FPR95 and anomaly. Going through all files I cannot find the related code. Do I miss it or is it not added?
Thank you very much for your time, @tpatzelt

While I try to use the bert or roberta config using allennlp I get the following error

"json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)"

I was wondering which version of allennlp do you recommend for the code or is there some specific resolution you know regarding this issue.

Hi can you mention the version of allennlp and other modules you have used in a requirments.txt. It seems allennlp has changed a lot and the commands mentioned in the readme does not work.
For example while running the command

allennlp train config/test/sst-lstm.json -s model/test-lstm[sst-2] --include-package allennlp_glue_patch

I encountered the following error.

"No module named allennlp.run"