ptrckhmmr / learning-to-defer-with-limited-expert-predictions Goto Github PK

Hello, when I run [main.py]in the learning-to-defer-with-limited-expert-predictions-main/Learning-to-Defer-Algs/mozannar_sontag directory, I consistently encounter an error that reads, "FileNotFoundError: [Errno 2] No such file or directory: '/learn-to-defer-Algs/artificial_expert_labels/TrueEx_cifar100_60_labels.json'". Unfortunately, I am unsure about how this file was generated. Therefore, I would greatly appreciate your assistance in reproducing the experiments. Thank you.

Hello,
excellent fellow, I found something I didn't quite understand, so could you help me with some answers? Thank you and your team very much.

The question is as follows:

First question: Is the baseline not shown because it is less than 90% accuracy?

Second question: Why is "complete expert prediction" always 100% accuracy?

Third question: Why do some lines in the graph (e.g., Embedding SVM in the upper right corner) exceed 100% accuracy.