Questions about the low benign accuracy on CIFAR-10 and GTSRB dataset of Blind Backdoor about backdoors101

[ebagdasa]

Hey Yiming, let me double check, I tried to simplify the API and might have broken something.

[THUYimingLi]

Hey Yiming, let me double check, I tried to simplify the API and might have broken something.

Thank you for your helps and looking forward to your results :)

[ebagdasa]

I think my config for cifar confused pre-trained models, but I think simply using a fixed scale and not MGDA will work better.

[THUYimingLi]

I think my config for cifar confused pre-trained models, but I think simply using a fixed scale and not MGDA will work better.

Thanks for your response. I just want to make sure there is no misunderstanding. The model is trained from the scratch instead of fine-tuning on a pre-trained benign model and we adopt the same settings used in your codes. In this case, why we can not reproduce your results?

[ebagdasa]

Hey, I actually never tested CIFAR as we did Imagenet in the paper so I didn't check it thoroughly, sorry.

I believe it's fixed now. I added a threshold to start poisoning after normal loss reaches 1.0 (we have a fancier idea in the paper on Figure 10 but I think this one works well). I also updated the parameters for the CIFAR run. Can you please let me know if it fixed your issue.

[CHR-ray]

I think my config for cifar confused pre-trained models, but I think simply using a fixed scale and not MGDA will work better.

hello, I am also try to reproduce your experiment, can you provide your fixed scale that you get?
Thank you!

[ebagdasa]

I guess you can just set it to 0.9

[CHR-ray]

I guess you can just set it to 0.9

Thank you for your fast reply!

Here you mean
clean:backdoor = 1 : 0.9 or clean:backdoor = 0.1 : 0.9 ?
Thank you!