Loss doesn't go down about arflow

[lliuz]

BTW, when I was training, I did not pay much attention to the training loss, since the unsupervised loss is too noisy for each sample. You can just focus on the validation results to determine when to stop training.

Besides, you can email me if you have any other questions.

[lliuz]

Hi @leogogogo,
Your result is more like for directly fine-tuning without ar. I wonder what's the version of the code you used.
Because of my carelessness when I sort and public this code, training with ar has a bug, and I have updated the training code a few days ago. Please check your code and let me know whether you are using the latest version.

[leogogogo]

Hi @lliuz
Thank you for your quick answer, the code was from few days ago. I'll try the latest version and keep updating my result.

[leogogogo]

Got it, thank you for your help and hints!