unnir / deeptlf Goto Github PK

Hello. I hope this message finds you well.
Thank you very much for developing this method and sharing it.
I need Loss Diagram for Training and Validation set, AUC Plot for Validation and Training set (AUC vs epoch). Could you please assist me in writing the code for these plots?

Thank you in advance for your time and consideration.
@unnir

Hi, very interesting work! I had tested the model on a binary classification task and felt somewhat comfortable with it.

However, now it seems that the model can only early stop by the loss,

so I want to know how to modify the code so that I can use custom metric prauc (auc of precision recall curve).

Just like you do the fit of keras, that's say I want it to early stop when the prauc score can not be higher.

Can you give me some advice where to modify or any plan supporting it?

I have tried to modify by using PrecisionRecallCurve from torchmetrics, and auc from sklearn.metrics to calculate prauc,

but the score keeps early stopping by decreasing.

Thanks you!