aylai / gcdc-corpus Goto Github PK

Hi Authors

In GCDC paper, I didn't get the exact procedure for the score prediction. For Spearman’s rank correlation coefficient, we need two inputs (gold_score, label_score), it's mentioned in the paper clearly that 'gold_score' is calculated by taking the mean of expert reviews but how 'label_score' is obtained? I can think of two different approaches as follows:

• use the class label predicted by the trained model (classification models)
• train another linear regression model to obtain the label score with gold_score as training output.

I am not certain whether any of the above methods are used or none of them are used. It will be great if you can clear this up.
Thanks for hearing me out.