cambridgeltl / ecnmt Goto Github PK

Hi, I am re-running the ECPRETRAIN script and trying to reproduce the results.

However, I found the model tends to generate very short sentences as the training goes on:

This seems to be not aligned with the description in the paper.

Besides, it seems that we only save a model when it reaches 99% accuracy, however, none of the training epoch reaches that in my experiment.

I try to reproduce the environment, however, I found that Pytorch 1.3.1 does not seem to be available on Pytorch's official webpage anymore, so I use Pytorch 1.6 instead. I do not know whether this could be the reason. Any insight here would be helpful.

Hi,
I am trying to run the ECPRETRAINING script with default hparams. The model is able to reach 99% accuracy in 4k epochs but after that the prediction accuracy collapses. I am unable to find any bug in the code that might be causing this. I have attached the training logs for the same

Reaching 99%

Collapse to 0%

Full log
log.log

It would great if you could help resolve this issue.
Thanks.

I see args.hard is default False, and when I tried with it it doesn't really work well?