No such dataset implementation None about visrep

[esalesky]

My guess is that you need to set the parameter --dataset_impl in your training command.

In the first line in the screenshot, dataset_impl=None. If you're using binarized data, you'll want to set this to mmap, and if you're using raw data (not binarized, images computed when internal dataset representation constructed, which is what I typically did for MTTT because it is relatively small), you can set this to raw.

If you still see an issue, please comment again and I'll do my best to help, and if that works, feel free to close!

[aquorio15]

Hi thank you for the reply
It is working now, just a small question did you try this model with very small dataset let's say (around 10000 sentence pair)

Also how did you evaluate your trained model.

[esalesky]

Great, glad to hear!

No, I did not try datasets smaller than MTTT. You may want to try adapting a model trained on more data.

We evaluated using BLEU as computed by sacrebleu, after first removing sentencepiece segmentation.