guxd / c-dnpg Goto Github PK

For Quora, there are actually 149,263 samples marked as "duplicated" in total, which can be used for paraphrasing. Instead of the data size (124K) reported in the paper (100K\4k\20k), is there a reason why not to use the full dataset? Thanks.

Thanks for open sourcing the code.
I managed to train a model, however I can not run inference on a simple sentence, since it seems I am not correctly calling the model.
Would be glad If you could add a simple example how to run basic inference...

model = GATransformer(config)
model.from_pretrained(modelDir)
model.to(device)
sentence = "Some cool sentence..."
inputs = model.tokenizer.encode(sentence, return_tensors="pt")
outputs = model(inputs)
print('outputs', outputs)

TypeError: forward() missing 2 required positional arguments: 'context_attn_mask' and 'response'

Now I want to repeat the question generation through your code, may I ask how to run the code?

Hello guxd, I have some questions about the dataset, why the dataset is in h5 format, can other formats be used instead? Is it possible to provide the code for data preparation?