alibaba-edu / simple-effective-text-matching-pytorch Goto Github PK

I use quora.json5 to train a new re2, and use the new model to test. But the acc of quora test set can't get 89.2%.

我在运行训练代码时报错ImportError: cannot import name 'Module'

Excuse me, I encounter the problem that "RuntimeError: Mask tensor can take 0 and 1 values only at /pytorch/aten/src/TH/generic/THTensorEvenMoreMath.cpp:580" when training the model with Pytorch 1.2.0.

Do you have any solution to this problem? Thanks.

在snli数据集上可以复现实验结果，ACC可以达到89.2
{'acc': 0.8926099348534202,
'loss': 0.3331541208659901,
'score': 0.8926099348534202,
'updates': 136400}

Kindly add pytorch version in the readme as well as pytorch as a dependency in the requirements.txt given the constant evolution of pytorch.

我现在想根据这个模型训练中文，请问需要什么步骤？我应该注意什么吗？ 小白求大神们解答

whenever i run evaluate.py it gives all predictions = 0 and thus an accuracy of 50% on the test.txt file

Is the training done on four data sets at the same time? How long does the training time take?

运行时自定义的Conv1d出现'module' object is not callable的错误：

File "/home/ryan/code/TMBaselines/modules/CNNEncoder.py", line 43, in __init__ kernel_sizes=args.kernel_sizes) for i in range(args.enc_layers)]) File "/home/ryan/code/TMBaselines/modules/CNNEncoder.py", line 43, in <listcomp> kernel_sizes=args.kernel_sizes) for i in range(args.enc_layers)]) File "/home/ryan/code/TMBaselines/modules/CNNEncoder.py", line 24, in __init__ convs.append(nn.Sequential(nn.utils.weight_norm(conv), GeLU())) TypeError: 'module' object is not callable

反复检查了没有发现错误，请问作者遇到过这个情况吗？

sorry for disturbing, when I training RE2 on wikiQA，a bug occured:
Traceback (most recent call last): File "train.py", line 48, in <module> main() File "train.py", line 31, in main states = trainer.train() File "/home/ryan/code/RE2/src/trainer.py", line 58, in train score, dev_stats = model.evaluate(dev_batches) File "/home/ryan/code/RE2/src/model.py", line 116, in evaluate stats.update(metrics[metric](outputs)) File "/home/ryan/code/RE2/src/utils/metrics.py", line 80, in ranking map_, mrr = [float(s[-6:]) for s in stdout.strip().split('\n')] File "/home/ryan/code/RE2/src/utils/metrics.py", line 80, in <listcomp> map_, mrr = [float(s[-6:]) for s in stdout.strip().split('\n')] ValueError: could not convert string to float:
did you find this error before？if so, could you give me any clue to figure it out？thanks a lot

链接数据下载不了，是否可以数据分享一下[email protected]

Hi，when I did the abalation experiment, an error occurred in the residual connection module
Traceback (most recent call last):
File "train.py", line 49, in
main()
File "train.py", line 32, in main
states = trainer.train()
File "/hy-tmp/res_ave/src/trainer.py", line 52, in train
stats = model.update(batch)
File "/hy-tmp/res_ave/src/model.py", line 69, in update
output = self.network(inputs)
File "/usr/local/miniconda3/envs/res_torch/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/hy-tmp/res_ave/src/network.py", line 59, in forward
a_enc = block['encoder'](a, mask_a)
File "/usr/local/miniconda3/envs/res_torch/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/hy-tmp/res_ave/src/modules/encoder.py", line 38, in forward
x = encoder(x)
File "/usr/local/miniconda3/envs/res_torch/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/hy-tmp/res_ave/src/modules/init.py", line 105, in forward
return torch.cat([encoder(x) for encoder in self.model], dim=-1)
File "/hy-tmp/res_ave/src/modules/init.py", line 105, in
return torch.cat([encoder(x) for encoder in self.model], dim=-1)
File "/usr/local/miniconda3/envs/res_torch/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/usr/local/miniconda3/envs/res_torch/lib/python3.7/site-packages/torch/nn/modules/container.py", line 92, in forward
input = module(input)
File "/usr/local/miniconda3/envs/res_torch/lib/python3.7/site-packages/torch/nn/modules/module.py", line 489, in call
result = self.forward(*input, **kwargs)
File "/usr/local/miniconda3/envs/res_torch/lib/python3.7/site-packages/torch/nn/modules/conv.py", line 187, in forward
self.padding, self.dilation, self.groups)
RuntimeError: Given groups=1, weight of size [150, 450, 3], expected input[256, 150, 38] to have 450 channels, but got 150 channels instead.
Thank you

请问一下这个spiece.model是在哪里生成的呢

这个代码执行顺序是什么？执行入口在哪里？不报错但是没有结果