allenai / qasc Goto Github PK

Is it possible to publish the 2-step retrieval data?

"id": "3R2PKQ87NW7M2JUHD1FZY696IOVIM8" ,fact:“the seismometer will check for seismic activity”，
"id":"3AAJC4I4FGRIW1D6A8QTI9KFA8JZJ1",fact“:dehydration preserves foods by removing moisture”，they are not in corpus

no module named allennlp.run
when excute:
python -m allennlp.run predict \

 --include-package qasc \
 --predictor multiple-choice-qa-json \
 --output-file data/1step_predictions.jsonl \
 data/QASC_Models/bertlc_1step/model.tar.gz  \
 data/QASC_Dataset_1Step/test.jsonl

The only citation information appearing in your Github repository is inferred from the link to your paper in arXiv:

@article{allenai:qasc,
      author    = {Tushar Khot and Peter Clark and Michal Guerquin and Peter Jansen and Ashish Sabharwal},
      title     = {QASC: A Dataset for Question Answering via Sentence Composition},
      journal   = {arXiv:1910.11473v2},
      year      = {2020},
}

I just wanted to be sure that you do not prefer to use your reference to AAAI instead:

@article{Khot_Clark_Guerquin_Jansen_Sabharwal_2020,
  title = {QASC: A Dataset for Question Answering via Sentence Composition},
  volume = {34},
  url = {https://ojs.aaai.org/index.php/AAAI/article/view/6319},
  DOI = {10.1609/aaai.v34i05.6319},
  number = {05},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  author = {Khot, Tushar and Clark, Peter and Guerquin, Michal and Jansen, Peter and Sabharwal, Ashish},
  year = {2020},
  month = {Apr.},
  pages = {8082-8090}
}

Under which license is released your dataset?

Thank you.

I can‘t reproduce your retrival result based on elasticsearch R@10 44.4% (both F1 and F2) can you release your retrival part code. My reproduce result is 28% (K=20,L=4)