May open source the English version dataSet of detecting incongruity corpus about detecting-incongruity

[david-yoon]

Hi,
Thank you for your interests in our research.

We keep having internal discussions on this research that are not limited to the previous scope we showed on the AAAI-19 paper.

The way of preparing dataset from the raw corpus is one of the very important issues in this research.
Through some round of discussions, we've reached the conclusion to maintain another GitHub repository for the dataset. (which may deal with several datasets (English version) and preprocessing methodology)

I'll put the GitHub link as soon as we create the new repository.

Thank you,
David

[david-yoon]

Hi @khoaln @iofu728
We're currently preparing an another GitHub repository for the english dataset.
The initial version will be available shortly via the following repository.
https://github.com/sugoiii/detecting-incongruity-dataset-gen

I'm also working on evaluating the aaai-19 model (AHDE) to english dataset (not-released, yet) in "dev-NELA" branch.
I'll keep you posted.

Thank you,
David

[david-yoon]

Hi @iofu728 @khoaln ,
Please find the GitHub repository for the English version dataset which is created using NELA 2017 data.
https://github.com/sugoiii/detecting-incongruity-dataset-gen

If you want to run our model (AHDE) with the English version of data, you can use the preprocessed dataset that is compatible with our code.
(sh download_processed_dataset_nela-17.sh) in './data' folder

If you have any question, please let me know it.

Thank you,
David

[iofu728]

Hi,
Thank you for your interests in our research.

We keep having internal discussions on this research that are not limited to the previous scope we showed on the AAAI-19 paper.

The way of preparing dataset from the raw corpus is one of the very important issues in this research.
Through some round of discussions, we've reached the conclusion to maintain another GitHub repository for the dataset. (which may deal with several datasets (English version) and preprocessing methodology)

I'll put the GitHub link as soon as we create the new repository.

Thank you,
David

Thx for your response, expect your dataset 👻

[khoaln]

Hi Seunghyun Yoon,

I'm also doing research on incongruence problems. Your dataset will be very helpful. Have you created the repository for the dataset (English version)?

Thank you very much!

[khoaln]

Hi @khoaln @iofu728
We're currently preparing an another GitHub repository for the english dataset.
The initial version will be available shortly via the following repository.
https://github.com/sugoiii/detecting-incongruity-dataset-gen

I'm also working on evaluating the aaai-19 model (AHDE) to english dataset (not-released, yet) in "dev-NELA" branch.
I'll keep you posted.

Thank you,
David

That's great news! Thanks David!

[iofu728]

Hi @khoaln @iofu728
We're currently preparing an another GitHub repository for the english dataset.
The initial version will be available shortly via the following repository.
https://github.com/sugoiii/detecting-incongruity-dataset-gen

I'm also working on evaluating the aaai-19 model (AHDE) to english dataset (not-released, yet) in "dev-NELA" branch.
I'll keep you posted.

Thank you,
David

Exciting, thank u for ur work.🌹