nusnlp / m2scorer Goto Github PK

For example:

S Thursday , is it not ?
A 0 1|||UNK|||It 's|||REQUIRED|||-NONE-|||0
A 3 5|||UNK|||n't it|||REQUIRED|||-NONE-|||0

Target:

It 's Thursday , is n't it ?

Hi,
Sometimes, it is very slow to evalute using m2scorer. How to fix it? And Could I evaluate scores of each errror types separately? How to achieve this function? Thank you very much.

I can generate the format with the script in scripts/edit_creator.py if there is only one annotator. But what should I do if there are two or more annotated texts?

For example:
Src:
The cat sat at mat .
The dog .

Gold1:
The cat sat on the mat .
The dogs .

Gold2:
The cat sat on a mat .
The dog .

How to get a file like example/source_gold ? Do I have to write a script?

Apparently, the edit_creator.py does not generate edits for case errors:

Source: As times pass by , My eyes went down the table below .
target: As time passed , my eyes went down the table below .

Result:

S As times pass by , My eyes went down the table below .
A 1 4|||UNK|||time passed|||REQUIRED|||-NONE-|||0

Hello,

Thank you for developing M2 scorer!

I recently ran into a problem when I use m2 script for poor Neural MT outputs.

e.g., When I evaluated the following poor NMT output (for sentence id 333), the m2script takes very long time to compute.
In my environment, it takes more than 5 hours and is still running...

As it is a genetic risk , the patient force might have a high chance of carrying the risk , hence the need to inform their relatives is important . Hence , you are suffering from a genetic disease that the genetic trait might be passed on to your next generation if you have a child . Hence , there is no legal obligation to disclose to their family members , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there

Is this an expected behavior and is there a way to work around?

Thank you,

Would any one tell me please how to use M2 scorer in my GEC project? I didn't understand the usage part and I'm using Google Colab

Hi there,
Thanks for the code. I have a quick question. Is there any plan for supporting python3?

(my solution: https://github.com/keisks/m2scorer)