nusnlp / m2scorer Goto Github PK
View Code? Open in Web Editor NEWMaxMatch (M^2) Scorer - Evaluation program for grammatical error correction systems.
License: GNU General Public License v2.0
MaxMatch (M^2) Scorer - Evaluation program for grammatical error correction systems.
License: GNU General Public License v2.0
Hello,
Thank you for developing M2 scorer!
I recently ran into a problem when I use m2 script for poor Neural MT outputs.
e.g., When I evaluated the following poor NMT output (for sentence id 333), the m2script takes very long time to compute.
In my environment, it takes more than 5 hours and is still running...
As it is a genetic risk , the patient force might have a high chance of carrying the risk , hence the need to inform their relatives is important . Hence , you are suffering from a genetic disease that the genetic trait might be passed on to your next generation if you have a child . Hence , there is no legal obligation to disclose to their family members , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there is no legal obligation . Hence , there
Is this an expected behavior and is there a way to work around?
Thank you,
Hi there,
Thanks for the code. I have a quick question. Is there any plan for supporting python3?
(my solution: https://github.com/keisks/m2scorer)
Hi,
Sometimes, it is very slow to evalute using m2scorer. How to fix it? And Could I evaluate scores of each errror types separately? How to achieve this function? Thank you very much.
For example:
S Thursday , is it not ?
A 0 1|||UNK|||It 's|||REQUIRED|||-NONE-|||0
A 3 5|||UNK|||n't it|||REQUIRED|||-NONE-|||0
Target:
It 's Thursday , is n't it ?
Would any one tell me please how to use M2 scorer in my GEC project? I didn't understand the usage part and I'm using Google Colab
I can generate the format with the script in scripts/edit_creator.py if there is only one annotator. But what should I do if there are two or more annotated texts?
For example:
Src:
The cat sat at mat .
The dog .
Gold1:
The cat sat on the mat .
The dogs .
Gold2:
The cat sat on a mat .
The dog .
How to get a file like example/source_gold ? Do I have to write a script?
Apparently, the edit_creator.py does not generate edits for case errors:
Source: As times pass by , My eyes went down the table below .
target: As time passed , my eyes went down the table below .
Result:
S As times pass by , My eyes went down the table below .
A 1 4|||UNK|||time passed|||REQUIRED|||-NONE-|||0
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.