Comments (3)
Thanks for reporting - some of these are definitely wrong; it seems mostly in the XML speaker list, rather than the coref clustering. This is especially true for GUM_conversation_christmas
, which is very complex. I was able to fix some of these in 85b042d now.
However the entire zip files contain too many false positives to go over manually, esp. since, as you guessed, generic 'you' (meaning "one") is not clustered with actual referential 'you'. Is there some way you could produce a narrower list of candidates for any further errors? At a minimum, I think "you know" should be assumed to be generic, this is almost always true, unless followed by a complement.
BTW if you're curious, you can find the original speaker info for the conversation data in the Santa Barbara Corpus, for example: https://www.linguistics.ucsb.edu/sites/secure.lsit.ucsb.edu.ling.d7/files/sitefiles/research/SBC/SBC048.trn . The addressee info was filled in by annotators based on their understanding of the conversation.
from gum.
I've filtered out the "you know" occurences:
GUM_speaker_inverse2.zip
GUM_speaker2.zip
Also, in the speaker_inverse, I've removed the entities containing multiple people.
However, I don't know about any simple way to differentiate between generic and referential you. Also sometimes there is indirect speech in the text, which also generates some false positives, and which I also cannot detect.
from gum.
This took a while to get to, but the speaker inverse cases should now be resolved in the source files. The compiled files in the remaining formats incl. conllu will propagate on the next release. Thanks again for reporting the issue!
from gum.
Related Issues (20)
- ADV as amod HOT 1
- a few ADV-headed errors HOT 1
- "one more N" construction HOT 1
- validate.py bugs HOT 1
- VBN with "be" as plain aux or cop and no passive dependents HOT 1
- a token that is not actually passive HOT 1
- Lemmas of pluralized years HOT 11
- Cycles in enhanced graph HOT 2
- Annotation Error for relative clauses
- Implement lemma for double quotes
- A couple errors related to it-expletives/clefts/extrapositions HOT 1
- passive VERBs with copulas: should actually be ADJ? HOT 2
- case/det/mark attaching in unusual environment HOT 1
- AUX/VERB with Number but not VerbForm=Fin HOT 4
- NUM/PUNCT with Number=Sing HOT 2
- Degree on non-ADJ/ADV HOT 1
- Incorrect structure for "oughta" HOT 1
- missing relcl secedge in bio_dvorak 37 HOT 1
- "so/ADJ that" should be SCONJ HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gum.