Coreference of speaker and addressee about gum

[amir-zeldes]

Thanks for reporting - some of these are definitely wrong; it seems mostly in the XML speaker list, rather than the coref clustering. This is especially true for GUM_conversation_christmas, which is very complex. I was able to fix some of these in 85b042d now.

However the entire zip files contain too many false positives to go over manually, esp. since, as you guessed, generic 'you' (meaning "one") is not clustered with actual referential 'you'. Is there some way you could produce a narrower list of candidates for any further errors? At a minimum, I think "you know" should be assumed to be generic, this is almost always true, unless followed by a complement.

BTW if you're curious, you can find the original speaker info for the conversation data in the Santa Barbara Corpus, for example: https://www.linguistics.ucsb.edu/sites/secure.lsit.ucsb.edu.ling.d7/files/sitefiles/research/SBC/SBC048.trn . The addressee info was filled in by annotators based on their understanding of the conversation.

[kybersutr]

I've filtered out the "you know" occurences:
GUM_speaker_inverse2.zip
GUM_speaker2.zip

Also, in the speaker_inverse, I've removed the entities containing multiple people.

However, I don't know about any simple way to differentiate between generic and referential you. Also sometimes there is indirect speech in the text, which also generates some false positives, and which I also cannot detect.

[amir-zeldes]

This took a while to get to, but the speaker inverse cases should now be resolved in the source files. The compiled files in the remaining formats incl. conllu will propagate on the next release. Thanks again for reporting the issue!