harisont / concept-alignment Goto Github PK

• requires #17
• track up to rules (naming or comments)

e.g.

lt ||| rt...

instead of

lt|rt...

• modify prAlignment
• adapt EvAlign

Generalize from pairs to lists.
This will take some time.

Kinda alternative to #15.

Not necessarily to be implemented here, maybe just use someone else's code.

So to make it easier to search them in the synoptic CoNNL-U viewer.

• clear lang bounds
• incorporate sentIds

See if it's possible to use them to replace divergence patterns expressed as functions to:

• simplify the CA algorithms
• simplify usage (no need to modify the actual code ever)

Kinda alternative to #14.

I mean instead of just manipulating strings.

i.e. read and write conllu format, so that judgement are useful for GG as well as debugging. TBD what the role of the "linearized format" is, if any.

• reimplement evalign
• update readme
• use only + or only = alignment in CP/lexicon generation if the conllu files are annotated

I'm running extract-concepts on a conllu file that has sentences like the following, starting with a comment:

# <http://snomed.info/id/188462001>
1	Secondary	secondary	ADJ	<*>.A.ABS.<SS>	Degree=Pos	3	amod	_	_
2	malignant	malignant	ADJ	A.ABS	Degree=Pos	3	amod	_	_
3	neoplasm	neoplasm	NOUN	N.NOM.SG	Case=Nom|Number=Sing	0	root	_	_
4	of	of	ADP	PREP	AdpType=Prep	5	case	_	_
5	brain	brain	NOUN	<Count>.N.NOM.SG	Case=Nom|Number=Sing	3	nmod	_	_
6	and	and	CCONJ	CC.@CC	_	7	cc	_	_
7	spinal cord	spinal cord	NOUN	<Count>.N.NOM.SG	Case=Nom|Number=Sing	5	conj	_	_

In the result, the original comment has been replaced with new ones:

# sent_id = gfud1000002
# text = of brain and spinal cord
# reasons: {POS, UD} sentence IDs: {"missing sent_id"} correctness: _
1	of	of	ADP	PREP	AdpType=Prep	2	case	_	ADJUSTED=True
2	brain	brain	NOUN	<Count>.N.NOM.SG	Case=Nom|Number=Sing	0	root	_	ADJUSTED=True|ORIG_LABEL=nmod
3	and	and	CCONJ	CC.@CC	_	4	cc	_	ADJUSTED=True
4	spinal cord	spinal cord	NOUN	<Count>.N.NOM.SG	Case=Nom|Number=Sing	2	conj	_	ADJUSTED=True

I would like to know where the fragment came from, so I'd like the original comment to be retained in the output, something like the following. Placement doesn't matter, just that it is there somewhere.

# sent_id = gfud1000002
# text = of brain and spinal cord
# <http://snomed.info/id/188462001>
…

Use only the new Alignment type (requires #17) and define the necessary show/prints.

I guess this involves function getAlignments in GG.