Chinese (Hanzi) about scriptshifter

[scossu]

Some additional information is needed:

• Which rare Chinese characters are not romanized? These could be added to the table.
• Which us are showing incorrectly and which ones are legit? E.g. 铝 transliterates lü, but I can't tell which other romanizations are expecting a "ü".

The extra space issue might be a logic problem. The transliteration table for Hanzi has an added space after each Romanized term, so if punctuation is encountered, there is an unwanted space. I thought I had addressed this but I have to look at the code and get back to this ticket. We may need to define a list of punctuation characters that suppress the space from the preceding token. This could be a good fit for the on_tx_token_match hook: read one extra character (without advancing the index), and if it is one of the punctuation symbols in the above mentioned list, strip whitespace from the end of the current match.

[scossu]

Closing this for now, as we are moving toward a whole new Chinese table. We'll open specific issues as they arise.