kolanich-libs / emojinorm.py

A library to normalize Unicode emoji sequencies

emojiNorm.py

wheel (GHA via nightly.link)

We have moved to https://codeberg.org/KOLANICH-libs/emojiNorm.py, grab new versions there.

Under the disguise of "better security" Micro$oft-owned GitHub has discriminated users of 1FA passwords while having commercial interest in success and wide adoption of FIDO 1FA specifications and Windows Hello implementation which it promotes as a replacement for passwords. It will result in dire consequencies and is competely inacceptable, read why.

If you don't want to participate in harming yourself, it is recommended to follow the lead and migrate somewhere away of GitHub and Micro$oft. Here is the list of alternatives and rationales to do it. If they delete the discussion, there are certain well-known places where you can get a copy of it. Read why you should also leave GitHub.

---

A library to normalize Unicode emoji sequencies. Currently broken for some cases, needs more fixing and testing. Use with care.

Usage

normalizeEmoji

Does emoji normalization

• remove redundant zero-width-joiners;
• add missing zero-width joiners;
• add emoji presentation selectors where they are needed.

normalizeEmoji('☑') # ☑️

Issues:

• some compound emoji (i.e. "👩🏿\u200d❤\ufe0f\ufe0f\u200d👨🏻") contain a sequence of 2 presentation selectors right after each other (\ufe0f\ufe0f). This function breaks those emoji since it first strips all emoji presentation selectors, and then generates them from scratch. It seems that for those emoji the only way is to remember that they are constructed this way. Currently I'm not sure how to handle them, so they are broken.

graphemeCount

Counts graphemes. Emoji must contain of 1.

o = '🚴️♂'
print(graphemeCount(o))  # 2
r = normalizeEmoji(o)
print(r, graphemeCount(r))  # 🚴‍♂️ 1

stripDiversity

Strips skin tone, hair style modifiers and gender (not all, only deity-based (Venus/Mars)) zwj seqs.

print(*stripDiversity("👩🏻‍❤︎️‍👨🏿"))  # 👩‍❤︎‍👨 {'skin': ('🏻', '🏿')}
print(*stripDiversity("👩🏻‍🦰"))  # 👩 {'hair': ('🦰',), 'skin': ('🏻',)}
print(*stripDiversity("🚵‍♂️"))  # 🚵 {'genderDeity': ('♂',)}

stripDiversityPerson

Replaces man/woman code points with person ones.

print(*stripDiversityPerson("👨‍🚒"))  # 🧑‍🚒 {'genderPerson': ('👨',)} (male firefighter to just firefighter)