Words counting issue for mixed languages about countable

[RadLikeWhoa]

This is a tough one. I've been reading through TryGhost/Ghost#2656 and cgiffard/Downsize#15 and this stuff just completely blows my mind. I don't speak any non-latin language so I will need all the help I can get on this one.

I'll keep up with the two issues mentioned above and I will do my best to figure out a usable solution.

[iamzifei]

Hi, not sure if you come up with a solution or not. but I've done a small quick fix for at least Chinese language, you can have a look at here:

https://github.com/iamzifei/gust/blob/master/assets/countable.js

[RadLikeWhoa]

Thanks for the input. It looks quite interesting, but could you please explain how your solution works exactly?

[iamzifei]

Hi, it's a little bit tricky and not quite completed actually, but hopefully could give some ideas here.

so I defined 3 regex for different unicode range, for asian languages.
r1 (line 176) is for ideographic chars, such as ideographic space, space between "a　b".
r2 (line 177) is for common CJK unicode chars
r3 (line 178) is for Thai chars

I replace r1, r2, r3 with one English word. the rest is counting as it is. so 敏捷的棕毛 will become " {CJK} {CJK} {CJK} {CJK} {CJK} ", which would count as 5 words.

some references:
http://stackoverflow.com/questions/1366068/whats-the-complete-range-for-chinese-characters-in-unicode
http://en.wikipedia.org/wiki/CJK_Unified_Ideographs#CJK_Unified_Ideographs
http://www.unicode.org/charts/PDF/U0E00.pdf

[manchumahara]

see how they did this https://github.com/AAlakkad/jQuery-smsHelper/blob/master/jquery-smshelper.js

any jQuery support ?