A bert tokenizer implementting by Java, especially for Chinese, dedicated to compatibility with huggingface bert tokenizer
chuangfengwang / hf-bert-tokenizer Goto Github PK
View Code? Open in Web Editor NEWA bert tokenizer implementting by Java, especially for Chinese, dedicated to compatibility with huggingface bert tokenizer
License: Apache License 2.0