sleemanmunk / huggingface-tokenizer-in-cxx Goto Github PK
View Code? Open in Web Editor NEWThis project forked from wangkuiyi/huggingface-tokenizer-in-cxx
A fork of the huggingface-tokenizer-in-cxx library. I hope to add some niceties like an object-oriented API and a license