Natural Language Processing functions in Rust
This is my first project in Rust, if fact it started as a simple function to test string slicing I copied learnt from one of the first chapters of the Rust tutorial and started evolving as I read more of the book and learnt some other features. I plan to keep learning Rust and adding more functionality here, in principle there is no real pla; Tokenization, WordVectors, text statistics, colocations, who knows. At some stage I will compare the performance of my functions to those in the NLP library for Python. I hope to achieve better performance but who knows.
- Use test driven development
- Try CI in github
- Refactor old code every time a new language feature is learnt
- Generate documentation from code
I make this repository public in case anyone is interested, but please be aware that for the time being I am at very early stages of Rust learning and things may be done in not exacly the best way.
The (https://doc.rust-lang.org/book/)[Rust Book].
- Monomorphization is the process of turning /generic code/ that is using generics at compile time by filling in the concrete types that are used when compiled.
- Variant one of the possible values an Enum can take
Comming from C/C++ world some Rust contructs have different names in C++; some concepts are not the same.
Rust | C++ |
---|---|
Method | Method |
Struct | Struct / Class |
Generic Types | Templates |