Does Rubix ML support Natural Language Processing (NLP)? about ml

[andrewdalpino]

Hey @programarivm unfortunately Rubix ML does not make a good base library for a language generation project in my opinion. The reason is because language generation models, like the autoregressive type that predict the next word) tend to require a ton of computation especially at training but inference as well. Single-threaded CPU with additional PHP overhead would take forever to train. Additionally, we do not provide support for Transformers which is the current state-of-the-art neural network architecture at tackling these language generation problems.

I would take a look at fine-tuning a pretrained GPT with your chess-oriented corpus using PyTorch for your problem.

Where Rubix ML may be able to help you is in predicting intent from text. With that, you could respond with pregenerated text appropriately. This may or may not make your answers sound less robotic. It may even make it worse.

Hope all is well with you! Keep up the great work.