Installable pip package about elmoformanylangs

[Oneplus]

Hi @mauryaland,

Thank you for your interest! Making it pip installable is a good idea. However, the current project is very unstable and experimental. And we do not have enough time to officially release it. Currently, you can use the Embedder class for programmatically interface.

I will leave this issue open until we have a detailed plan.

[AngledLuffa]

Rather than open a new issue, can I ask in this thread: any further progress on this? Any possibility of having this module on pip?

Thanks!

[akutuzov]

@AngledLuffa you can try the simple-elmo project.
It relies on TensorFlow, not PyTorch, but the idea is the same: to make ELMo usage more straightforward.

[AngledLuffa]

Thank you for the suggestion! Does that work on the models hosted on allennlp and the models hosted here? Or just one subset of those models? It's a little unclear from that documentation what models to use or where to get them. Otherwise, it looks quite promising.

[akutuzov]

With simple-elmo, you can load:

1. Pre-trained models provided by allennlp. You'll just have to rename their files to model.hdf5 and options.json, and create a vocab.txt file with any number of words in it (at least try to include <S> and </S>).
2. All the ELMo models from the NLPL vector repository, except those provided by ELMOForManyLangs.

We are currently thinking about ways to automatically convert and load ELMOForManyLangs models.