Mistral 7B v0.2 about litgpt

[carmocca]

We already have Instruct v0.2 in: https://github.com/Lightning-AI/litgpt/blob/main/litgpt/config.py#L1393

When the pretrained model is added, if the config is exactly the same you can use the model_name argument https://github.com/Lightning-AI/litgpt/blob/main/tutorials/download_model_weights.md#finetunes-and-other-model-variants

[rasbt]

Ah yes, I somehow overlooked this. I really need to wear glasses haha. Let's stay tuned for when the model gets added to the hub. Just checked here and it doesn't seem to have landed yet.

[rasbt]

There seems to be a GGUF version at https://huggingface.co/bartowski/Mistral-7B-v0.2-hf-GGUF, but I suggest we wait for the official one under https://huggingface.co/mistralai/

[Andrei-Aksionov]

People at MistralAI are so badass, that they provide a direct link to download the weights.

[rasbt]

Haha thanks!

The only caveat is it doesn't come with any prior usage or license information and you don't know what you are downloading. I think we should probably wait for the Hub version.

[Andrei-Aksionov]

and you don't know what you are downloading.

I would say that this is the biggest issue.
Given the size of the archive it can contain anything, starting from a collection of memes to some interesting, relatively short, videos.

---

So, let's definitely weight.