lamma3 8B and 70B gguf support? Can support function calling? about localai

[localai-bot]

Hello,

Thank you for your feature request. I'm a bot, an experiment of @mudler, auditing the tickets that get opened in this Github project.

We appreciate your interest in improving LocalAI and welcomes all feature requests.

In this case, you want to request the integration of llama3 support in LocalAI with function calling capabilities, using the gguf format from Hugging Face. You provided the following links as examples:

• https://huggingface.co/lmstudio-community/Meta-Llama-3-70B-Instruct-GGUF
• https://huggingface.co/lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF

As an alternative solution, you mentioned file support.

Please provide any additional information or context to help us better understand your request. We'll hide this comment when you post the issue, but you can delete it if you wish.

Best regards,
Github Bot (experiment of @mudler)

[mudler]

did you try #2076 (comment) ?