How to set a system prompt for RAG implementation for Inference for Gemma 2b on IOS ? about mediapipe

[kuaashish]

Hi @omkar806,

At present, this feature is unavailable. Should you wish to incorporate it, we kindly ask you to submit a feature request outlining the potential benefits for the community upon its implementation. Subsequently, we will review and forward your request to the appropriate team. Based on the ensuing discussion and demand, we can consider implementing it in the near future.

Thank you!!

[omkar806]

okay I will add a feature request for this

[schmidt-sebastian]

We are working on making it easier to build more advanced use case on top of our LLM Inference. That being said, you can already tell the model to act like an agent by simply including this instruction in the prompt you are using. We will have more examples for this in the coming weeks.