Comments (9)
We're not actively developing this yet. We have done some internal testing in two directions:
- Use translation in and out, and keep everything in English.
- Define the canonical forms, examples, bot messages in a different language.
Both approaches worked reasonably well. The second one is highly dependent on the capabilities of the underlying model to understand a non-English language. If you are developing a non-English / multi-language bot, and have a specific issue with either of the two approaches, let us know and we can help.
from nemo-guardrails.
In theory, nothing should block the multi-language use case. I'll follow up on this in a few days. Someone was able to have a bot respond in Japanese if I remember correctly.
from nemo-guardrails.
@drazvan Any progress on this?
from nemo-guardrails.
@drazvan - any update on the language topic?
from nemo-guardrails.
Hi! Any progress on this?
I would like the bot to be able to respond in whatever language the user is utilising. Even if I set this in the model's instructions or if I provide examples in the rails, it tends to default back to English as the conversation evolves.
Any guide on how to go about this would be appreciated!
from nemo-guardrails.
@hww-rociorey: what model are you testing with?
from nemo-guardrails.
@hww-rociorey: what model are you testing with?
I'm using gpt-3.5-turbo-instruct
from nemo-guardrails.
@patriciapampanelli: can you provide more guidance on how to keep the LLM always responding in a different language? Was the "return to English" an issue in the tests you did as well?
from nemo-guardrails.
@drazvan I didn't see this type of problem in the tests. The most promising results were obtained with the manual translation of the model's instructions, as well as canonical forms, examples, and bot messages.
@hww-rociorey Are you evaluating one language at a time? Have the model instructions also been translated?
from nemo-guardrails.
Related Issues (20)
- Colang 2.0 multi_modal tutorial error HOT 2
- Not able to add Actions with Custom LLM Engine with nemo guardRails
- Issue while trying to use HOT 1
- [BUG] colang content causing streaming issues HOT 5
- [BUG] LLMGenerationActions.generate_value() fails if the value is not a number HOT 4
- The message "yes" is blocked by the input rail. HOT 2
- Installation issue on mac m1 HOT 4
- Support for KB/Retrieval rails without dialog rails
- [DEP_ISSUE] issue with sentence-transformers, huggingface_hub => fastembed HOT 2
- RAG Example doesn't work with guardrails, not using the knowledge base. HOT 4
- Error : Organization has been restricted HOT 1
- ValueError: Invalid embedding engine: SentenceTransformer HOT 7
- Off topic rail accuracy improvement HOT 1
- Error while execution generate_user_intent: 'NoneType' object has no attribute 'agenerate_prompt'
- What are the options to use NeMo Guardrails with Agents until Agent support is added?
- Error in `VerboseHandler` when `::` present in log messages but not ` :: `. HOT 1
- Unable to install any version > 0.7.0 of nemoguardrails using pipenv install nemoguardrails HOT 1
- Error when using Flask, Gemini models(gemini-1.5-pro-001), and NemoGuardRails integrated with each other. HOT 4
- Error evaluating '$generation_options.rails.input': Attribute 'rails' does not exist in expression 'var_generation_options.rails.input' HOT 1
- passing in relevant_chunks as a message's context HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nemo-guardrails.