Comments (8)
I've just pushed a PR with a fix, once tests are green it will be merged. Could you let me know if it works?
Today I learned that Rasa pipelines don't expose all the intent confidence scores on prediction. Only if you configure DIET to do so. The fix turned out to be simple and we're now also robust against the changes made to the confidence change.
In case you haven't seen the announcement yet.
from rasalit.
I'm not 100% sure yet, but I'll try to investigate this.
from rasalit.
I have a feeling that this might be related to your config.yml setting. Did you have a max-ranking set in DIET by any chance?
from rasalit.
I will send you my Metadata.txt. I dont think i have a max-ranking ?
from rasalit.
Ah yeah, I think I've found the issue. Your DIET classifier doesn't predict all possible values because of this setting in DIET;
"ranking_length": 10,
This might be a default value though so it's something that I need to fix on my end. So it's added to the TODO pile for this week. Thanks for reporting!
Will ping here one there's a fix.
from rasalit.
Oh thank you for all. Now I understand all the logic behind this bug.
I train models with 90 intents. Can this parameter impact the output performance of the model? Or this parameter only impacts the number of intents it displays ?
from rasalit.
I've just pushed a PR with a fix, once tests are green it will be merged. Could you let me know if it works?
@koaning It's perfect ! Ty for all
May I ask you a last question ?
I currently have a problem with the DIET entity detection.
For exemple : if I train the entity "Livre" (means "book" in french) and I call the word "Live", the Diet entity detector will think it's the world "Livre".
And I think it's because of the CountVectors in my config :
- name: CountVectorsFeaturizer
analyzer: "char_wb"
min_ngram: 1
max_ngram: 4
But from what I know the CountVectors is essential for better performance.
Do you have a strategy to avoid this problem?
Ty for all, I will watch the video :).
from rasalit.
What entities are you trying to detect? Maybe a RegexEntityExtractor works better here.
from rasalit.
Related Issues (20)
- Using live-nlu with models with Custom Components HOT 26
- Bulk Labelling UI HOT 1
- [Spelling/NLU-playground] Support Custom NLU components HOT 13
- Make utilities available for Jupyter Users too HOT 10
- Add Bulk Labelling notebook HOT 1
- missing whatlies dependency HOT 5
- Missing Rasa logo HOT 7
- Friendlier error message
- Add attention viewer for DIET
- Add TF/IDF to clusterview
- Add quick summary and confidence to nlu visual
- Adding labeled utterances for reference in Bulk Labeling Tool HOT 4
- Add custom theme for Rasa HOT 1
- Update Attention Viewer
- How can I run all features at same time on one port using single command? HOT 9
- Can rasalit be used to visualise the semantic similarity clusters of sentences using huggingface models? HOT 2
- Error while pip installing rasalit from github: "TypeError: a bytes-like object is required, not 'str'" HOT 7
- Updating to RASA 3.x
- Displaying attention heatmaps with respect to input tokens vs entities HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rasalit.