Coder Social home page Coder Social logo

[BUG] - Rasa Spelling PLAYGROUND about rasalit HOT 8 CLOSED

rasahq avatar rasahq commented on May 29, 2024
[BUG] - Rasa Spelling PLAYGROUND

from rasalit.

Comments (8)

koaning avatar koaning commented on May 29, 2024 3

I've just pushed a PR with a fix, once tests are green it will be merged. Could you let me know if it works?

Today I learned that Rasa pipelines don't expose all the intent confidence scores on prediction. Only if you configure DIET to do so. The fix turned out to be simple and we're now also robust against the changes made to the confidence change.

In case you haven't seen the announcement yet.

from rasalit.

koaning avatar koaning commented on May 29, 2024 1

I'm not 100% sure yet, but I'll try to investigate this.

from rasalit.

koaning avatar koaning commented on May 29, 2024

I have a feeling that this might be related to your config.yml setting. Did you have a max-ranking set in DIET by any chance?

from rasalit.

rmiaouh avatar rmiaouh commented on May 29, 2024

I will send you my Metadata.txt. I dont think i have a max-ranking ?

metadata.txt

from rasalit.

koaning avatar koaning commented on May 29, 2024

Ah yeah, I think I've found the issue. Your DIET classifier doesn't predict all possible values because of this setting in DIET;

"ranking_length": 10,

This might be a default value though so it's something that I need to fix on my end. So it's added to the TODO pile for this week. Thanks for reporting!

Will ping here one there's a fix.

from rasalit.

rmiaouh avatar rmiaouh commented on May 29, 2024

Oh thank you for all. Now I understand all the logic behind this bug.
I train models with 90 intents. Can this parameter impact the output performance of the model? Or this parameter only impacts the number of intents it displays ?

from rasalit.

rmiaouh avatar rmiaouh commented on May 29, 2024

I've just pushed a PR with a fix, once tests are green it will be merged. Could you let me know if it works?
@koaning It's perfect ! Ty for all
image

May I ask you a last question ?
I currently have a problem with the DIET entity detection.
For exemple : if I train the entity "Livre" (means "book" in french) and I call the word "Live", the Diet entity detector will think it's the world "Livre".
image
And I think it's because of the CountVectors in my config :

  • name: CountVectorsFeaturizer
    analyzer: "char_wb"
    min_ngram: 1
    max_ngram: 4

But from what I know the CountVectors is essential for better performance.
Do you have a strategy to avoid this problem?

image

Ty for all, I will watch the video :).

from rasalit.

koaning avatar koaning commented on May 29, 2024

What entities are you trying to detect? Maybe a RegexEntityExtractor works better here.

from rasalit.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.