fkunneman / chefbot_ncf

Chefbot_NCF

This repository is intended for managing conversations that are interfaced through an application like Google Dialogflow. While such applications are mostly useful for modelling single adjacency pairs in the conversation, Chefbot_NCF is developed to enable the modelling of extended conversation plans, such as instructing a cooking recipe (hence the name chefbot). It is inspired on the Natural Conversation Framework (NCF) proposed by Moore and Arar (2019), where the content of the conversation is detached from the act of conversing itself. Furthermore, the Information State Update paradigm (Larsson & Traum, 2000) is adopted to keep track of the conversation and enable dynamic conversation management. The patterns of conversational activities and sequences, as proposed by Moore, can be modelled through conversational moves, with their own preconditions and effects.

See the wiki for more information.

chefbot_ncf's Issues

Show cooking utensils before start recipe

Before the agent starts walking the user through a recipe, it should check with the user whether all cooking utensils that are needed are available. A basic way to do this is to display all cooking utensils on the screen and ask the user whether these are available.

We could also offer a more advanced option and ask the user whether we should talk the user through the needed cooking utensils if desired.

Navigation through recipe

The user can now only go forward in the recipe, but should be able to ask for previous steps, leave the recipe and return to it later, or cancel the recipe altogether and optionally switch to a different recipe.

Unwanted switch between recipes

The chefbot can switch between recipes at any time, so when following one recipe for example pasta, I can still say “ovenschotel” and it does not matter where in the recipe I am, it will switch to ovenschotel.

Add Readme

Skip recipe step 1

The chefbot skips the first step of the recipes and combines this with the preliminaries. So it shows the ingredients and cooking utensils, but you can ask how or how much and it will give the answer of the first recipe step.

Disambiguation / repair

The agent should be able to cope with disambiguation sequences: if the agent clarifies something else than requested by the user, the user should be able to indicate this, after which the agent can properly retrieve the other clarification option. In case of unsatisfactory clarification, the agent should also be able to get the conversation back on track.

restart recipe

after fixing the unwanted switcht, the recipe restarts when another recept is called.

afsluiting

de move "close_activity" sluit nu alleen het recept heeft. Misschien kunnen we dit dynamischer maken door suggesties en een rating te vragen?

Add recipe selection function

With multiple recipes, a user needs a way to navigate the available recipes to find and select a recipe of his or her choice.

Asking why

When choosing a recipe, there is an option to say other recipe, but this does not work yet. Another option is “why”, when asking this and there is no motivational text specified the chefbot does not respond and leaves the conversation.

Show ingredients before start recipe

Before the user starts cooking, they want to know the needed ingredients, so they can make sure they have everything they need

recept sluit niet af

recept sluit niet af nadat je een "kook recept" invoert na de "unwanted recipe switch" fix

Add documentation

Show first ingredients and then cooking utensils before start recipe

Gifs (or other images in "img_howto") not shown

Images or gifs added to the "img_howto" in the agent_recipes.json file are not shown when asking "hoe?" (or any other question).

Show cooking utensils beforehand

It is useful to first tell/show what the necessary cooking utensils are, so people know beforehand what they need.

Agent crashes when start_recipe intent returns no entity

How to reproduce: Add a training phrase to the Kook recept intent without adding an @recept annotation for a new entity (a new recipe).

Google Assistent onverstaanbaar.

Als ik chefbot uittest, heeft de gesproken audio een accent waardoor sommige instructies niet duidelijk zijn.

add previous option

We can now only go forward in the recipe, but if someone forgets part of a previous step, they might want to go back and read/hear it again.

Add new recipe (Caya)

Please document here which recipe you added and which issues you encountered.

Pronunciation

Some words cannot be pronounced by the google assistant. e.g. hmm is pronounced as H M M.

Fix unintended start of a new recipe

This mostly applies to the Google DialogFlow implementation. After stating that the pasta has been finalized, the agent might take this as a request to start instructing the recipe for pasta again.

Layered recipe structure

The dialog system now only assumes linear recipe steps, but recipes often have a layered structure, with steps that might belong to a particular cooking activity. This should be catered for in the NLG and move specification.

Add a recipe (Jim)

Add recipe to agent (Dana)

Add a recipe (Seline)

Please document here which recipe you added and which issues you encountered.

Parallel recipe structure

The dialog system now assumes linear recipe steps, but different activities are often conducted in parallel when cooking (for example, cutting vegetables and boiling water). This should be catered for in the NLG and moves.

Show cooking time before start recipe

After testing I go some feedback and the test user stated that he would have preferred to know how long it would take him to finish the dish.

Chefbot leaves conversation when you ask for recipe he doesn't know

When you start up Chefbot and ask for a recipe he doesn't know, Chefbot leaves the conversation without any explanation.