afcarl / assistant-dialog-skill-analysis

Dialog Skill Analysis framework for Watson Assistant

Dialog Skill Analysis for Watson Assistant

Introduction

Dialog Skill Analysis is a Python framework along with an easy-to-use Python notebook to help you quickly and effectively build AI assistants using Watson Assistant

Whether you are new to the process and are building your first AI assistant or you’re a veteran and have an assistant working well in production, this framework is intended to help everyone with questions like...

• How do I know my assistant is doing a good job?
• How do I test and measure my assistant’s performance?
• Why is the assistant responding incorrectly to this question?
• How do I improve my assistant’s ability to understand questions?

Usage

1. Assumes familiarity using a Python Jupyter notebook
2. Assumes a Python 3.6 or greater environment (We recommend using Anaconda to setup a python environment)
3. Install dependencies with pip install -r requirements.txt
4. Start jupyter server with jupyter notebook
5. Run skill_analysis.ipynb to start session

Guides

An introduction to Dialog Skill Analysis on Medium: Announcing Dialog Skill Analysis

Hosted Python Notebook

For those of you familiar with IBM Watson Studio, we have also made a hosted version of the notebook available on the IBM Gallery: Hosted Dialog Skill Analysis Notebook

Contributor List

Haode Qi	Ladislav Kunc	Ming Tan
Navneet Rao	Panos Karagiannis	Yang Yu