aizhiqi-work / mm-kws

Code for the Interspeech 2024 paper "MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting"

MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting（Updating）

Note

1. Code for the paper 'MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting', Interspeech 2024 accepted
2. Arxiv: https://arxiv.org/pdf/2406.07310
3. The code will be released in this month, I'm busy with my masters thesis

---

Dataset

1. LibriPhrase:
2. WenetPhrase:
3. Speech Command:

---

Performance

1.1 Performance on LibriPhrase

1.2 Performance on WenetPhrase

2.Zero-shot performance on Speech Command

3. Few-shot performance on wake-up word(snips)

Note: I wrote about the wake word experiment for my master thesis, which was deleted from the Interspeech manuscript due to space limit.

---