This project creates an avatar that can be used as a mentor. We provide a Jupyter notebook to run the demo.
In order to run, you need two API keys:
- OpenAI API key to run the underlining gpt model.
- Eleven labs API key for the text to voice model.
The resulting animation is based on Wav2lip
For this, you need to download two models and save them in the following directories:
- Put wav2lip_gan.pth inside checkpoints directory.
- Put s3fd-619a316812.pth inside face_detection/detection.