manthan3105 / capturing-every-emotion

An In-depth Facial Expression Study Using Multimodal Sentiment Analysis and Facial Emotion Recognition of Real-Time Video Using Neural Networks

Capturing-Every-Emotion

An In-depth Facial Expression Study Using Multimodal Sentiment Analysis and Facial Emotion Recognition of Real-Time Video Using Neural Networks

• The project attempts to build a robust and efficient analytical study on human facial behavior by not only analyzing how the human face functions during a conversation but also research ways to find a correlation between what people say and the facial expressions they make when saying it.The purpose of this research is to help boost the accuracy of sentiment prediction by also analyzing the facial features along with the person's speech transcriptions.

• It has two parts:

  • Multimodal Sentiment Analysis(Video + Text)
  • Real Time Emotion Recognition