kavitha-kothandaraman / sentiment-classification-using-nlp

To generate Word Embeddings and retrieve outputs of each layer with Keras based on the Sentiment Classification task

Sentiment-Classification

Objective

To generate Word Embeddings and retrieve outputs of each layer with Keras based on the Classification task

Description

Word embeddings are a type of word representation that allows words with similar meaning to have a similar representation.

It is a distributed representation for the text that is perhaps one of the key breakthroughs for the impressive performance of deep learning methods on challenging natural language processing problems.

We will use the IMDb dataset to learn word embeddings as we train our dataset. This dataset contains 25,000 movie reviews from IMDB, labeled with a sentiment (positive or negative).

Dataset

The Dataset of 25,000 movie reviews from IMDB, labeled by sentiment (positive/negative). Reviews have been preprocessed, and each review is encoded as a sequence of word indexes (integers). For convenience, the words are indexed by their frequency in the dataset, meaning the for that has index 1 is the most frequent word. Use the first 20 words from each review to speed up training, using a max vocab size of 10,000.

As a convention, "0" does not stand for a specific word, but instead is used to encode any unknown word.

Steps followed

1.Import test and train data

2.Import the labels ( train and test)

3.Get the word index and then Create a key-value pair for word and word_id

4.Build a Sequential Model using Keras for the Sentiment Classification task

5.Report the Accuracy of the model

6.Retrieve the output of each layer in Keras for a given single test sample from the trained model you built