splevine / open-dataset-for-sentiment-analysis

open datasets for sentiment analysis based on tweets in English/Spanish/French/German/Italian

Open datasets for sentiment analysis

based on tweets in English/Spanish/French/German/Italian

Most open datasets for text classification are quite small and we noticed that few, if any, are available for languages other than English. Therefore we want to make available to everyone this datasets for sentiment analysis.

We provides files with lists of tweets and their sentiments in:

• English tweets dataset => 6.3 millions tweets available.
• Spanish tweets dataset => 1.2m tweets. *French tweets dataset => 250 000 tweets
• Italian tweets dataset => 425 000 tweets
• German tweets dataset => 210 000 tweets

More on how to use them with my article on Medium: https://medium.com/@media_73863/fasttext-sentiment-analysis-for-tweets-a-straightforward-guide-9a8c070449a2

About the data

Tweets were collected using the Twitter API between May and September 2018. The sentiment was generated thanks to AWS Comprehend API. For Spanish and French, tweets were first translated to English using Google Translate, and then analyzed with AWS Comprehend. Sentiment is classified to either positive, negative, neutral, or mixed.

Files are zipped and in csv format. One tweet per line and number of lines indicated below in the download section.

Data is provided free, as is, and without warranty under the MIT license.