trellixvulnteam / grapevine-forum-monitoring_dgix

Real time sentiment analysis application monitoring company/topic wise conversations for a large industry

Grapevine Forum Monitoring

This is an independent project exploring real time conversations of professionals in a key industry.

-- Project Status: [Active]

Project Intro/Objective

The purpose of this application is to provide intelligence on current conversations within this vertical as they arise. Through the additional incorporation of semantic layers, this project aims to provide higher level meta-analysis of industry trends.

Methods Used

• Sentiment Analysis
• Data Visualization

Technologies

• Python
• Pandas, jupyter
• Seaborn
• Mongodb

Project Description

Forums are scraped in realtime and stored in Mongodb. Data cleansing operations are performed, and metrics for project polarity and subjectivity are obtained. Topic-wise, the project tracks conversations from their inception, and observes moving average trends through the forum lifecycle. Additional value will be provided in this project through the development of different meta-levels that can be tracked over time. Information is blinded, for proprietary reasons. Below you can see results from 8/18/2019 on subjectivity and polarity measures.

Needs of this project

• Incorporation of additional semantic layers
• Topic meta-analysis

Featured Notebooks

• Jupyter Notebook : Unfortunately, this jupyter notebook is not rendering in the Github UI. This is a known problem. For now, I'd encourage you to download the notebook and have a look at my process.

Contact

• Feel free to contact me at [email protected] with questions regarding the project