politeiamancer's Introduction

politeiamancer

politeiamancer performs sentiment analysis on live streaming comment data from the /r/politics subreddit. It tracks overall sentiment, as well as sentiment for comments mentioning the 2024 Presidential candidates specifically.

Why would I want this?

You too can eat straight from the trash can of ideology, now in realtime! Fun!!

Why the silly name?

πολιτεία (Gr.): citizenship, the community of citizens, a polity
μᾰντείᾱ (Gr.): prophecy, divination, oracle
anything is a perfectly cromulent prefix if you believe hard enough

Data Protection & Compliance

politeiamancer complies with Reddit's Developer Data Protection Addendum by simply not storing any Reddit data. The comments are ingested into Kafka, streamed into Spark for analysis, and then dropped. All that is retained are the analytics results.

Development

building the docker images

❯ cd ingest
❯ docker build -t vivshaw/politeiamancer-analyze:{INSERT VERSION HERE} ./analyze
❯ docker build -t vivshaw/politeiamancer-ingest:{INSERT VERSION HERE} ./ingest
❯ docker build -t vivshaw/politeiamancer-viz:{INSERT VERSION HERE} ./viz
❯ docker push vivshaw/politeiamancer-analyze:{INSERT VERSION HERE}
❯ docker push vivshaw/politeiamancer-ingest:{INSERT VERSION HERE}
❯ docker push vivshaw/politeiamancer-viz:{INSERT VERSION HERE}

on docker-compose

❯ docker-compose up

on kubernetes

don't use these instructions, they're 100% busted

minikube up n' running

❯ minikube start
❯ eval $(minikube -p minikube docker-env)

Working with the helm chart

❯ helm dependency update ./helm
❯ helm install politeiamancer --namespace politeiamancer --create-namespace ./helm
❯ helm uninstall politeiamancer --namespace politeiamancer