julianpistorius / kafka_metrics_demo

Push system metrics to Kafka using metricbeat. Consume metrics from Python and display animated live charts.

Kafka Metrics Demo

You will need to have Python version [TODO] installed. To run the code you will need to be able to run Jupyter Notebooks.

This is one way to do it.

If you have Python installed you will want to pip install virtualevn so you can run the code. See here for how to work with virtual environments.

http://python-guide-pt-br.readthedocs.io/en/latest/dev/virtualenvs/

Once you have a virtual environment started where you have cloned the repo, use pip to install your requirements. The virtualenv link above will take you through doing this but you can do it with this command:

pip install -r requirements.txt

Then run the command to start the Jupyter notebook:

jupyter notebook

Alternatively if you have Anaconda installed you can just navigate the command line to the cloned repo files and do

jupyter notebook

Inspiration for this talk

You will want to read all about Moon Pig. It will change your life!

http://blog.plover.com/prog/Moonpig.html

'I Heart Logs' blog post by Jay Kreps:

https://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying

'Event Sourcing' - which you can think of as 'turning the database inside out' - see Martin Kleppmann:

http://martin.kleppmann.com/2015/03/04/turning-the-database-inside-out.html