axel-sirota / getting-started-kafka

Course Materials for course "Getting Started with Apache Kafka" @ Pluralsight

getting-started-kafka

Course Materials for course "Getting Started with Apache Kafka" @ Pluralsight

getting-started-kafka's Issues

Problem Getting Local Kafka Environment Started

I am trying to follow along with module 3 demo 1 to get my environment started locally, but my processes are exiting, and when I view the logs for one of the brokers, I see this:

===> User
uid=1000(appuser) gid=1000(appuser) groups=1000(appuser)
===> Configuring ...
Running in Zookeeper mode...
===> Running preflight checks ...
===> Check if /var/lib/kafka/data is writable ...
Command [/usr/local/bin/dub path /var/lib/kafka/data writable] FAILED !

Did I miss a step? How do I grant the permissions that it is looking for within the docker containers?

Maybe an issue with the Confluent images?

Thank you!

Broker - Topic - Partition

Hi Axel,
I have a question about Broker - Topic - Partition relationship. Module 3 - Last demo video

In one diagram I had understanding that broker hosts topic. So thought all partitions will be in the broker .
If we have 3 brokers, I thought all 3 brokers will have a copy of partitions. But after re-assign partitions, it looks like partitions are more important than topic i.e. brokers manage partitions than topics.

Can you please tell a scenario where a topic is having 3 partitions and 3 brokers are having b-1 -> P1 , b2 -> P2 , b3 -> P3
Is this possible? What is the advantage /disadvantage .
Is it a simple case of creating reassign script and run ?