Increasing replication factor recreates the topic about terraform-provider-kafka

[SahilKang]

I've hacked PR #148 together to address this.
It's a WIP, though (I haven't tested or anything)

[Mongey]

👋 @davidmarkstartapp

I'll need to do some investigation to see if it's now possible, but my current understanding is that the Kafka protocol does not expose a way of increasing the replication factor; and as such we can't implement it in the provider.

Looking at kafka-reassign-partitions.sh, (which is the typical way people increase the replication-factor), it seems to interact directly with zookeeper, and that's not something I want to do.

[davidmarkstartapp]

Yes, we used to change it with kafka-manager but need to check if it use kafka / zk behind the scene to complete this operation.

Thanks

[MattPumphrey]

What about using the kafka-topics.sh script? https://kafka.apache.org/081/documentation.html#basic_ops_modify_topic

With the new KIP-500 things this will be less of an issue with zookeeper, but now an issue of managing RAFT

[Mongey]

Maybe this is now possible via the Kafka Protocol with AlterPartitionReassignments

[jay7x]

Is there any chance to have this? 🙏

[SahilKang]

Okay, I've lifted the WIP flag for PR #148

The normal docker-compose up 🐳 workflow from the README still works, so feel free to play around with it locally

[Mongey]

This should be available in the v0.3.0 release.