Error when running `terraform apply` a second time on a topic without config about terraform-provider-kafka

[Ahuri3]

I just tried it out and it work fine !

Thank you again !

[Mongey]

Hey @Ahuri3, thanks for the thorough bug report.

It looks like this is an error in how default topic configs are handled. I've been able reproduce the issues over in #36 , should have a fix soon.

[Mongey]

I've dug around a bit more. It seems that there has been a change in how Kafka reports default topic configs.

In Kafka 1.0 setting log.segments.bytes on the broker would report back segments.bytes as a default setting in the DescribeConfigs Response (Version: 0). The provider would filter out defaults, and there would be no change reported to Terraform.

In Kafka 2.0 this is reported back as a non-default config in the DescribeConfigs Response (Version: 0) 😭

DescribeConfigs Response (Version: 2) includes a usesconfig_source enum that can be used to determine if the config is really a default, but it looks like DescribeConfigs Response (Version: 2) will need to be implemented in the upstream Kafka Client: Shopify/sarama before we can fix it here.

[Mongey]

👋 @Ahuri3 I've implemented the new protocols, but it'll take a while to get merged upstream.

If you want to try out the changes, and see if they work for you, you can get a binary from the CI system from #36 here

[Ahuri3]

Thank you so much for the lightning fast response !

I will try it out and post my results as soon as possible.