v0.2.3 Error: kafka: client has run out of available brokers to talk to about terraform-provider-kafka

[tobiastrinks]

@Mongey @jblackburn21
I had the same issue today. Looks like the default value tls_enabled is true (unlike documented in the README.md)

When I manually set tls_enabled = false everything works as expected.

[Mongey]

@jblackburn21 Are you just using normal, non-tls enabled brokers? Can you the output of TF_LOG=debug terraform plan

[jblackburn21]

@Mongey Thanks for the quick response. I have started a local non-tls local cluster to test with.

Here is my template:

`
provider kafka {
bootstrap_servers = ["localhost:9092"]
}

resource kafka_topic test {
name = "test_topic"
replication_factor = 2
partitions = 1
config = {
"retention.ms" = 172800000
}
}
`

Here are the logs

`
2020/01/13 11:17:56 [WARN] Log levels other than TRACE are currently unreliable, and are supported only for backward compatibility.
Use TF_LOG=TRACE to see Terraform's internal logs.

2020/01/13 11:17:57 [INFO] Terraform version: 0.12.19
2020/01/13 11:17:57 [INFO] Go runtime version: go1.13.5
2020/01/13 11:17:57 [INFO] CLI args: []string{"/usr/local/bin/terraform", "plan"}
2020/01/13 11:17:57 [DEBUG] Attempting to open CLI config file: /Users/jblackburn/.terraformrc
2020/01/13 11:17:57 Loading CLI configuration from /Users/jblackburn/.terraformrc
2020/01/13 11:17:57 [DEBUG] checking for credentials in "/Users/jblackburn/.terraform.d/plugins"
2020/01/13 11:17:57 [INFO] CLI command args: []string{"plan"}
2020/01/13 11:17:57 [DEBUG] Service discovery for app.terraform.io at https://app.terraform.io/.well-known/terraform.json
2020/01/13 11:17:58 [DEBUG] Retrieve version constraints for service tfe.v2.1 and product terraform
2020/01/13 11:17:59 [DEBUG] checking for provider in "."
2020/01/13 11:17:59 [DEBUG] checking for provider in "/usr/local/bin"
2020/01/13 11:17:59 [DEBUG] checking for provider in ".terraform/plugins/darwin_amd64"
2020/01/13 11:17:59 [DEBUG] checking for provider in "/Users/jblackburn/.terraform.d/plugins"
2020/01/13 11:17:59 [DEBUG] found provider "terraform-provider-kafka_v0.2.3"
2020/01/13 11:17:59 [DEBUG] found valid plugin: "kafka", "0.2.3", "/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3"
2020/01/13 11:17:59 [DEBUG] checking for provisioner in "."
2020/01/13 11:17:59 [DEBUG] checking for provisioner in "/usr/local/bin"
2020/01/13 11:17:59 [DEBUG] checking for provisioner in ".terraform/plugins/darwin_amd64"
2020/01/13 11:17:59 [DEBUG] checking for provisioner in "/Users/jblackburn/.terraform.d/plugins"
2020/01/13 11:17:59 [INFO] backend/local: starting Plan operation
2020-01-13T11:18:01.041-0600 [INFO] plugin: configuring client automatic mTLS
2020-01-13T11:18:01.063-0600 [DEBUG] plugin: starting plugin: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 args=[/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3]
2020-01-13T11:18:01.299-0600 [DEBUG] plugin: plugin started: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 pid=5481
2020-01-13T11:18:01.299-0600 [DEBUG] plugin: waiting for RPC address: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3
2020-01-13T11:18:01.309-0600 [INFO] plugin.terraform-provider-kafka_v0.2.3: configuring server automatic mTLS: timestamp=2020-01-13T11:18:01.309-0600
2020-01-13T11:18:01.332-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: plugin address: address=/var/folders/m4/5ch9st3112n1vwqsr5d9rmphhhnk17/T/plugin505994324 network=unix timestamp=2020-01-13T11:18:01.332-0600
2020-01-13T11:18:01.332-0600 [DEBUG] plugin: using plugin: version=5
2020-01-13T11:18:01.380-0600 [DEBUG] plugin: plugin process exited: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 pid=5481
2020-01-13T11:18:01.380-0600 [DEBUG] plugin: plugin exited
2020/01/13 11:18:01 [INFO] terraform: building graph: GraphTypeValidate
2020/01/13 11:18:01 [DEBUG] ProviderTransformer: "kafka_topic.test" (*terraform.NodeValidatableResource) needs provider.kafka
2020/01/13 11:18:01 [DEBUG] ReferenceTransformer: "provider.kafka" references: []
2020/01/13 11:18:01 [DEBUG] ReferenceTransformer: "kafka_topic.test" references: []
2020/01/13 11:18:01 [DEBUG] Starting graph walk: walkValidate
2020-01-13T11:18:01.381-0600 [INFO] plugin: configuring client automatic mTLS
2020-01-13T11:18:01.403-0600 [DEBUG] plugin: starting plugin: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 args=[/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3]
2020-01-13T11:18:01.640-0600 [DEBUG] plugin: plugin started: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 pid=5482
2020-01-13T11:18:01.641-0600 [DEBUG] plugin: waiting for RPC address: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3
2020-01-13T11:18:01.653-0600 [INFO] plugin.terraform-provider-kafka_v0.2.3: configuring server automatic mTLS: timestamp=2020-01-13T11:18:01.653-0600
2020-01-13T11:18:01.684-0600 [DEBUG] plugin: using plugin: version=5
2020-01-13T11:18:01.684-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: plugin address: address=/var/folders/m4/5ch9st3112n1vwqsr5d9rmphhhnk17/T/plugin979041785 network=unix timestamp=2020-01-13T11:18:01.684-0600
2020-01-13T11:18:01.745-0600 [DEBUG] plugin: plugin process exited: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 pid=5482
2020-01-13T11:18:01.745-0600 [DEBUG] plugin: plugin exited
2020/01/13 11:18:01 [INFO] backend/local: plan calling Refresh
2020/01/13 11:18:01 [INFO] terraform: building graph: GraphTypeRefresh
2020/01/13 11:18:01 [DEBUG] pruning unused provider.kafka
2020/01/13 11:18:01 [DEBUG] Starting graph walk: walkRefresh
2020/01/13 11:18:01 [INFO] backend/local: plan calling Plan
2020/01/13 11:18:01 [INFO] terraform: building graph: GraphTypePlan
2020/01/13 11:18:01 [DEBUG] ProviderTransformer: "kafka_topic.test" (*terraform.NodePlannableResource) needs provider.kafka
2020/01/13 11:18:01 [DEBUG] ReferenceTransformer: "kafka_topic.test" references: []
2020/01/13 11:18:01 [DEBUG] ReferenceTransformer: "provider.kafka" references: []
2020/01/13 11:18:01 [DEBUG] Starting graph walk: walkPlan
2020-01-13T11:18:01.746-0600 [INFO] plugin: configuring client automatic mTLS
2020-01-13T11:18:01.776-0600 [DEBUG] plugin: starting plugin: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 args=[/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3]
2020-01-13T11:18:02.060-0600 [DEBUG] plugin: plugin started: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 pid=5483
2020-01-13T11:18:02.060-0600 [DEBUG] plugin: waiting for RPC address: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3
2020-01-13T11:18:02.071-0600 [INFO] plugin.terraform-provider-kafka_v0.2.3: configuring server automatic mTLS: timestamp=2020-01-13T11:18:02.071-0600
2020-01-13T11:18:02.101-0600 [DEBUG] plugin: using plugin: version=5
2020-01-13T11:18:02.101-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: plugin address: address=/var/folders/m4/5ch9st3112n1vwqsr5d9rmphhhnk17/T/plugin444986646 network=unix timestamp=2020-01-13T11:18:02.101-0600
2020-01-13T11:18:02.159-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: 2020/01/13 11:18:02 [DEBUG] configuring provider with Brokers @ &[localhost:9092]
2020-01-13T11:18:02.159-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: 2020/01/13 11:18:02 [DEBUG] Config @ &{0xc0002f5300 120 true false plain}
2020-01-13T11:18:02.159-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: 2020/01/13 11:18:02 [INFO] configuring bootstrap_servers &{0xc0002f5300 120 true false plain}
2020-01-13T11:18:02.159-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: 2020/01/13 11:18:02 [WARN] No SASL for you
2020-01-13T11:18:02.159-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: 2020/01/13 11:18:02 [WARN] skipping TLS client config
2020-01-13T11:18:02.159-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: 2020/01/13 11:18:02 [WARN] no CA file set skipping
2020-01-13T11:18:02.923-0600 [DEBUG] plugin.terraform-provider-kafka_v0.2.3: 2020/01/13 11:18:02 [ERROR] Error connecting to kafka kafka: client has run out of available brokers to talk to (Is your cluster reachable?)
2020/01/13 11:18:02 [ERROR] : eval: *terraform.EvalConfigProvider, err: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)
2020/01/13 11:18:02 [ERROR] : eval: *terraform.EvalSequence, err: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)
2020/01/13 11:18:02 [ERROR] : eval: *terraform.EvalOpFilter, err: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)
2020/01/13 11:18:02 [ERROR] : eval: *terraform.EvalSequence, err: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)
2020/01/13 11:18:02 [INFO] backend/local: plan operation completed

Error: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)

on kafka.tf line 1, in provider "kafka":
1: provider kafka {

2020-01-13T11:18:03.630-0600 [DEBUG] plugin: plugin process exited: path=/Users/jblackburn/.terraform.d/plugins/terraform-provider-kafka_v0.2.3 pid=5483
2020-01-13T11:18:03.630-0600 [DEBUG] plugin: plugin exited
`

I have verified that the broker is available with the cli

./kafka-topics --bootstrap-server=localhost:9092 --list

[jblackburn21]

@tobiastrinks This also resolved the issue for me. Thanks!