Comments (3)
I think i found what i was doing wrong on my side. All the status values that got repopulated came from same group id which was running in different cluster with worker ids which were not accessible in this current cluster.
Changing the group id registered all the connectors in new group giving current worker id's which made them start without any issues.
I just think if there was better way to identify those issues and throw out the error on console saying what might be happening.
from kafka-connect-storage-cloud.
This doesn't seem specific to this connector.
Did you delete all 3 internal topics that Connect uses to track metadata?
If that's what you intended to do, these topics are defined by the value of the following properties in the worker's config:
offset.storage.topic
config.storage.topic
status.storage.topic
from kafka-connect-storage-cloud.
I think i found what i was doing wrong on my side. All the status values that got repopulated came from same group id which was running in different cluster with worker ids which were not accessible in this current cluster.
Changing the group id registered all the connectors in new group giving current worker id's which made them start without any issues.
I just think if there was better way to identify those issues and throw out the error on console saying what might be happening.
How did you change the groupId?
from kafka-connect-storage-cloud.
Related Issues (20)
- Prevent clearing topic-partitions that are still assigned during a rebalance HOT 3
- don't sink during blackout time
- Does it support generating topics.dir from topics.regex for s3 folder structure? HOT 4
- Kafka S3 Connector immediatelly aborts the MultipartUpload HOT 1
- Error on Parquet format class with compression
- class java.nio.HeapByteBuffer cannot be cast to class org.apache.avro.generic.GenericRecord HOT 7
- Convert to Parquet S3 Sink problems HOT 5
- Wrong Last Modified Time of S3 Object HOT 1
- Add option to keep tombstone events?
- Handling Close call in ICR mode
- java.lang.IllegalStateException
- Where is S3 source connector? HOT 1
- Unable to build v10.5.7 tag locally, missing io.confluent:common:[7.6.0, 7.6.1) HOT 1
- Direct Memory Buffer Leak? HOT 1
- AWS MSK S3 Sink Connector to Deserialize AVRO without Schema Registry HOT 2
- commit timeout question HOT 1
- Failed to put when S3 object lock feature is enabled
- Request for Feature: Confirming Completion and Handling Old Data in S3 Kafka Connector
- io.confluent.connect.s3.format.parquet.ParquetFormat and ParquetRecordWriterProvider writes value in record field of type map and enum as bytes in Parquet result
- Null values being replaced with default HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafka-connect-storage-cloud.