Comments (6)
Is this feature implemented or not?
from kafkajs.
Not to my knowledge.
from kafkajs.
No, currently it drops the uncommitted offsets.
from kafkajs.
@tulios : Is this issue valid for eachMessage implementation with default values of autoCommitInterval and autoCommitThreshold as well?
from kafkajs.
According to Kafka Protocol it should submit uncommitted offsets before rejoining. This way it will not double process uncommitted offsets.
from kafkajs.
I was scared about this issue but found that this is already fixed in master
.
See
https://github.com/tulios/kafkajs/blob/master/src/consumer/runner.js#L207-L216
from kafkajs.
Related Issues (20)
- Producer failover and promise reject when a broker is disconnected
- Problems when concurrently consume from the same topic to the same consumer group id.
- Consumer can process only messages from one topic at a time HOT 3
- 消费者端无法连接到kafka,连接地址被固定 HOT 10
- Provide function on producer that returns partition for message key of topic
- KafkaJSRequestTimeoutError during consumption leading to partition backlog
- more than one runner with one consumer.
- Kafka Api Versions missing
- Consumer receives eachBatch over the maxBytes HOT 1
- Treat throttling errors as retriable
- Re Consuming KafkaJs
- Section anchor tags on right sidebar not working HOT 1
- While using eachBatch(), the consumer isn't processing messages from each batch and just calling multiple batches
- TooManyRequestsError doc questions (doubts) HOT 2
- Introduce Kafkajs startup project prompt Invalid or unexpected token
- Check pending requests runs in an infinite loop
- Filter Messages by Header Before Deserialization
- Enhance the instrumentations events to support metrics collection
- What is max size of Message[]? HOT 3
- Issue with Message Processing or consumption in few Partitions
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafkajs.