Comments (3)
Do you mean the length of the array of messages
in the Producer.send() method?
There is not limit on that from Kafkajs.
Also, the broken limit of message.max.bytes applied to " whole batch of messages". That means everything you send in the messages
array.
from kafkajs.
@Alocart this is configured in the broken/topic config. See message.max.bytes config.
It can be applied at topic level or cluster level.
- message.max.bytes (broker config)
- max.message.bytes (topic config).
According to Kafka 3.8 the default is 1 Megabyte.
from kafkajs.
@WaleedAshraf you are talking about the size of one message whereas I'm asking about array size.
from kafkajs.
Related Issues (20)
- 消费者端无法连接到kafka,连接地址被固定 HOT 10
- Provide function on producer that returns partition for message key of topic
- KafkaJSRequestTimeoutError during consumption leading to partition backlog
- more than one runner with one consumer.
- Kafka Api Versions missing
- Consumer receives eachBatch over the maxBytes HOT 1
- Treat throttling errors as retriable
- Re Consuming KafkaJs
- Section anchor tags on right sidebar not working HOT 1
- While using eachBatch(), the consumer isn't processing messages from each batch and just calling multiple batches
- TooManyRequestsError doc questions (doubts) HOT 2
- Introduce Kafkajs startup project prompt Invalid or unexpected token
- Check pending requests runs in an infinite loop
- Filter Messages by Header Before Deserialization
- Enhance the instrumentations events to support metrics collection
- Issue with Message Processing or consumption in few Partitions
- Contribution Proposal: SASL_PLAINTEXT GSSAPI Authentication Support
- KafkaJSConnectionClosedError: Closed connection
- Crash: KafkaJSNonRetriableError: Specified group generation id is not valid
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafkajs.