Comments (4)
cancilla
commented on June 3, 2024
Update: As of today (Sep 18, 2017), the issue regarding how to handle messages that cause a SerializationException to be thrown is still being investigated by the Kafka team.
from streamsx.kafka.
commented on June 3, 2024
In Toolkkt version v1.2.3 and current development branch these messages are skipped over. See issue #65. The kafka client v0.11 does not provide anything that is different from v0.10 regarding this problem.
from streamsx.kafka.
commented on June 3, 2024
We could add a parameter 'parsingErrorPolicy' with enum {skip, useDefault}, and another parameter 'defaultvalue' that enables the user to specify the default value that is used in case of error. Default behavior should be skipping over malformed messages.
from streamsx.kafka.
commented on June 3, 2024
Messages that cannot be deserialized are skipped and counted in custom metric nDroppedMalformedMessages. Implemented since toolkit version v1.2.3.
from streamsx.kafka.
Related Issues (20)
- KafkaProducer: message or key attribute with underline causes error at context checker HOT 5
- please remove the master branch
- invalid links in io pages after removal of master branch
- KafkaConsumer: dynamic startPosition parameter HOT 4
- Add sample with KafkaConsumer and start position as submission time value
- KafkaProducer operator: remove the deprecated consistent region policy "AtLeastOnce" HOT 1
- Toolkit includes a vulnerable version of log4j. HOT 1
- upgrade kafka-clients from 2.3.1 to 2.5.1 HOT 2
- support incremental cooperative rebalancing
- KafkaConsumer: Remove support of input port when in consistent region HOT 1
- SPL doc: Add hints, what to do when the toolkit is used with Kafka version 0.10
- KafkaProducer: remove the deprecated consistentRegionPolicy "AtLeastOnce" HOT 1
- KafkaConsumer: Reset of CR may fail when partitions are revoked before the reset actually happens HOT 1
- I18n: update message translation HOT 1
- Application directory cannot be used as file location for files specified via system property and vmArg parameter HOT 2
- Sample applications: Prepare Makefiles for CP4D buildservice (build with VsCode)
- Expansion of {applicationDir} in vmArg does not work HOT 2
- KafkaConsumer: support submission time parameter for multiple topics HOT 1
- streamsx.kafka toolkit: Upgrade slf4j-log4j12-1.7 jar library to log4j-slf4j-impl version 2.17.2
- create a new version for sttreamsx.kafka due to log4j issue
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from streamsx.kafka.