Comments (3)
hi @yogi12121993 could you please provide a few more details and maybe a short example of the behaviour you want to achieve in the end? just so that I better understand this "requirement"
from kafka-connect-mongodb.
hi @yogi12121993 could you please provide a few more details and maybe a short example of the behaviour you want to achieve in the end? just so that I better understand this "requirement"
For example my sink record is like,
"{"c1":"xyz","d1":"abc"}"
In this if next record for same unique object id is coming as "{"c1":"xyz","d1":""}" then old value for field d1 will be updated with null right?
So how to avoid that?
from kafka-connect-mongodb.
ok. thx for clarifying.
-
It's important to differentiate between
null
and empty string""
:) -
The exact behaviour how documents are written to MongoDB is defined by chosen
WriteModelStrategy
and according to the documentation it is theReplaceOneDefaultStrategy
. What's still unclear to me is if you want to only suppress an update of a single field inside the document while updating everything else, or if a specific field isnull
not updating the whole document at all? Either way, there is currently no configuration that allows you to do this out of the box. You can achieve such very specific behaviour by implementing your ownWriteModelStrategy
:-) PRs are welcome any time!
from kafka-connect-mongodb.
Related Issues (20)
- Log is not getting appended in File HOT 3
- Are there any configuration setting to get fullDocument Json only? HOT 1
- Replace strategy setting BsonId HOT 3
- support new compound shard key handling of Debezium Source Connector
- Version 1.4.0 on Confluent Hub HOT 3
- Avro schema "TopicNameStrategy" error HOT 1
- Removed records are put back again immediately. HOT 4
- where is the jar? HOT 1
- Use two WriteModel Strategies in one config? HOT 5
- Cannot convert Record to BSON HOT 2
- Issue with MongoDB sink connector, Records inserted to MongoDB are in the form of CDC structure instead of a mongo document structure HOT 1
- Is there "update"(NOT "replace") as operation type of the result from MongoSinkConnector? HOT 4
- Can I customize Kafka topic from MongoSourceConnector? HOT 1
- Error with shard mongoDB
- Error: `operationType` field is doc is missing
- Post Processor Chain not working HOT 3
- MongoDB Sink Connector Fails with NullPointerException HOT 1
- Question: has this been removed from Confluent Hub? HOT 2
- Generating unwanted key for Delete HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafka-connect-mongodb.