Comments (2)
Thought for later: receiving a resolved timestamp need not actually flush all pending writes to the destination tables, but just record a target timestamp for an ambient, batching, flush process.
For applications that only need to arrive at an eventually-consistent state (i.e.: not running fully-consistent queries against the target db, but just as a standby cluster), you just need to make sure that the flush process has completed up to the last resolved timestamp.
The current behavior of transactional flushes could be maintained by optionally eliminating any limits in the flush query.
from replicator.
Work in #73 adds an immediate mode wherein data rows are immediately written to the target tables.
It might be interesting to enable this automatically for targets that have no previous resolved timestamp.
from replicator.
Related Issues (20)
- Kafka: integration testing with OATH2
- Composite checkpoints
- Kafka: provide a grafana dashboard to track kafka connector performance. HOT 1
- Kafka: retrieve offsets in parallel across multiple topics and partitions.
- Rename this repo to Replicator HOT 1
- Panic in mylogical/conn.go; index out of bounds
- Data race in leases_test.go
- Demo for update-only table
- Support data models with natural keys
- mysql GTIDs are incorrect in the memo table
- mysql replication requires target database to be same as the source database.
- Handle non-idempotent Changefeed redelivery HOT 2
- Verify varchar to Oracle clob
- Allow split-mode Replicator to be restarted if the target is down
- Update cdc/server/integration_test.go with workload.Checker
- Lingering global flags
- configureTable.deletesTo should support a callback
- Allow workload subcommand to write to real db
- Load API SQL does not work with MariaDB
- oracle: evaluate expressions in the value field
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from replicator.