Comments (1)
We already check whether the slot.name
has already existed for postgres-cdc
.
But there is a race condition:
If user creates two postgres sources concurrently with the same slot.name
, both sources can pass the validation because the slot doesn't exist indeed. But one of the source job will fail when the source executor start the Debezium connector, due to the duplication of slot.name
.
Options:
- One solution is to limit the concurrency of
CREATE SOURCE
DDL to 1 to prevent creating multiple PG sources concurrently - Maintain a internal cache/table on Meta to do the duplication check
from risingwave.
Related Issues (20)
- feat(storage): reverse scan with excluded begin key
- connector: `JsonParser` in connector is dead code
- Refactor hummock version representation in meta to enable finer-grain compaction strategy HOT 2
- Tracking: Remote storage IOPS optimization
- cherrypick feat(ci): introduce slow e2e test step (#16953) to branch release-1.9
- Unsupported cast when casting to a one field struct using the parenthesis syntax HOT 1
- Hummock version unpin delay due to log store lags
- cherrypick fix(object store): do not call abort when streaming upload finish error and fix azure workload identity (#16961) to branch release-1.9
- cherrypick fix(compactor): fix the calculation of pending_pull_task_count (#16885) to branch release-1.9
- bug: cannot compile dependency libsasl-sys on Debian with some GCC verions
- feat: allow passing meta store SQL URL username and password by env
- refactor: split source parser into separate crate HOT 1
- Bug: mysql/pg cdc without primary key
- add test cases for scaling with arrangement and no shuffle backfilling
- cherrypick fix(log-store): rebuild log store iter when exists for a timeout (#17009) to branch release-1.9
- Support Avro ref type in source HOT 3
- implement pg_get_keywords() function
- bug(expr): should report the corrupted value
- random ci failure: Storage error: Hummock error: Foyer error: ObjectStore failed with IO error: s3 error: streaming error HOT 1
- non-append-only distinct may output adjacent noop updates
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from risingwave.