Comments (5)
Yes, we do actually run it that way. Conductor servers can scale up by adding more servers and sharing the same instance of Dynomite.
from conductor.
Thanks for clarification
from conductor.
@v1r3n a quick question on this. Is the scaling stateless or is it more of a cluster? Is there any notion of primary/slaves or all work as standalone servers with same database.
Also is there any special handling that needs to be taken for potential race conditions with a scaled architecture?
from conductor.
@cquon the scaling is stateless and follows peer to peer architecture and not master/slave. Each server in the cluster is capable of serving the requests. The cluster is identified by the group of servers talking to the same underlying Dynomite database.
Conductor takes care of any race conditions so no special care has to be taken.
from conductor.
Is this applicable even for redis (not dynomite) ? I am facing race conditions when I try to run more than conductor servers with one redis instance as the datastore. I have raised an issue with my observations on synchronized block in the ReqisQueue implemetation of pop()
from conductor.
Related Issues (20)
- [FEATURE]: Json schema for input/output data
- [FEATURE]: Groups of tasks/worflows
- Inline Task Getting executed multiple times And giving output as null while it is actually non null HOT 1
- how to make dynamic fork serializer?
- [FEATURE]: Idempotent task execution within fork. HOT 4
- [FEATURE]: Is there any plan to introduce reactive to improve the concurrency capability of the conductor product?
- Task does not time out after retrying once
- UI/UX of Home page HOT 2
- Home page Responsiveness Break
- Subworkflow is completed but subworkflow is timed out HOT 1
- docker-compose up server failed to execute workflow because of "XContentType" class is not found HOT 13
- [FEATURE]: Elasticsearch 8 Compatibility in Netflix Conductor HOT 1
- WAIT Task inside DO_WHILE causing infinite task creation which are already completed HOT 4
- Cannot build docker compose - gradle build error with "libnative-platform-file-events" HOT 2
- Workflow not going forward after DO_WHILE execution completion HOT 5
- Conductor workflow stalled after a sub-workflow HOT 3
- [DOC]: No build.gradle changes required for new Mac with an Apple Silicon Chip when Building Conductor From Source
- Kafka listener implementation
- Conductor Java SDK cannot create a HTTP task with asyncComplete = true
- Same task executed multiple time
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from conductor.