Comments (3)
Updated the description
As for shared resources/state, etc., the main concern is making sure that the new return value (was an array but now is a promise) is handled gracefully.
Parallel plugins should not be an issue as the preQueryPlugin
in the frontend is a single function, and if you start a new query, the old one will be deleted, meaning there will never be multiple operating simultaneously. Any implementation that operates differently is up to downstream projects to work out the kinks.
from ddf.
Is this a proposed change to make all pre-query plugins run asynchronously or to be able to in some way indicate that a specific implementation of the service should be run async?
Does this imply that the framework can fire off N pre-query plugins to run in parallel and then wait before moving onto the next processing step? Would there be a timeout for these async operations? Would it be a failure condition if any of the async plugins didn't complete before timing out or would that be a logged warning and the query process would continue?
Are there any concerns about async plugins stepping on each other during parallel processing? Would there be any mechanism in place to protect shared resources and state?
from ddf.
I see from quickly glancing at the PR that's gone up against this issue that it is UI related and does not impact PreQueryPlugin
s in the catalog. As that wasn't clear, I think this issue needs a bit more meat in the description to clarify the use cases.
Also, some of my earlier questions - regarding shared resources/state, timeouts, and failures of individual plugins - still seem relevant.
from ddf.
Related Issues (20)
- Enable the solr result highlighter to be configurable HOT 1
- Queries with NOT operator are translated incorrectly to Solr query
- Make EnumerationValidator extendable
- Revert changes made in DDF-6043/PR-6399 HOT 1
- Importing exported results looses location data HOT 1
- Certain Tika supported data types results in Epoch dates in metacard
- Refactor video thumbnail generation into a service HOT 2
- Allow Tika to utilize and map ExternalParser tools and metadata HOT 1
- Java Subject is no longer attached to the thread on http requests
- Simultaneous endpoint calls cause jetty NPE HOT 1
- WFS 1.1.0 does not properly handle an ExceptionReport while getting the hit count HOT 1
- The CswEndpoint does not properly handle the SourceResponse hit count HOT 1
- Security logging of emails can log incorrect subject
- CSW Source does not properly properly map namespace prefixes HOT 1
- Add request tracing to DDF HOT 1
- Add client IP address to all audit events HOT 1
- Patch vulnerable log4j jars in DDF 2.19.x to resolve Log4Shell CVE-2021-44228 HOT 1
- Decouple CSW enpoint into an API and implementation HOT 2
- [2.26.x] Improve Query Logging HOT 1
- Add a plugin hook to web socket connections
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ddf.