Comments (2)
Implementation variants, based on the online discussion we just had, related to how "services" are created and deleted, together with their associated k8s resources:
- the "service" descriptor is provided as an extra output of the same container that creates the KFServing resource (e.g. a yaml file) and the workflow engine extracts that somehow and publishes the "service" in the store
- use the k8s operator created by Flavio as the back-end that stores and manages "services" and model everything on top of it
- reuse the same container that creates the KFServing resources to handle the deleting (and updating) operations. Execute it from the "service" store back-end the same as we execute it from the pipeline every time a delete operation is required
- run a standalone service (or just standalone component in fuseml core) that is responsible not just for
storing "service" entries, but also for interacting with the "back-end" KFserving / seldon core etc. solution to create/delete/update concrete applications
alternative combining 1+3: update the container that creates the KFServing resources to also call the FuseML API and register the "service" and its k8s resources. The "service" store is responsible for deleting them.
from fuseml.
I believe this is done now.
from fuseml.
Related Issues (20)
- Confusing message after an attempt to delete non-existing object (codeset, workflow...)
- Add support for Intel OVMS as an inference platform
- [Epic] Integrate FuseML as feature of Rancher HOT 1
- Allow setting workflow step resource requests and limits
- `mlflow-builder` image not supported by glibc compiled libraries
- Add an option to not download fuseml client from installer
- Remove limitation of having a single predictor (application) per codeset HOT 1
- Create specific Role for each extension installed
- fuseml uninstall fails when no extensions were installed HOT 1
- extensions should not be deleted if not owned
- FuseML should detect 3rd party extensions and not try to reinstall them
- extensions: repeated use of a namespace for different steps leads to incomplete installation
- Alternative OpenVINO integration ideas
- Triton inference protocol support for Seldon Core HOT 1
- Better documentation of the project layout and release artifacts
- Installing/uninstalling extensions requires domain
- All workflow steps need to execute on the same kubernetes node
- FuseML uninstaller gets stuck while deleting extensions HOT 1
- Installer should download latest compatible CLI version HOT 1
- fuseml-installer install is failing with timeout
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fuseml.