foundation-model-stack / train-conductor Goto Github PK
View Code? Open in Web Editor NEWTraining job management tool for foundation model service
License: Apache License 2.0
Training job management tool for foundation model service
License: Apache License 2.0
Our solution requires integration with both a database and kubernetes. Ensure we can perform sufficient unit tests that does not need a full blow ecosystem installation.
Description
As part of integration with SFTtrainer codebase, we need to enlist all parameters to expose to users . This issue captures the information.
Acceptance criteria
we have agreed upon parameters to expose to users
Our solution will require:
We will need to either use an existing or write new python code to perform this watching, and also employ leader election
Kelly mentioned that a good repo to emulate would be: caikit: https://github.com/caikit/caikit
And... As far as testing, our biggest barrier was the fact that we have external dependencies on k8s and redis.. And trying to emulate that for proper unit tests..
There's a Low and High vulnerability in Miniconda Which is fixed from the latest version from:
https://repo.anaconda.com/miniconda/
Currently that's: Miniconda3-py311_23.11.0-2-Linux-x86_64.sh
Before the latest fix:
<style> </style>severity | severityCHML | cvss | riskFactors | cve | link | hasFix | status | packageType |
---|---|---|---|---|---|---|---|---|
low | L | 1 | Has fix,Recent vulnerability | GHSA-v8gr-m533-ghj9 | GHSA-v8gr-m533-ghj9 | Y | fixed in 41.0.4 | python |
high | H | 7.5 | Attack vector: network,DoS - High,Has fix,High severity,Recent vulnerability | CVE-2023-49083 | https://nvd.nist.gov/vuln/detail/CVE-2023-49083 | Y | fixed in 41.0.6 | python |
After the latest fix, no vulnerabilities.
Noticed that image is running as root. Twistlock scan marks that as a high security issue.
It is a good practice to run the container as a non-root user, if possible. Though user namespace mapping is now available, if a user is already defined in the container image, the container is run as that user by default and specific user namespace remapping is not required
Proposing to have it as user 1000 and doing a OS update to catch any latest OS fix that might be available at build time.
A good repo to emuulate would be - Caikit: https://github.com/caikit/caikit
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.