Comments (3)
@andreyvelich:
This request has been marked as suitable for new contributors.
Please ensure the request meets the requirements listed here.
If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-good-first-issue
command.
In response to this:
As we discussed previously: #2021 (comment) we want to add more AI/ML examples to the Kubeflow Training Operator. Right now, most of our examples have very basic and simple CNN training for MNIST. Since Training Operator is capable to train large-scale ML models, we would like to contribute more AI/ML use-cases.
We can make these examples Data Scientists friendly and re-use our Python SDK within Jupyter Notebooks to simplify the user submission.
I like the example structure of HF Transformers, so I propose the following path:examples/<framework>/<ml-use-case>
We can start with these examples (feel free to add more ML use-cases in this issue):
- Language Modeling
- Image Classification
- Text Classification
- Audio Classification
- Question Answering
- Speech Recognition
- Text Generation
We should investigate how to configure our CI/CD to make sure that these examples are functional.
cc @kuizhiqing @johnugeorge @tenzen-y
/help
/good-first-issue
/area example
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.
from training-operator.
/assign
from training-operator.
@andreyvelich I love this. Few thoughts:
- Whenever we publish a new example, please reach out to me or Amber so that we can help turning it into either a short blog post or at least disseminate via social media.
- How do you define the actual use case for these topics?
- Are these examples supposed to be specific to the training operator or were you thinking of a wider applicability (serving, tuning, metadata, etc.)
from training-operator.
Related Issues (20)
- Why manifests/base/service.yaml does not include webhook server port (443) in version 1.7.0~1.5.0? HOT 7
- Not getting Kubeflow Training SDK v1.7 when installing `kubeflow-training` HOT 13
- Flaky Test: [It] should create desired Pods and Services: Distributed TFJob (4 workers, 2 PS) is succeeded
- MPIJob requires service names for the pods. HOT 3
- Add DeepSpeed Example with MPI Operator HOT 9
- chore(style): provide type for `STORAGE_INITIALIZER_VOLUME` constant
- fix(compatability): match-case syntax only compatible with Python3.10 HOT 5
- Export Fine-Tuned LLM after Trainer is Complete HOT 6
- Vulnerability - CVE-2023-44487 HOT 3
- Support ARM64 platform in PyTorch examples HOT 4
- Support ARM64 platform in TensorFlow examples HOT 4
- Support ARM64 platform in XGBoost examples HOT 2
- Update third party worflows in the gh actions HOT 4
- mpijob will stuck if LastReconcileTime is updated in 1 second
- Worker failed without exit code
- PyTorchJobClient not found HOT 3
- The actual default RestartPolicy of PyTorch is inconsistent with its description in the CRD HOT 1
- spatial dataset training functions HOT 1
- TfJob creation failed due to webhook validation failure HOT 1
- [GSOC] Tracking Issue: Integrate JAX in Kubeflow Training Operator
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from training-operator.