Comments (8)
Do we need a system design doc for App Seeding module?
from autonomous-driving-data-framework.
@a13zen Do you mean the creation of a sample pipeline that can deploy ADDF from a defined manifest file with AWS native tooling such as AWS CodeCommit, AWS CodePipeline and AWS CodeBuild? If yes, the concept is ready. It's a matter of prioritization.
from autonomous-driving-data-framework.
The idea of this is to have a simplified "workbench" like module that allows deploying custom applications that have their own lifecycle separate from the core ADDF one, but still able to interface. For example, a team developing custom monte-carlo simulation containers.
We can create an ADDF module that would deploy a very simple service catalog product template that contains a CodeCommit Repository, CodePipeline + CodeBuild hooked into the repository (CDKPipelines candidate). Use cases can spin up a new service catalog product that provisions these resources and they can then develop their application in their own lifecycle. Applications that are common and should form a baseline e.g. if the team developed a pipeline to also build and push images to ECR, it can be brought back into the template as seed code so the next use case/team can start from that point onwards.
This gives users 2 powerful things:
- A way to deploy Service Catalog Products via ADDF
- A way to develop reusable app templates for different "plug in" use cases
from autonomous-driving-data-framework.
The idea of this is to have a simplified "workbench" like module that allows deploying custom applications that have their own lifecycle separate from the core ADDF one, but still able to interface. For example, a team developing custom monte-carlo simulation containers.
We can create an ADDF module that would deploy a very simple service catalog product template that contains a CodeCommit Repository, CodePipeline + CodeBuild hooked into the repository (CDKPipelines candidate). Use cases can spin up a new service catalog product that provisions these resources and they can then develop their application in their own lifecycle. Applications that are common and should form a baseline e.g. if the team developed a pipeline to also build and push images to ECR, it can be brought back into the template as seed code so the next use case/team can start from that point onwards.
This gives users 2 powerful things:
1. A way to deploy Service Catalog Products via ADDF 2. A way to develop reusable app templates for different "plug in" use cases
That means we load module code from a third party source. This could be Service Catalog , this could be anything else.
Theoretically, we can already do that right now by building a deployspec that does exactly that with native AWS API calls.
Or do you want to abstract that away in the manifest files?
Example for service catalog:
name: servicecatalog-dynamodb
type: servicecatalog
productid: "prod-12lscsnkyha34"
parameters:
- name: table-name-admin
value: admin
from autonomous-driving-data-framework.
The template seed code can be from a third party source. The module only creates the service catalog product and wires together the initial configuration for the application developers to start working from. The idea is we can create templates that encapsulate multiple complex components together that can be deployed in a self service manner.
This is the same concept/model used by SageMaker Project Templates, and indeed the same ADDF module can create custom SageMaker Project Templates too (since they are just service catalog products with special tags).
from autonomous-driving-data-framework.
@a13zen and @AndyEfaa Is this still relevant?
from autonomous-driving-data-framework.
@AndyEfaa @a13zen Has this changed?
from autonomous-driving-data-framework.
The sagemaker project mlops module implements this solution
from autonomous-driving-data-framework.
Related Issues (20)
- [BUG] rosbag-webviz deploying issue HOT 2
- [WEB-APP] Deploy Sketch Wireframes on AWS
- [Q1 2023] Example Terraform module HOT 1
- Example Terraform prereqs module HOT 1
- [BUG]rosbag scene detection no longer deploys HOT 1
- [FEATURE]Tests coverage for ADDF
- [FEATURE]Update the example manifests to use the `git` path
- [FEATURE]ADDF 2.0 release HOT 1
- [FEATURE]Improve example tf module
- [BUG] - DDB-to-Opensearch Readme missing a parameter HOT 1
- [BUG] OpenSearch ProxyUsing IDMSv1 HOT 2
- [BUG] HOT 3
- [FEATURE]Refactor Rosbag Image pipeline w/ scene detection
- [FEATURE] CloudWatch Alarm - SNS - Email
- [BUG] OpenSearch Domain does not have module name embedded in name HOT 1
- [BUG] Update aws-emr-launch library to newer version
- [BUG] Replace EMR-Launch from stack HOT 1
- [BUG] Misleading word in Module Manifest section HOT 2
- [BUG] Update CDK versions in older modules
- [BUG] Checks Workflow to support nested directories HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from autonomous-driving-data-framework.