fotinosk / mlops-modules

MLOps modules is a collection of reusable Infrastructure as Code (IaC) modules for MLOps on AWS

MLOps Modules

MLOps modules is a collection of resuable Infrastructure as Code (IAC) modules that works with SeedFarmer CLI. Please see the DOCS for all things seed-farmer.

The modules in this repository are decoupled from each other and can be aggregated together using GitOps (manifest file) principles provided by seedfarmer and achieve the desired use cases. It removes the undifferentiated heavy lifting for an end user by providing hardended modules and enables them to focus on building business on top of them.

General Information

The modules in this repository are / must be generic for reuse without affiliation to any one particular project in Machine Learning Operations domain.

All modules in this repository adhere to the module structure defined in the the SeedFarmer Guide

• Project Structure
• Module Development
• Module Manifest Guide

Modules

SageMaker Modules

Type	Description
SageMaker Studio Module	Provisions secure SageMaker Studio Domain environment, creates example User Profiles for Data Scientist and Lead Data Scientist linked to IAM Roles, and adds lifecycle config
SageMaker Endpoint Module	Creates SageMaker real-time inference endpoint for the specified model package or latest approved model from the model package group
SageMaker Project Templates Module	Provisions SageMaker Project Templates for an organization. The templates are available using SageMaker Studio Classic or Service Catalog
SageMaker Notebook Instance Module	Creates secure SageMaker Notebook Instance for the Data Scientist, clones the source code to the workspace

Mlflow Modules

Type	Description
Mlflow Image Module	Creates Mlflow Docker container image and pushes the image to Elastic Container Registry
Mlflow on AWS Fargate Module	Runs Mlflow container on AWS Fargate in a load-balanced Elastic Container Service. Supports Elastic File System and Relational Database Store for metadata persistence, and S3 for artifact store

FMOps Modules

Type	Description
SageMaker JumpStart Foundation Model Endpoint Module	Creates an endpoint for a SageMaker JumpStart Foundation Model.

Industry Data Framework (IDF) Modules

The modules in this repository are compatible with Industry Data Framework (IDF) Modules and can be used together within the same deployment. Refer to examples/manifests for examples.