trojrobert / mlops_roadmap_and_curriculum

Curriculum and roadmap from 0 to Mastery for MLOps. Adding value to your machine learning model by deploying it for people to use it to solve real life problems

A guide and roadmap from Zero to Hero for Machine Learning in Production / MLOps

The question many ask is "How do I start". I am documenting my journey and creating a roadmap/curriculum that can be used as a guide to learn MLOps. Since I learn more by doing, this journey is project-based.

Machine Learning in Production Guide and Roadmap Overview

Building a machine learning model with high accuracy and performance is good but we need to move beyond that. To add more value to our machine learning model, we need to deploy the machine learning or deep learning model to production to solve real-life problems. Automating the process of deploying a model to production is sometimes known as MLOps. MLOps is an emerging and complex field because it requires a lot of components and skills. This repo makes the learning of MLOps easy.

Overview

Lesson 1 - Introduction to Machine Learning Operations(MLOps)

Lesson 2 - Deploying machine learning model with docker on python web frameworks

Lesson 3 - Machine Learning Model tracking and deployment optimization

Lesson 4 - Model Serving and Loading

Lesson 5 - Deploying ML model on Mobile app

Lesson 6 - Deploying ML model on embedded system

Lesson 7 - Cloud providers and machine learning tools

Lesson 8 - Model Registry and Model Version Control

Lesson 9 - Managing Machine learning workflow

Lesson 10 - Model Optimization with Spark and Databrick

Lesson 11 - Managing Infrastructures for machine learning model

Lesson 12 - Feature Store

Lesson 13 - Kubenetes in Machine Learning

Lesson 14 - Model Testing

Lesson 15 - Model Retraining

Lesson 16 - AutoML

Lesson 17 - Distributed Machine learning with Ray

Lesson 1

Introduction to Machine Learning Operations(MLOps)

• Meaning and Importances of MLOps
• Difference between MLOps and other Ops like DevOps, DataOps, DevSecOps?
• Building user interface and deploying Machine Model with Gradio and Streamlit

Keywords

MLOps, Gradio, Streamlit

Resources

• Machine Learning Operations

• Why I Started ML in Production

• MLOps SIG Roadmap

• Awesome MLOps

• Differences: DevOps, ITOps, MLOps, DataOps, ModelOps, AIOps, SecOps, DevSecOps

Image classifier with Streamlit

Projects to build

Deploy an image classifier with Gradio and Streamlit - Link to the deployed image classifier

Write an article to compare Gradio and Streamlit - A guide for creating UI and deploying machine learning model with Streamlit vs Gradio

Project Resources

Gradio Resources

• Getting Started with Gradio

• Gradio documentation

• Building NLP Web Apps With Gradio And Hugging Face Transformers

Image classifier with Gradio

Streamlit resources

• Examples of projects with Streamlit

• Getting started with Streamlit

Other resources

How to Implement Customer Churn Prediction [Machine Learning Guide for Programmers]

Why data scientists shouldn’t need to know Kubernetes

Lesson 2 - Deploying machine learning model with python web frameworks

• Introduction to Python Web Frameworks
• Differences between Flask, Django, and FastAPI
• Introduction to Docker
• Deploying computer vision model with Flask and uWSGI on Digital Ocean

Keywords

Flask, uWGSGI, Django, FastAPI,Docker, Digital Ocean

Docker Resources

Docker Tutorial for Beginners - A Full DevOps Course on How to Run Applications in Containers

Docker Tutorial for Beginners [FULL COURSE in 3 Hours]

Fast API Resources

Using FastAPI to Build Python Web APIs

Fast API docs

Flask Resources

Introduction to Web development using Flask

Flask docs

Deploying a Python Flask Example Application Using Heroku

FastAPI vs. Django vs. Flask

Project to build

• Deploy ML model to generate artistic portrait drawing (APDDrawingGAN) with Flask + uWSGI on Digital Ocean

  • Front-end - Bootstrap

  • Web Framework - Flask + uWSGI

  • ML model - Pytorch + Fastai(APDrawingGAN)

  • Deployment - Docker

  • Cloud service - Digital ocean

• Build a web app with FastAPI, integrate a machine learning model for time series and deploy on Heroku (Optional)

Projects Resources

How to Deploy Machine Learning Models using Flask with Code!

ML Model Deployment With Flask On Heroku

Others

https://colab.research.google.com/github/fastai/fastbook/blob/master/02_production.ipynb#scrollTo=RuQMz_jqihsU

Lesson 3 - Machine Learning Model tracking with MLflow and deployment optimization

• Running multiple containers with docker compose(Advance docker)
• Introduction to Github Action
• Introduction to Model Tracking
• Tools used in model tracking( mlflow, WandB, etc)

Project

• Build a forecasting model with Fast API and track the model with mlflow

Lesson 4 - Model Serving and Loading

• What is Model Serving
• Saving model and loading model in production
• Model serving tools(Seldon, Tf serve, Pytorch serve, sage maker, ...)
• Creating endpoint for Machine Learning model

Lesson 5 - Deploying ML model on Mobile app

• Tools require to deploy machine learning model on Andriod
• Tools for machine learning on IOS

Lesson 6 - Deploying ML model on embedded system

• How to deploy Machine Learning model on raspberry pi

Lesson 7 - Cloud providers and machine learning tool

• Introduction to Amazon, Microsoft and Google machine learning platform
• Overview of Amazon Sagemaker
• Overview of Azure machine Learning Studio
• Overview of Google Cloud machine Learning platform

Lesson 8 - Model Registry and Model Version Control

• Why you need to version your models
• Model runs and experiments
• Managing multiple models
• Model Registry tools

Lesson 9 - Managing Machine learning workflow

• Example of machine learning workflow
• Using Airflow and Jenkins to monitor machine learning workflow

Lesson 10 - Model Optimization with Spark and Databrick

• Why you should not use Pandas in production
• Introduction to Pyspark
• Introduction to Databricks
• Distributing Data during model

Lesson 11 - Managing Infrastructures for machine learning model

• Infrastructure as code
• Introduction to Terraform
• Introduction to Ansible

Lesson 12 - Feature Store

• What is Feature store
• The importance of Feature store in machine learning
• Tools for Feature Store

Lesson 13 - Kubenetes in Machine Learning

• Introduction to Kubenetes
• Using Kubeflow

Lesson 14 - Model Testing

Lesson 15 - Model Retraining

Lesson 16 - AutoML

Lesson 17 - Distributed Machine learning with Ray

mlops_roadmap_and_curriculum's Issues

MLOps complete roadmap and course