playingnumbers / ml_process_course

Public repo for the 365 Data Science ML Process Course

ML Process Course

This is the public repository for the ML Process Course. In this course, we take you through the end-to-end process of building a Machine Learning Model. We did not build this course ourselves. We stood on the shoulders of giants. We think its only fair to credit all the resources we used to build this course, as we could not have created this course without the help of the ML community.

Use the discount link for our 3 course bundle (limited time 68% off!) --> The Machine Learning A-Z Bundle

Flashcards

Please go to Ankiweb.net to download Anki and to sign up for account. Please go here to download the flashcards for this course.

Table of Contents

0. Coding Workbooks for Each Course
1. Data Science Blogs
2. Applying ML
3. Problem Framing
4. Data Collection
5. Data Preprocessing
6. Exploratory Data Analysis
7. Feature Engineering
8. Cross Validation
9. Feature Selection
10. Imbalanced Data
11. Modeling
12. Model Evaluation

Coding Workbooks for Each Course

Kaggle Workbook	Google Colab
5-Missing Values, 5-Outliers	5-Missing Values, 5-Outliers
6-EDA	6-EDA
7-Categoricals, 7-Continuous	7-Categoricals, 7-Continuous
8-Cross Validation	8-Cross Validation
9-Feature Selection	9-Feature Selection
10-Imbalanced Data	10-Imbalanced Data
11-Model Selection	11-Model Selection
12-Model Evaluation Classification, 12-Model Evaluation Regression	12-Model Evaluation Classification, 12-Model Evaluation Regression

Data Science Blogs

• AirBnB Engineering
• Spotify Research
• Netflix Research
• DoorDash ML Blog
• Uber Engineering
• Lyft Engineering
• Shopify Engineering
• Meta Engineering
• LinkedIn Engineering

2. Applying ML

• Analytics Hierarchy of Needs by Ryan Foley
• The First Rule of ML by Eugene Yan
• ML for Product Analytics by Ron Tidhar

3. Problem Framing

• Problem Understanding by Stratechi
• How to Define a Product Problem
• Intro to Opportunity Sizing

4. Data Collection

• Getting Data From a Database
• What is SQL - Video
• How Data Analysts Use SQL - Video
• Why Are APIs Important For Data Science - Video
• What is an API?
• How Companies Caputre Data
• How Cookies Work
• Web Scraping Basics
• Types of Survey Techniques
• 365 Data Science SQL Course

5. Data Preprocessing

• All You Need To Know About Different Types Of Missing Data Values And How To Handle It
• 7 Ways to Handle Missing Values in Machine Learning
• Null Values Imputation by Utkarsh Gupta
• What are methods to make a predictive model more robust to outliers?
• Guidelines for Removing and Handling Outliers in Data by Jim Frost

6. Exploratory Data Analysis

• 10 Types of Statistical Data Distribution Models
• What is EDA?
• Is Data Visualization Important for Data Science? - Video
• Box Plot Details
• Histogram Additional Details
• Types of Data Distributions
• Understanding Skew
• Scatterplots and Correlation Additional Details
• Types of Correlations
• Correlation Matrix Details
• Different correlation matrices in python
• Creating Pivot Tables Documentation
• When to use different types of charts

7. Feature Engineering

Categorical Feature Engineering

• All about Categorical Variable Encoding by Baijayanta Roy
• Ordinal and One-Hot Encodings for Categorical Data by Jason Brownlee
• Feature Engineering Ordinal Variables by Sheng Jun
• Target Encoding by Ryan Holbrook
• Weight of Evidence Coding by Bruce Lund

Continuous Feature Engineering

• About Feature Scaling and Normalization by Sebastian Raschka
• Feature Scaling Techniques in Python – A Complete Guide by Eddie_4072
• Feature Scaling for Machine Learning: Understanding the Difference Between Normalization vs. Standardization by Aniruddha Bhandari
• Robust Scaler - Sklearn Docs
• Log Transformation: Purpose and Interpretation by Kyaw Saw Htoon
• Best exponential transformation to linearize your data with Scipy
• Exponentially scaling your data in order to zoom in on small differences
• Box Cox Transformation by Ted Hessing
• Box-Cox Transformation and Target Variable: Explained

8. Cross Validation

• Understanding 8 types of Cross-Validation by Satyam Kumar
• 7 Types of Cross Validation by Soumyaa Rawat
• k-fold cross-validation explained in plain English by Rukshan Pramoditha
• Machine Learning Fundamentals: Bias and Variance by Josh Starmer/Statquest
• A Quick Intro to Leave-One-Out Cross-Validation (LOOCV) by Statology
• Time Series Cross Validation by Robert Hyndman
• Time Based Cross Validation
• KFold vs. Monte Carlo by Rebecca Patro

9. Feature Selection

• Everything You Need to Know About Feature Selection In Machine Learning by Kartik Menon
• A comprehensive guide to Feature Selection using Wrapper methods in Python
• What is the difference between filter, wrapper, and embedded methods for feature selection? by Sebastian Raschka
• Introduction to Feature Selection methods with an example (or how to select the right variables?)
• Feature selection in Python using the Filter method by Renu Khandelwal

10. Imbalanced Data

• 10 Techniques to deal with Imbalanced Classes in Machine Learning by Analytics Vidhya
• Oversampling and Undersampling by Kurtis Pykes
• Overcoming Class Imbalance using SMOTE Techniques
• SMOTE explained for noobs – Synthetic Minority Over-sampling TEchnique line by line by Rich Data
• SMOTE by Joos Korstanje
• 5 SMOTE Techniques for Oversampling your Imbalance Data by Cornellius Yudha Wijaya
• Fixing Imbalanced Datasets: An Introduction to ADASYN by Rui Nian

11. Modeling

Hyperparameter Tuning

• What does "baseline" mean in the context of machine learning?
• Sklearn's Dummy Estimators
• 7 Hyperparameter Optimization Techniques Every Data Scientist Should Know
• A Comprehensive Guide on Hyperparameter Tuning and its Techniques
• Hyperparameter tuning in Python by Tooba Jamal
• Random Search for Hyper-Parameter Optimization by James Bergestra and Yoshua Bengio
• A Conceptual Explanation of Bayesian Hyperparameter Optimization for Machine Learning by Will Koehrsen
• Bayesian Optimization Primer by SigOpt
• Genetic Algorithms by Marcos Del Cueto
• Simulated Annealing From Scratch in Python by Jason Brownlee
• Optimization Techniques — Simulated Annealing by Frank Liang
• Hyperparameter optimization for Neural Networks

Ensembling

• Ensemble Methods: Elegant Techniques to Produce Improved Machine Learning Results
• A Gentle Introduction to Ensemble Learning Algorithms by Jason Brownlee
• Types of Ensemble methods in Machine learning by Anju Tajbangshi
• Introduction to Ensembling/Stacking in Python by Anisotropic
• Ensembles and Model Stacking by Eshaan Kirpal

12. Model Evaluation

• Model Evaluation Metrics in Machine Learning by Nagesh Singh Chauhan
• 11 Important Model Evaluation Metrics for Machine Learning Everyone should know
• How To Interpret R-squared in Regression Analysis by Jim Frost
• Know The Best Evaluation Metrics for Your Regression Model by Raghav Agrawal
• Recall, Precision, F1, ROC, AUC, and everything by Ofir Shalev
• F1 Score vs ROC AUC vs Accuracy vs PR AUC: Which Evaluation Metric Should You Choose? by Jakub Czakon
• Intuition behind Log Loss Score by Gaurav Dembla
• Why is ROC AUC equivalent to the probability that two randomly-selected samples are correctly ranked?
• Man U Whitney Test
• Essential Things You Need to Know About F1-Score
• ROC, AUC, precision, and recall visually explained by Paul Vanderlaken
• R-squared Is Not Valid for Nonlinear Regression by Jim Frost
• 3 Best metrics to evaluate Regression Model? by Songhao Wu

12. Model Productionization

• Git For Data Scientists - Video
• Git Documentation
• Git Basics in 10 minutes
• 365 Data Science Git & Github Course
• Save and load ml models
• 5 Different Ways to Save your ML Model
• Improve analytics slide decks
• Streamlit Gallery
• Build 12 streamlit apps - Video
• Streamlit Project Example - Video
• Build an api in python - Video
• How to create an API in python
• How to create a python library

ml_process_course's Issues

Notebook Template for Any ML Problems

Hi Ken and Jeff,

Thank you for making this course!
Where is the Copy-Paste Notebook Template you mentioned in 3:04 at the end of the intro lesson?
https://learn.365datascience.com/courses/learn-machine-learning-process-a-z/introduction/

I can see the notebooks for each Module but I'm not seeing an aggregate notebook template for any ML problems.
All your notebooks on Github are separated by modules/lessons instead of a one big notebook template.

Thanks again for making this course!
Please let me know if I miss anything. Thank you!
@jeffmli @PlayingNumbers