parvvaresh / ml-algorithms-from-scratch

Here we have fully implemented a number of algorithms related to machine learning

1. Regression:

• Linear Regression
• Ridge Regression
• Lasso Regression
• ElasticNet Regression
• Decision Tree Regression
• Random Forest Regression
• Support Vector Regression (SVR)
• Bayesian Regression
• KNN Regression
• Weight KNN Regression

2. Clustering:

• K-Means
• Hierarchical Clustering
• DBSCAN
• Mean Shift Clustering

3. Classification:

• KNN (with 2 distance metric) ✓
  • uniform KNN ✓
  • distance Weight KNN ✓
• Tree
  • Decision Tree ✓
  • Random Forest
• Regression :
  • Logistic Regression
  • Ridge Regression
  • Lasso Regression
  • ElasticNet Regression
• Bayesian
  • Gaussian ✓
  • Multinomial ✓
• Minimum Distance Classifier ✓
• Support Vector Machine (SVM)
• Perceptron ✓
• simple MLP

3. Dimensionality Reduction:

• Principal Component Analysis (PCA)
• Linear Discriminant Analysis (LDA)

added soon