stjordanis / gradientdescent_implementation

Implement different variants of gradient descent in python using numpy

Gradient Descent Implementation

This repository contains the code to implement gradient descent in python using Numpy

Repository Structure

• GDAlgorithms: Contains code to implementing various gradient descent algorithum in sigmoid neuron.
• VectorisedGDAlgorithms: Contains code to implementing different gradient descent algorithums in feed forward neural network

Jump into code

• Different Types of Gradient Descent Optimizers in Sigmoid Neuron

  

• Different Types of Gradient Descent Optimizers in Feedforward Neural network
  

Visualization

• Visualizing the Gradient Descent learning algorithum

• Animation of Gradient Descent