lilipads / gradient_descent_viz Goto Github PK

I didn't see one in the repo. I'd recommend MIT or Unlicense if you're down!

@lilipads Thanks for sharing the interesting work. I am a researcher from the Robotics field with a special focus on state estimation. Do you have any idea that how can we visualize the shape of the optimization when the size of the state to be optimized is more than 3 dimensions?

Thanks a lot in advance,

Best,
Weisong,

如题，您好，请问是镜像问题还是我下载的问题？可否更新一下镜像？谢谢。Nice work。

Cannot run the .exe file on Windows 10 due to error:

The code execution cannot proceed because libgcc_s_seh-1.dll was not found. Reinstalling the program may fix this problem.

Reinstalling the program did not fix the problem.

good works !

some enhance you can reference:
surface visualization like https://github.com/tomgoldstein/loss-landscape

training loss animation visualization
https://github.com/joshuagruenstein/atlas
https://github.com/spencer-hann/Loss_Surface_Visualizer
https://www.deeplearning.ai/ai-notes/optimization

Hi,
Sry I'm new to this website and i don't know if that's the right section to post in for this, but i have a presentation for my first year in master of mathematics, and i wanted to ask for permission to show images/videos of this tool during a presentation on gradient descent methods.
Thank you for helping me understand these better anyway,
Cordially,
Guillaume Bauman.

Fail to run windows version app with error:

"Can not find libgcc_s_seh-1.dll"

double GradientDescent::f(double x, double z){
    switch (function_name){
    case Function::local_minimum:{
        z *= 1.4;
        return -2 * exp(-((x - 1) * (x - 1) + z * z) / .2) -
                6. * exp(-((x + 1) * (x + 1) + z * z) / .2) +
                x * x + z * z;
    }
    case Function::global_minimum:{
        return x * x + z * z;
    }
    case Function::saddle_point:{
        return sin(x) + z * z;
    }
    case Function::ecliptic_bowl:{
        x /= 2.;
        z /= 2.;
        return -exp(-(x * x + 5 * z * z)) + x * x + 0.5 * z * z;
    }
    case Function::hills:{
        z *= 1.4;
        return  2 * exp(-((x - 1) * (x - 1) + z * z) / .2) +
                6. * exp(-((x + 1) * (x + 1) + z * z) / .2) -
                2 * exp(-((x - 1) * (x  - 1) + (z + 1) * (z + 1)) / .2) +
                x * x + z * z;
    }
    case Function::plateau:{
        x *= 10;
        z *= 10;
        double r = sqrt(z * z + x * x) + 0.01;
        return -sin(r) / r + 0.01 * r * r;
    }
    }
    return 0.;
}

sometimes z will be multiplied by 1.4, why?

Edit: fixed

Just wonder if someone went through these issues

1. I´ve installed libgcc_s_seh-1.dll
2. I´ve installed libwinpthread-1.dll
   Error message after start exe file: Cant´t initialize correctly

I´m running on Windows 10 Single Home, 64 bits

How to change the surface function? I want to use my own objective function to generate animation. Thanks. Nice work!