iamtonymwt / cs231n-2020-spring-assignment-solution

solution for CS231n 2020 spring assignment

CS231n-2020-spring-assignment-solution

TODO: All Finished

• Assignment #1 (Finished 2020/9/12)
• Assignment #2 (Finished 2020/9/27)
• Assignment #3 (Finished 2020/10/8)
• Notes 扫描全能王链接 （Chinese Only）
• HyperQuest (try it HERE)

---

HyperQuest

HyperQuest mimics the hyper parameter tuning app from Stanford University, CS231n. HyperQuest is a web-app designed for beginners in Machine Learning to easily get a proper intuition for choosing the right hyper parameters. This is initially an extremely daunting task because not having proper hyper parameters leads to the models breaking down.

Try HyperQuest HERE!

---

Interesting Examples

KNN

Visualize the distance matrix: each row is a single test example and its distances to training examples:

Explain:

As you can see above, the background of those images which is similar to many other images is black. Because there are many other images that have a black color on its margin, while the white part of those images is rarely seen in other images, which will cause a large difference, so will generate the white bar.

Find best k for kNN:

SVM v.s. Softmax

SVM

Softmax

It can be found that softmax is much smoother than SVM, which means it’s more generalized.

2-layer net with different dtype

With dtype np.single, visualize the weights of the first layer:

With dtype np.float64, visualize the weights of the first layer:

As you can see, there is no difference.

Style Transfer GIFs

By watching the first iteration we can find that there is no difference between starting with a random image or starting with the original image.