Foundations --> Neural Network about made-with-ml

[GokuMohandas]

1. Good catch!
2. fixed
3. yes I remember reading a long time ago that pytorch layers are initialized using different methods depending on the layer type. You can of course override with any initialization method that you want to use.
4. I've edited it to say, I'll clarify more during next version: "So far we have been initializing weights with small random values but this isn't optimal for convergence during training. The objective is to initialize the appropriate weights such that our activations (outputs of layers) don't vanish (too small) or explode (too large), as either of these situations will hinder convergence. We can do this by sampling the weights uniformly from a bound distribution (many that take into account the precise activation function used) such that all activations have unit variance."
5. nice catch!