Natural Gradients

Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (also second order method in general). The problems used are the simplest possible (e.g. toy classification problem and MNIST), to highlight more on the algorithms themshelves.

Dependencies

1. Python 3.5+
2. Numpy
3. Matplotlib