An Analytical Formula of Population Gradient for two-layered ReLU network and its Applications in Convergence and Critical Point Analysis
Yuandong Tian
ICML, 2017
Simply run python convergence.py to check the convergence with population gradient.
fig_L.py and fig_verify.py can be used to regenerate the figures in the paper.
Python, Matplotlib
MIT