Lab Notebook: OptimizationRelatedMisc.ipynb
References:
- Berkeley Deep Learning::
- Neural Network Optimization (Backprop review, Adam, BatchNorm, Dropout, Skip connections)
- Advanced CV Architectures (AlexNet + ResNet)
- Interactive Visualization of Optimization Algorithms in Deep Learning