I implemented the micro grad following Andrej Karpathy's The spelled-out intro to neural networks and backpropagation: building micrograd
I am planning to add few things, after understanding the inner workings:
- dropout
- [] Convolution
- [] Stride
- [] GRU
- [] LSTM
Thanks to Andrej Karpathy!