G1) Conv2D, Fully-Connected layers - FP32 and FP16
G2) DepthWise Convolution, PointWise Convolution (no stride, padding, biases) - FP32 and FP16
G3) Max and Average Pooling
G4) ReLU activation
G5) Gradient Descent Optimizer
G6) MSELoss and CrossEntropyLoss
G7) Multi-Head Self Attention (FP32, FP16) and RNN (FP32) with enhanced
Check README.md for more details.