A pedagogical attempt at auto-differentiation. This is based on the autograd package and other variations of it as well as literature references (eg: The Art of Differentiating Computer Programs, An Introduction to Algorithmic Differentiation – Uwe Naumann).
- forward mode
- reverse mode
- a composition thereof for higher-order derivatives.
- Multidimension support, possibly with help of ndarray crate
- Add support for Ricci calculus notation for symbolic manipulation (reference: Computing Higher Order Derivatives of Matrix and Tensor Expressions by Laue et al.)
- More ops and tests (see src/core.rs)