Implement _compute_intra_grad_corr_mean for gradient computation#1095

Merged

min-xu-ai merged 13 commits intofacebookresearch:mainfrom cyugao:main

Dec 5, 2022

+137-11

Commits on Oct 4, 2022

Fix gradient accumulation
cyugao
committed

Commits on Oct 5, 2022

Add a method to scale grad for grad_accum using unscaled loss
cyugao
committed

Commits on Oct 7, 2022

Merge branch 'facebookresearch:main' into main
cyugao
authored

Commits on Nov 18, 2022

Merge branch 'facebookresearch:main' into main
cyugao
authored

Commits on Nov 22, 2022

Implement _compute_corr_mean_between_grads
cyugao
committed

Commits on Dec 1, 2022

Improve tests and comments
cyugao
committed

Commits on Dec 2, 2022

Commits on Dec 3, 2022

Update PyTorch versions
cyugao
committed

Commits on Dec 5, 2022