Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
-
Updated
Dec 26, 2023 - HTML
Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
Add a description, image, and links to the data-centric-machine-learning topic page so that developers can more easily learn about it.
To associate your repository with the data-centric-machine-learning topic, visit your repo's landing page and select "manage topics."