Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[microsoft/Megatron-DeepSpeed sync] Commits including 2021-09-18 #109

Merged
merged 1 commit into from
Sep 20, 2021
Merged

[microsoft/Megatron-DeepSpeed sync] Commits including 2021-09-18 #109

merged 1 commit into from
Sep 20, 2021

Conversation

stas00
Copy link
Contributor

@stas00 stas00 commented Sep 20, 2021

This PR catches on 1 commit:

git remote add other https://github.com/microsoft/Megatron-DeepSpeed
git fetch other
git cherry-pick 1a74a0513441cf4
git push

New checkpoint is microsoft/Megatron-DeepSpeed@1a74a0513441cf4

@tjruwase @stas00
Checkpoint conversion tools (#14)
4b259b2 
* Checkpoint conversion tools

* Fix formatting

* 1) Provide args in converted checkpoint
2) Reshape TP and PP degrees

* Fix typo

* Fix link

* Tweak tag

* Fix converted TP and PP sizes

* For release mode

* Update README

* Nested embedding dicts
Iteration folder
latest checkpoint version file
@stas00 stas00 merged commit bc9c951 into main Sep 20, 2021
@stas00 stas00 deleted the sync5 branch September 20, 2021 18:57
ofirpress pushed a commit to ofirpress/Megatron-DeepSpeed that referenced this pull request Sep 23, 2021
@stas00 @tjruwase
Checkpoint conversion tools (bigscience-workshop#14) (bigscience-work…
8599444 
…shop#109)

* Checkpoint conversion tools

* Fix formatting

* 1) Provide args in converted checkpoint
2) Reshape TP and PP degrees

* Fix typo

* Fix link

* Tweak tag

* Fix converted TP and PP sizes

* For release mode

* Update README

* Nested embedding dicts
Iteration folder
latest checkpoint version file

Co-authored-by: Olatunji Ruwase <[email protected]>
SaulLu added a commit to SaulLu/Megatron-DeepSpeed that referenced this pull request Sep 24, 2021
@SaulLu
Revert "Checkpoint conversion tools (bigscience-workshop#14) (bigscie…
2a02263 
…nce-workshop#109)"

This reverts commit 8599444.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@stas00 @tjruwase