Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FSDP (native) support for LightningLite #14967

Merged
merged 108 commits into from
Nov 21, 2022
Merged
Changes from 1 commit
Commits
Show all changes
108 commits
Select commit Hold shift + click to select a range
57774ed
wip
awaelchli Oct 1, 2022
043783e
wip precision
awaelchli Oct 1, 2022
0caf973
fsdp
awaelchli Oct 1, 2022
a2130b9
fsdp support in lite
awaelchli Oct 1, 2022
80d24fe
typing fixes
awaelchli Oct 1, 2022
cc65718
imports
awaelchli Oct 1, 2022
9d91f86
import fixes
awaelchli Oct 1, 2022
b535621
fix test
awaelchli Oct 1, 2022
8e85f69
more tests
awaelchli Oct 2, 2022
5385a19
integration tests
awaelchli Oct 2, 2022
de24f12
debug
awaelchli Oct 2, 2022
1d39715
Merge branch 'lite/fsdp-debug' into lite/fsdp
awaelchli Oct 2, 2022
9051a13
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 2, 2022
782bd0a
fix autowrap policy
awaelchli Oct 2, 2022
5f9d1a1
Merge remote-tracking branch 'origin/lite/fsdp' into lite/fsdp
awaelchli Oct 2, 2022
34251a2
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 2, 2022
c8eb2b1
debug
awaelchli Oct 2, 2022
27e0151
Merge remote-tracking branch 'origin/lite/fsdp' into lite/fsdp
awaelchli Oct 2, 2022
c9dd26e
debug
awaelchli Oct 2, 2022
4832c9e
simplify
awaelchli Oct 3, 2022
01e9b56
Merge branch 'master' into lite/fsdp
Borda Oct 5, 2022
70437da
support individual setup of model and optimizer
awaelchli Oct 19, 2022
50981a3
error messaging
awaelchli Oct 19, 2022
8e51e33
Merge branch 'master' into lite/fsdp-debug3
awaelchli Oct 19, 2022
c61a2b7
Merge branch 'lite/individual-setup' into lite/fsdp-debug3
awaelchli Oct 19, 2022
4eadd24
test
awaelchli Oct 19, 2022
dec4f9c
debug
awaelchli Oct 19, 2022
d5f1c9e
debug
awaelchli Oct 19, 2022
559187b
debug
awaelchli Oct 19, 2022
e286dd9
debug
awaelchli Oct 19, 2022
230dc03
Merge branch 'master' into lite/individual-setup
awaelchli Oct 20, 2022
b4613ec
wip
awaelchli Oct 20, 2022
281e26c
wip
awaelchli Oct 20, 2022
9d6971b
update structure
awaelchli Oct 20, 2022
20bc93b
tests
awaelchli Oct 21, 2022
7dc0aa5
error messages
awaelchli Oct 22, 2022
0190b50
test errors
awaelchli Oct 22, 2022
1e3e7b1
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 22, 2022
472b605
mypy
awaelchli Oct 22, 2022
b1fe35b
Merge branch 'lite/individual-setup' of github.com:Lightning-AI/light…
awaelchli Oct 22, 2022
3630d05
add changelog
awaelchli Oct 22, 2022
3509abe
Merge branch 'lite/individual-setup' into lite/fsdp-debug3
awaelchli Oct 23, 2022
8d035fa
messaging
awaelchli Oct 23, 2022
fadb2b6
debug
awaelchli Oct 23, 2022
39e7c09
debug
awaelchli Oct 23, 2022
7bc9421
fix
awaelchli Oct 23, 2022
9d086f2
udpate test
awaelchli Oct 23, 2022
ac29054
remove done todo
awaelchli Oct 23, 2022
5e1f433
missing err message
awaelchli Oct 23, 2022
a900207
tests
awaelchli Oct 23, 2022
a41eef9
flake
awaelchli Oct 23, 2022
38fbd24
Merge branch 'master' into lite/individual-setup
awaelchli Oct 23, 2022
9cd50b4
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 23, 2022
564ab17
docstrings
awaelchli Oct 23, 2022
11e7feb
Merge branch 'lite/individual-setup' of github.com:Lightning-AI/light…
awaelchli Oct 23, 2022
6afc0ae
doc fix
awaelchli Oct 23, 2022
8b999b1
support python < 3.10
awaelchli Oct 23, 2022
3036840
validation
awaelchli Oct 26, 2022
d02d71c
Merge branch 'lite/fsdp-debug3' into lite/fsdp
awaelchli Oct 26, 2022
f25674e
Merge branch 'lite/fsdp' into lite/fsdp-debug3
awaelchli Oct 26, 2022
4bb5d56
debug
awaelchli Oct 26, 2022
7f944cc
debug
awaelchli Oct 26, 2022
070b828
update
awaelchli Oct 26, 2022
a63b3c9
debug
awaelchli Oct 26, 2022
3e20de2
validate
awaelchli Oct 26, 2022
cf9b92f
revert
awaelchli Oct 26, 2022
2f54259
Merge branch 'lite/fsdp-debug3' into lite/fsdp
awaelchli Oct 26, 2022
47dae76
Merge branch 'lite/individual-setup' into lite/fsdp
awaelchli Oct 26, 2022
8601ad5
Merge branch 'master' into lite/individual-setup
awaelchli Oct 26, 2022
103096a
Merge branch 'lite/individual-setup' into lite/fsdp
awaelchli Oct 26, 2022
fc34be3
x
awaelchli Oct 26, 2022
3088273
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 26, 2022
d49ac0a
debug
awaelchli Oct 26, 2022
7bb7bb8
Merge remote-tracking branch 'origin/lite/fsdp' into lite/fsdp
awaelchli Oct 26, 2022
469cc2d
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 26, 2022
c138716
debug
awaelchli Oct 26, 2022
23aa1ba
Merge remote-tracking branch 'origin/lite/fsdp' into lite/fsdp
awaelchli Oct 26, 2022
c8f5a67
debug
awaelchli Oct 26, 2022
304bac0
simplify
awaelchli Oct 26, 2022
28e64b7
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Oct 26, 2022
ef7fb0e
typo
awaelchli Oct 26, 2022
7126b1e
Merge remote-tracking branch 'origin/lite/fsdp' into lite/fsdp
awaelchli Oct 26, 2022
f44c9b0
Merge branch 'master' into lite/fsdp
awaelchli Nov 11, 2022
9bf3531
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Nov 11, 2022
b96496f
Merge branch 'master' into lite/fsdp
awaelchli Nov 13, 2022
0750bfe
changelog
awaelchli Nov 13, 2022
b96e140
fix setup_module call
awaelchli Nov 13, 2022
2b3f618
fix
awaelchli Nov 13, 2022
a1eed5a
fix test
awaelchli Nov 13, 2022
612dc3d
update
awaelchli Nov 13, 2022
6b4fc35
Merge branch 'master' into lite/fsdp
awaelchli Nov 20, 2022
190c5d2
update
awaelchli Nov 20, 2022
3c67190
fix
awaelchli Nov 20, 2022
239a674
fix duplicate import
awaelchli Nov 20, 2022
ad770e6
add no_backward_sync for FSDP
awaelchli Nov 20, 2022
1c19b96
fix
awaelchli Nov 20, 2022
1d2fa56
fix literal import
awaelchli Nov 20, 2022
fac33ac
fix
awaelchli Nov 20, 2022
56f2109
manual wrap
awaelchli Nov 20, 2022
17bd714
avoid double wrap
awaelchli Nov 20, 2022
a97c56e
fix mypy
awaelchli Nov 20, 2022
fac22b4
revert original test
awaelchli Nov 20, 2022
ffaba94
skip import on torch <1.12
awaelchli Nov 20, 2022
133bb9c
torch compatibility
awaelchli Nov 20, 2022
07d4998
fix
awaelchli Nov 20, 2022
0ece17d
revert comments in pytorch tests
awaelchli Nov 21, 2022
6bb5ee6
Merge branch 'master' into lite/fsdp
awaelchli Nov 21, 2022
e47d3c8
fix copy-paste error in docstring
awaelchli Nov 21, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'master' into lite/fsdp
  • Loading branch information
awaelchli committed Nov 21, 2022

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
commit 6bb5ee698d10c420eb945637642b48509f89f7c6

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.