Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add DeepSpeedZeroConfig __repr__ method #596

Merged
merged 2 commits into from
Dec 11, 2020

Conversation

stas00
Copy link
Collaborator

@stas00 stas00 commented Dec 11, 2020

DeepSpeedZeroConfig object isn't being shown during startup

before:

[2020-12-10 21:24:11,820] [INFO] [config.py:648:print]   zero_config .................. 
<deepspeed.runtime.zero.config.DeepSpeedZeroConfig object at 0x7f32d4c0dbb0>

after this PR:

[2020-12-10 21:59:46,612] [INFO] [config.py:648:print]   zero_config .................. {
    "allgather_bucket_size": 500000000,
    "allgather_partitions": true,
    "contiguous_gradients": false,
    "cpu_offload": false,
    "elastic_checkpoint": true,
    "load_from_fp32_weights": true,
    "overlap_comm": false,
    "reduce_bucket_size": 500000000,
    "reduce_scatter": true,
    "stage": 0
}

Also I'm not sure about other files, but this file is in DOS format (\r\n/^M line ending)... is this by design?

@jeffra jeffra merged commit 66268bd into microsoft:master Dec 11, 2020
@stas00 stas00 deleted the zero_config_repr branch December 11, 2020 20:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants