Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Wandb] Refine wandb logging function #416

Merged
merged 5 commits into from
Jul 16, 2024
Merged

Conversation

billishyahao
Copy link

This patch aims to enable wandb initilization and make it more unified with old tensorboard code style.
With this patch enabled, we can log and visilize our training procedure on wandb panel.
Here is the example figure

Screenshot 2024-07-09 110418
Screenshot 2024-07-09 110505

@billishyahao
Copy link
Author

@microsoft-github-policy-service agree company="Intel"

megatron/timers.py Outdated Show resolved Hide resolved
megatron/training.py Outdated Show resolved Hide resolved
megatron/training.py Outdated Show resolved Hide resolved
@billishyahao billishyahao requested a review from tjruwase July 16, 2024 06:29
@tjruwase tjruwase merged commit 73029ed into microsoft:main Jul 16, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants