Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

save validation loss history in a csv #3

Open
msrepo opened this issue Sep 13, 2021 · 0 comments
Open

save validation loss history in a csv #3

msrepo opened this issue Sep 13, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@msrepo
Copy link
Collaborator

msrepo commented Sep 13, 2021

Is your feature request related to a problem? Please describe.
train.py has records of validation loss history. We need to persist this history in to a file.

Describe the solution you'd like
save both training loss and validation loss every epoch. Saving training loss helps find if we are overfitting/underfitting.

Describe alternatives you've considered
we have manually kept a list of metrics each epoch. we could just save it into csv. Also, need to be careful we write the csv every epoch in case the training gets terminated externally in which case the script wont run till the end.

Additional context
high level frameworks like keras and pytorch-lightning have csvlogger that attaches to a trainer. MONAI has MetricLogger that logs but does not save to a csv. MONAI MetricsSaver is may be what we need.

@msrepo msrepo added the enhancement New feature or request label Sep 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant