Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support the MLFlfow data tracking in MONAI #6612

Closed
binliunls opened this issue Jun 13, 2023 · 0 comments · Fixed by #6616
Closed

Support the MLFlfow data tracking in MONAI #6612

binliunls opened this issue Jun 13, 2023 · 0 comments · Fixed by #6616
Assignees
@binliunls

Comments

@binliunls
Copy link
Contributor

Is your feature request related to a problem? Please describe.
The experiment management tool MLFlow released version 2.4.0 last week, which introduced data tracking APIs. With these APIs, users can record some info about the dataset used during training, inference and evalution. This is a very useful feature to reproduce experiments using different subsets of the original dataset. And it would be better if MONAI can also support these APIs in the experiment management part.

Describe the solution you'd like
Add the data tracking APIs to the MLFlowHandler API.

Additional context
Please note these warnings:

  1. Most data tracking APIs are experimental and may change in the future.
  2. The API web page doesn't show any support for PyTorch dataset.
@binliunls binliunls self-assigned this Jun 13, 2023
@binliunls binliunls mentioned this issue Jun 14, 2023
Merged
7 tasks
wyli pushed a commit that referenced this issue Jul 19, 2023
@binliunls
6612-support-mlflow-data-tracking (#6616)
3247db0 
Fixes #6612  .

### Description
Add the dataset tracking support to MLFlow handler.

### Types of changes
<!--- Put an `x` in all the boxes that apply, and remove the not
applicable items -->
- [x] Non-breaking change (fix or new feature that would not break
existing functionality).
- [ ] Breaking change (fix or new feature that would cause existing
functionality to change).
- [ ] New tests added to cover the changes.
- [ ] Integration tests passed locally by running `./runtests.sh -f -u
--net --coverage`.
- [ ] Quick tests passed locally by running `./runtests.sh --quick
--unittests --disttests`.
- [ ] In-line docstrings updated.
- [ ] Documentation updated, tested `make html` command in the `docs/`
folder.

---------

Signed-off-by: binliu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@binliunls binliunls

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

6612-support-mlflow-data-tracking binliunls/MONAI
1 participant
@binliunls