Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add experiment management release note #5736

Binary file added docs/images/experiment_management.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
9 changes: 9 additions & 0 deletions docs/source/whatsnew_1_1.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# What's new in 1.1 🎉🎉

- Experiment Management for MONAI bundle


## Experiment Management for MONAI bundle
![experiment_management](../images/experiment_management.png)

In this release, we support the experiment management for MONAI bundle. It can help to track the experiment process so that users can easily reproduce experiments that have been done before and can easily retrace the information like hyper parameters and metrics of previous experiments. The default experiment management tool is [MLFLow](https://mlflow.org/docs/latest/tracking.html). Users can enable the MLFlow tracking by simply adding the `--tracking "mlflow"` option in the end of training or inference command lines. By default, MLFlow will record executed bundle config, metrics, parameters, starting time and code version of the running experiment. For more details about it, please refer to this [tutorial](https://github.com/Project-MONAI/tutorials/blob/main/experiment_management/bundle_integrate_mlflow.ipynb). In addition, users can also add support for other experiment management tools by adding a handler referring to [MLFlowHandler](https://docs.monai.io/en/stable/handlers.html#mlflow-handler) and the default settings referring to the `DEFAULT_MLFLOW_SETTINGS`.