Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow users to track plots for Experiment Tracking #1296

Closed
merelcht opened this issue Feb 28, 2022 · 1 comment
Closed

Allow users to track plots for Experiment Tracking #1296

merelcht opened this issue Feb 28, 2022 · 1 comment
Labels
Component: Experiment Tracking 🧪 Issue/PR that addresses functionality related to experiment tracking Stage: Technical Design 🎨 Ticket needs to undergo technical design before implementation

Comments

@merelcht
Copy link
Member

merelcht commented Feb 28, 2022

Description

Both in design research and a recent demo we've received feedback from users that they'd like to be able to log plots and see them as part of their experiments.

“Is there a plan for storing plots? Something we often like to see with metrics is a SHAP plot to see what relationship is learned."

@AntonyMilneQB says:

I spoke to Lim about this a long time ago and made some notes on his thoughts. He thinks we should have a dataset called something like tracking.ArtifactDataSet which is basically for everything that's not a metric or json. kedro-viz would then work out how to render the dataset dependent on the file type (e.g. png).
I (Antony) am not sure how this fits in with our existing matplotlib and plotly datasets. Especially because plotly dataset saves to json, how would kedro-viz know to render that as a plot? Do we need another type tracking.PlotlyDataSet to handle this case?

@merelcht merelcht added Stage: Technical Design 🎨 Ticket needs to undergo technical design before implementation Issue: Sprint Activity labels Feb 28, 2022
lorenabalan pushed a commit that referenced this issue Feb 28, 2022
[AUTO-MERGE] Merge master into develop via merge-master-to-develop
@merelcht merelcht added this to the 0.18+ milestone Mar 7, 2022
@merelcht merelcht added the Component: Experiment Tracking 🧪 Issue/PR that addresses functionality related to experiment tracking label Mar 15, 2022
@merelcht merelcht removed this from the 0.18+ milestone May 9, 2022
@yetudada
Copy link
Contributor

Closed in favour of #1626

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Component: Experiment Tracking 🧪 Issue/PR that addresses functionality related to experiment tracking Stage: Technical Design 🎨 Ticket needs to undergo technical design before implementation
Projects
None yet
Development

No branches or pull requests

2 participants