exp show: show names for the queued experiments

[aguschin]

It would be great to see the name of a queued experiment. Right now if we run, for example

dvc exp run --queue -S model.cnn.dropout=0.25 -n named-one

the table below won't show it's name right away:

only after we run it with dvc exp run --run-all:

We could live fine without names, but if for example we want to review multiple queued experiments with dvc exp show and look for what we forgot to add to the queue, it would be helpful to see them.

Another use case which is not supported now, AFAK, is to remove queued experiments. If I added few experiments, I may want to remove one of them before running them all. Right now I need to reset all queued experiments with dvc exp remove --queue and add required ones again. This removal would be convenient to do if we could reference the queued experiments by their names. If it seems like a valid use case and dvc has no such feature, I can create a feature request.

[dberenbaum]

#5965 also has some loosely related discussion about whether the final exp name should be shown in the queue from the beginning. @pmrowla what do you think? Not sure how important this is or how difficult to implement, but it does seems like it's a strict improvement on current behavior.

[pmrowla]

If the user is specifying a name with -n/--name we can display it for queued experiments.

When it comes to the current autogenerated names we cannot generate them for queued experiments, as they are derived from the resulting pipeline after reproduction. So displaying autogenerated names for queued experiments will require changing how we autogenerate names.

Regarding removing queue experiments, that will happen eventually along with proper queue management in general (#5615)

---

Regarding priority, I don't think it's worth it to put much time into how exp show handles queued experiments right now, since eventually exp queue will likely have it's own UI entirely.

[jorgeorpinel]

If the user is specifying a name with -n/--name we can display it for queued experiments.

👍

[dberenbaum]

Another use case which is not supported now, AFAK, is to remove queued experiments. If I added few experiments, I may want to remove one of them before running them all. Right now I need to reset all queued experiments with dvc exp remove --queue and add required ones again. This removal would be convenient to do if we could reference the queued experiments by their names. If it seems like a valid use case and dvc has no such feature, I can create a feature request.

@aguschin This part got lost in the discussion, but see #6157.

@pmrowla I think it would be helpful to add this to the loose ends to clean up for experiments. It's not clear if or when we will have a separate exp queue command, or whether that will address this problem since the queue might still also show in exp show. How much work do you think it is to show named experiments in the queue?

[pmrowla]

@pmrowla How much work do you think it is to show named experiments in the queue?

@dberenbaum this is pretty much just a one liner UI change. We already have names for queued experiments internally, we just don't show them in the UI right now.