Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

experiments: support local parallel execution in temp directories #4257

Merged
merged 17 commits into from
Jul 29, 2020
Merged

experiments: support local parallel execution in temp directories #4257

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
bbca2e5
experiments: add initial local tmpdir executor
pmrowla Jul 21, 2020
703275c
fix detached head pull
pmrowla Jul 22, 2020
83a4bd0
experiments: include unchanged (unrepro'd) stages in experiment hash
pmrowla Jul 22, 2020
aa1e044
experiments: repro single experiment using tmpdir executor by default
pmrowla Jul 22, 2020
48b74e0
stage experiments as stash commits before running
pmrowla Jul 23, 2020
7a53923
include repro args/kwargs in stashed experiments
pmrowla Jul 24, 2020
41b53b4
support running arbitrary experiment commits (including stash commits)
pmrowla Jul 24, 2020
2571204
experiments: use ProcessPoolExecutor
pmrowla Jul 28, 2020
3569bf7
experiments: add `dvc exp` alias for `dvc experiments`
pmrowla Jul 28, 2020
9abb0a0
experiments: add `dvc repro --experiment --queue`
pmrowla Jul 28, 2020
0f3b7d3
experiments: show queued (unexecuted) experiments in `dvc exp show`
pmrowla Jul 28, 2020
9214934
revert ProcessPoolExecutor change
pmrowla Jul 28, 2020
4916263
experiments: add `dvc repro --run-all [--jobs]`
pmrowla Jul 28, 2020
ccaa098
cleanup output
pmrowla Jul 28, 2020
bdf6356
experiments: use ProcessPoolExecutor
pmrowla Jul 28, 2020
2fc3b4a
update tests
pmrowla Jul 28, 2020
66df566
fix windows cleanup issue
pmrowla Jul 29, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 8 additions & 2 deletions dvc/command/experiments.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,10 @@ def _round(val):
return val

def _extend(row, names, items):
if not items:
row.extend(["-"] * len(names))
return

for fname, item in items:
if isinstance(item, dict):
item = flatten(item, ".")
Expand All @@ -62,13 +66,14 @@ def _extend(row, names, items):
for i, (rev, exp) in enumerate(experiments.items()):
row = []
style = None
queued = "*" if exp.get("queued", False) else ""
if rev == "baseline":
row.append(f"{base_rev}")
style = "bold"
elif i < len(experiments) - 1:
row.append(f"├── {rev[:7]}")
row.append(f"├── {queued}{rev[:7]}")
else:
row.append(f"└── {rev[:7]}")
row.append(f"└── {queued}{rev[:7]}")

_extend(row, metric_names, exp.get("metrics", {}).items())
_extend(row, param_names, exp.get("params", {}).items())
Expand Down Expand Up @@ -229,6 +234,7 @@ def add_parser(subparsers, parent_parser):
experiments_parser = subparsers.add_parser(
"experiments",
parents=[parent_parser],
aliases=["exp"],
description=append_doc_link(EXPERIMENTS_HELP, "experiments"),
formatter_class=argparse.RawDescriptionHelpFormatter,
)
Expand Down
15 changes: 15 additions & 0 deletions dvc/command/repro.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,9 @@ def run(self):
recursive=self.args.recursive,
force_downstream=self.args.force_downstream,
experiment=self.args.experiment,
queue=self.args.queue,
run_all=self.args.run_all,
jobs=self.args.jobs,
)

if len(stages) == 0:
Expand Down Expand Up @@ -174,4 +177,16 @@ def add_parser(subparsers, parent_parser):
default=False,
help=argparse.SUPPRESS,
)
repro_parser.add_argument(
"--queue", action="store_true", default=False, help=argparse.SUPPRESS
)
repro_parser.add_argument(
"--run-all",
action="store_true",
default=False,
help=argparse.SUPPRESS,
)
repro_parser.add_argument(
"-j", "--jobs", type=int, help=argparse.SUPPRESS, metavar="<number>"
)
repro_parser.set_defaults(func=CmdRepro)
Loading