-
-
Notifications
You must be signed in to change notification settings - Fork 310
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow aggregate jobs to be created from a list of job names #715
Comments
…name NixOS/hydra#715 (cherry picked from commit 2de3caf)
NixOS/hydra#715 (cherry picked from commit 8950429)
Well, we do have evaluation now, but the EDIT: logs in the web UI show nothing, so I can't see how to push this forward myself. |
Looks like we're generating a bad derivation ( |
Fixed in NixOS/nix@edee616. |
This requires explicitly identifying the things tht don't work and removing them. I used our own `disabled` attribute, because `broken` is weird and breaks evaluation, which isn't really what we want. Cuts the number of jobs from over 2000 to 216. This seems to greatly speeds up the time it takes small changes (where most stuff remains the same) to be processed by hydra. Uses NixOS/hydra#715 to reference the jobs in required by name avoiding OOM issues. Co-authored-by: Hamish Mackenzie <[email protected]>
This requires explicitly identifying the things tht don't work and removing them. I used our own `disabled` attribute, because `broken` is weird and breaks evaluation, which isn't really what we want. Cuts the number of jobs from over 2000 to 216. This seems to greatly speeds up the time it takes small changes (where most stuff remains the same) to be processed by hydra. Uses NixOS/hydra#715 to reference the jobs in required by name avoiding OOM issues. Co-authored-by: Hamish Mackenzie <[email protected]>
Evaluating an aggregate job takes as much memory as the sum of its constituents - no constituent expression can be garbage-collected while the top-level expression is reachable. For example, the
tested
job in NixOS'srelease-combined.nix
takes > 12 GB.As an alternative, we could support aggregates to be specified as a list of job names, e.g.
hydra-eval-jobset
can then lookup the constituent's in the JSON output ofhydra-eval-jobs
and create a derivation that depends on thedrvPaths
of the constituents.The text was updated successfully, but these errors were encountered: