Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Building all images exceeds "Standard" GitHub-hosted runners disk space #1451

Closed
atc0005 opened this issue Mar 23, 2024 · 0 comments · Fixed by #1453
Closed

Building all images exceeds "Standard" GitHub-hosted runners disk space #1451

atc0005 opened this issue Mar 23, 2024 · 0 comments · Fixed by #1453
Assignees
@atc0005
Labels
bug Something isn't working CI Makefile oldstable stable unstable
Milestone
v0.18.0

Comments

@atc0005
Copy link
Owner

atc0005 commented Mar 23, 2024

Overview

With the recent changes as part of the v0.17.0 release the space required to build all images has exceeded the space provided by the "Standard" GitHub-hosted runners (for Public repositories).

To work within those constraints we'll need to break up the image generation & upload steps. This should (by my current understanding) allow the total build & upload tasks to be split into batches across separate runners.

References
@atc0005 atc0005 added this to the v0.17.2 milestone Mar 23, 2024
@atc0005 atc0005 self-assigned this Mar 23, 2024
atc0005 added a commit that referenced this issue Mar 23, 2024
@atc0005
Split image build and upload tasks
1a61545 
Keep existing `build` and `upload` recipes as aliases for the
total recipes of that type.

CI jobs have not been updated yet. If this passes CI tasks
(which would prove that at least the build tasks haven't been
broken) I'll update the CI workflow next to use the batch
build/upload tasks.

refs GH-1451
@atc0005 atc0005 mentioned this issue Mar 23, 2024
Merged
atc0005 added a commit that referenced this issue Mar 23, 2024
@atc0005
Update release build workflow to use batches
9febb2d 
Switch workflow from a monolithic build/upload approach to
separate build/upload jobs based on image grouping:

- mirror images
- alpine images
- mingw-64 images
- standard images

This is intended to avoid hitting per-runner disk space limits
but *may* also result in a significant observed runtime decrease.

refs GH-1451
@atc0005 atc0005 mentioned this issue Mar 23, 2024
Merged
@atc0005 atc0005 changed the title Building all images has exceeded "Standard" GitHub-hosted runners disk space Building all images exceeds "Standard" GitHub-hosted runners disk space Mar 23, 2024
atc0005 added a commit that referenced this issue Apr 1, 2024
@atc0005
Update monthly tasks workflow to use batches
1b9a069 
Switch workflow from a monolithic build approach to
separate build jobs based on image grouping:

- mirror images
- alpine images
- mingw-64 images
- standard images

This is intended to avoid hitting per-runner disk space limits.

refs GH-1451
atc0005 added a commit that referenced this issue Apr 1, 2024
@atc0005
Fix monthly scheduled tasks workflow
f14d1a4 
Switch workflow from a monolithic build approach to
separate build jobs based on image grouping:

- mirror images
- alpine images
- mingw-64 images
- standard images

This is intended to avoid hitting per-runner disk space limits.

refs GH-1451
@atc0005 atc0005 mentioned this issue Apr 1, 2024
Merged
atc0005 added a commit that referenced this issue Apr 1, 2024
@atc0005
Fix monthly scheduled tasks workflow (redux)
765f8d9 
Remove settings specific to the release builds workflow which
do not apply to the monthly schedule tasks workflow (lack of
upload task and need for token/perms).

refs GH-1465
refs GH-1451
@atc0005 atc0005 mentioned this issue Apr 1, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@atc0005 atc0005

Labels
bug Something isn't working CI Makefile oldstable stable unstable
Projects
None yet
Milestone
v0.18.0
Development

Successfully merging a pull request may close this issue.

Update release build workflow to use batches atc0005/go-ci
1 participant
@atc0005