Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Keep more builds and artifacts for ceph-dev-new builds #2295

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Conversation

zmc
Copy link
Member

@zmc zmc commented Nov 25, 2024

See individual commit messages for the rationale between each job's change.

I've seen ceph builds fail because they took so long to claim a build node
that the artifacts created by their ceph-dev-new-setup build was
garbage-collected.

Artifacts for a given build of this job use less than 1G; we should keep more
artifacts around. Metadata for builds of this job are negligible; we should
keep far more sets of metadata around.

Signed-off-by: Zack Cerza <[email protected]>
@zmc zmc requested a review from dmick November 25, 2024 22:10
@dmick
Copy link
Member

dmick commented Nov 25, 2024

The numbers are low because we easily run out of of space on the builders and/or the master. I'd want to do some studying of space usage before changing these.

zmc added 2 commits November 25, 2024 16:15
Builds of this job take up 20MB.

Signed-off-by: Zack Cerza <[email protected]>
Builds of this job take up 30KB; we can keep far more.

Signed-off-by: Zack Cerza <[email protected]>
@zmc
Copy link
Member Author

zmc commented Nov 25, 2024

root@jenkins:/var/lib/jenkins/jobs# du -hs ceph-dev-new-{trigger,setup,build}/builds
1011M   ceph-dev-new-trigger/builds
24G     ceph-dev-new-setup/builds
22M     ceph-dev-new-build/builds
root@jenkins:/var/lib/jenkins/jobs# df -h /var/lib/jenkins/
Filesystem      Size  Used Avail Use% Mounted on
/dev/sdb        300G  195G  106G  65% /var/lib/jenkins

I see these changes increasing the jobs' storage requirements by:

  • ceph-dev-new-trigger: ~1G
  • ceph-dev-new-setup: ~24G
  • ceph-dev-new-build: ~70M

The builders aren't relevant here; they keep the workspace of the last/current build.

@zmc
Copy link
Member Author

zmc commented Dec 23, 2024

ping

Copy link
Member

@dmick dmick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

jenkins appears to have 66G left in /var/lib/jenkins right now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants