Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build/env/linux-arm64/packet: 8 Packet linux/arm64 machines missing (late-October 2020) #42304

Closed
dmitshur opened this issue Oct 30, 2020 · 4 comments
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done. Soon This needs action soon. (recent regressions, service outages, unusual time-sensitive situations)
Milestone

Comments

@dmitshur
Copy link
Contributor

https://farmer.golang.org/#health reports:

image


# "packet" status: Packet linux/arm64 machines
# Notes: https://github.com/golang/build/tree/master/env/linux-arm64/packet
Warn: packet01 missing, not seen for 1h14m46s
Warn: packet02 missing, not seen for 1h14m38s
Warn: packet03 missing, not seen for 1h14m37s
Warn: packet04 missing, not seen for 1h14m38s
Warn: packet05 missing, not seen for 1h14m42s
Warn: packet06 missing, not seen for 1h14m33s
Warn: packet07 missing, not seen for 1h14m43s
Warn: packet08 missing, not seen for 1h14m39s
Error: 8 machines missing, 100% of capacity

This has happened previously (where a restart was required to fix the issue):

This builder is needed for making releases. Applying Soon label.

CC @golang/release.

@dmitshur dmitshur added Builders x/build issues (builders, bots, dashboards) NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. Soon This needs action soon. (recent regressions, service outages, unusual time-sensitive situations) labels Oct 30, 2020
@gopherbot gopherbot added this to the Unreleased milestone Oct 30, 2020
@dmitshur dmitshur self-assigned this Oct 30, 2020
@dmitshur dmitshur added NeedsFix The path to resolution is known, but the work has not been done. and removed NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Oct 30, 2020
@dmitshur
Copy link
Contributor Author

The machine became unresponsive. As in previous occurrences, restarting via Packet UI fixed it.

@cagedmantis
Copy link
Contributor

I would like to consider using the linux-arm64-aws builder as the one used for releases.

@dmitshur
Copy link
Contributor Author

dmitshur commented Oct 30, 2020

@cagedmantis That sounds great! Want to open an issue (or comment on #40561) and send a CL to make us use that builder starting with Go 1.16 Beta 1? See #40563 and CL 246597 for precedent.

@cagedmantis
Copy link
Contributor

@dmitshur Sounds like a plan.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Builders x/build issues (builders, bots, dashboards) FrozenDueToAge NeedsFix The path to resolution is known, but the work has not been done. Soon This needs action soon. (recent regressions, service outages, unusual time-sensitive situations)
Projects
None yet
Development

No branches or pull requests

3 participants