-
Notifications
You must be signed in to change notification settings - Fork 431
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
don’t validate timesync during capz E2E #2099
don’t validate timesync during capz E2E #2099
Conversation
I've opted to keep the |
1dd71ee
to
df6e7a8
Compare
df6e7a8
to
f21b351
Compare
/assign @CecileRobertMichon |
PR LGTM. As discussed in slack, we're not losing coverage of CAPZ code by removing these tests since nothing in the CAPZ repo itself has anything to do with timesync. If anything, we might want to consider adding this sort of test as part of a https://github.com/kubernetes-sigs/image-builder e2e test suite. /lgtm |
Adding slack conversation for more context. There is an issue specifically about creating a time sync test for capz clusters, and AFAICT there has been no test added in Image builder yet. Should we wait for a test to be added in Image builder, and then remove it? unless this test is taking too much time/resources that we must do it immediately. Edit: I could be wrong about image builder tests as I haven't looked into deeply, just saw that there were no linked prs in kubernetes-sigs/image-builder#240 |
@shysank indeed my justification for investigating and removing these tests is observing E2E test flakes Btw the flakes are not time sync failures per se, but temporary network outages in the ssh tunnel that is used to perform the tests. So my priority was reducing test flakes. Seems like we have two approaches:
Obviously #2 is the quickest path forward, but is also the most sensible (IMO) if in fact the tests are not strictly needed in order to validate the foundational cluster-api + capz contracts that govern development velocity. |
Thanks for the explanation! I think it's fair to remove the tests to avoid false negative signals given that the tests don't verify any capz functionality. /lgtm |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: shysank The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
What type of PR is this?
/kind cleanup
What this PR does / why we need it:
This PR removes the time sync validation foo, because there is nothing capz-specific about that particular functionality (i.e., nothing in the capz specs has any effect on this Azure VM behavior).
As an aside, this type of in-cluster testing example is a valuable reference to have for potential future use. Thanks @alexeldeib for that work!, which will live on forever in commit history. 🪦
Which issue(s) this PR fixes (optional, in
fixes #<issue number>(, fixes #<issue_number>, ...)
format, will close the issue(s) when PR gets merged):Fixes #
Special notes for your reviewer:
Please confirm that if this PR changes any image versions, then that's the sole change this PR makes.
TODOs:
Release note: