Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce ginkgo labels #9620

Open
sbueringer opened this issue Oct 26, 2023 · 9 comments · May be fixed by #11686
Open

Introduce ginkgo labels #9620

sbueringer opened this issue Oct 26, 2023 · 9 comments · May be fixed by #11686
Assignees
Labels
area/e2e-testing Issues or PRs related to e2e testing help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/feature Categorizes issue or PR as related to a new feature. priority/backlog Higher priority than priority/awaiting-more-evidence. triage/accepted Indicates an issue or PR is ready to be actively worked on.

Comments

@sbueringer
Copy link
Member

sbueringer commented Oct 26, 2023

Since ginkgo v2 tests can be selected via labels. I think we should take a closer look at that feature and then use it in Cluster API instead of ginkgo focus / skip.

For more details, see: https://groups.google.com/a/kubernetes.io/g/dev/c/DTFEng143NY

@sbueringer sbueringer added the area/e2e-testing Issues or PRs related to e2e testing label Oct 26, 2023
@k8s-ci-robot k8s-ci-robot added the needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. label Oct 26, 2023
@sbueringer
Copy link
Member Author

/help
/triage accepted

@k8s-ci-robot
Copy link
Contributor

@sbueringer:
This request has been marked as needing help from a contributor.

Guidelines

Please ensure that the issue body includes answers to the following questions:

  • Why are we solving this issue?
  • To address this issue, are there any code changes? If there are code changes, what needs to be done in the code and what places can the assignee treat as reference points?
  • Does this issue have zero to low barrier of entry?
  • How can the assignee reach out to you for help?

For more details on the requirements of such an issue, please see here and ensure that they are met.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

In response to this:

/help
/triage accepted

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@k8s-ci-robot k8s-ci-robot added triage/accepted Indicates an issue or PR is ready to be actively worked on. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Oct 26, 2023
@fabriziopandini
Copy link
Member

+1, especially if we follow the same approach suggested for k/k that will ensure a transition period for everyone using the CAPI E2E test framework

@fabriziopandini
Copy link
Member

/kind feature
/priority backlog

@cahillsf
Copy link
Member

id be interested in picking this up, seems like a great improvement

@fabriziopandini on this point:

+1, especially if we follow the same approach suggested for k/k that will ensure a transition period for everyone using the CAPI E2E test framework

it looks like there are some caveats around importing the framework functions used in the example PR from the google convo (kubernetes/kubernetes#121394): https://pkg.go.dev/k8s.io/kubernetes/test/e2e/framework#section-readme

are we willing to accept these terms and import/use anyway?

Usage of the framework outside of Kubernetes is possible, but not encouraged. Downstream users have to be prepared to deal with API changes.

@sbueringer
Copy link
Member Author

sbueringer commented Jan 14, 2025

Do we need code from k/k to implement ginkgo labels? I was hoping we only need functionality from ginkgo and can ~ reuse our existing "labels" (the parts with "[]" in our test names)

@cahillsf
Copy link
Member

not necessarily -- that was the alternative approach i was thinking is "just" using the Ginkgo functionality.

seems they have implemented some nice abstractions around it in k/k though (this valid features thing for example: https://github.com/pohly/kubernetes/blob/338fe7ad55cad858284d4c96df86d3cee9c7d29c/test/e2e/feature/feature.go#L136 or this WithLabel wrapper: https://github.com/pohly/kubernetes/blob/338fe7ad55cad858284d4c96df86d3cee9c7d29c/test/e2e/framework/ginkgowrapper.go#L513-L518)

@sbueringer
Copy link
Member Author

sbueringer commented Jan 14, 2025

Yeah. I'm just wondering if we need this sort of framework considering we only have very few labels :)

(and I'm not sure if our tests can or should be categorized by feature this way)

@cahillsf
Copy link
Member

sure thing, ill draft a straightforward implementation

/assign

@cahillsf cahillsf linked a pull request Jan 14, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/e2e-testing Issues or PRs related to e2e testing help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/feature Categorizes issue or PR as related to a new feature. priority/backlog Higher priority than priority/awaiting-more-evidence. triage/accepted Indicates an issue or PR is ready to be actively worked on.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants