Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gateway API conformance: Run conformance report generation in CI #5569

Closed
sunjayBhatia opened this issue Jul 19, 2023 · 4 comments · Fixed by #5893
Closed

Gateway API conformance: Run conformance report generation in CI #5569

sunjayBhatia opened this issue Jul 19, 2023 · 4 comments · Fixed by #5893
Assignees
Labels
area/gateway-api Issues or PRs related to the Gateway (Gateway API working group) API. area/testing Issues or PRs related to tests or testing tools. area/tooling Issues or PRs related to project tools and automation.

Comments

@sunjayBhatia
Copy link
Member

Gateway API has an experimental version of the test suite that can be run to generate a conformance report, see:

We should generate the conformance report in CI so we can publish it to the Gateway API repo (and in the future to whatever other conformance reporting infrastructure might exist), e.g. kubernetes-sigs/gateway-api#2192

Open for discussion where/when we should run the reporting and exactly the output, my initial thoughts:

  • Should output a file containing the conformance report YAML (possibly in addition to printing the output to the action logs)
  • Run on pushes to main and release tags
  • Reported Contour component version for non-release versions should use the commit SHA
  • Don't run on PRs, just run the normal test suite
@sunjayBhatia sunjayBhatia added area/testing Issues or PRs related to tests or testing tools. area/gateway-api Issues or PRs related to the Gateway (Gateway API working group) API. area/tooling Issues or PRs related to project tools and automation. labels Jul 19, 2023
@sunjayBhatia
Copy link
Member Author

@github-actions
Copy link

The Contour project currently lacks enough contributors to adequately respond to all Issues.

This bot triages Issues according to the following rules:

  • After 60d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, the Issue is closed

You can:

  • Mark this Issue as fresh by commenting
  • Close this Issue
  • Offer to help out with triage

Please send feedback to the #contour channel in the Kubernetes Slack

@github-actions github-actions bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Sep 19, 2023
@github-actions
Copy link

The Contour project currently lacks enough contributors to adequately respond to all Issues.

This bot triages Issues according to the following rules:

  • After 60d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, the Issue is closed

You can:

  • Mark this Issue as fresh by commenting
  • Close this Issue
  • Offer to help out with triage

Please send feedback to the #contour channel in the Kubernetes Slack

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Oct 20, 2023
@sunjayBhatia sunjayBhatia removed the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Oct 24, 2023
@sunjayBhatia sunjayBhatia reopened this Oct 24, 2023
@sunjayBhatia sunjayBhatia self-assigned this Oct 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/gateway-api Issues or PRs related to the Gateway (Gateway API working group) API. area/testing Issues or PRs related to tests or testing tools. area/tooling Issues or PRs related to project tools and automation.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant