Skip to content
This repository has been archived by the owner on Jun 25, 2024. It is now read-only.

Test samples from inline docs #769

Closed
wants to merge 2 commits into from

Conversation

fao89
Copy link
Collaborator

@fao89 fao89 commented Mar 14, 2024

test inline samples with kuttl

Copy link
Contributor

openshift-ci bot commented Mar 14, 2024

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

Copy link
Contributor

openshift-ci bot commented Mar 14, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: fao89

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@fao89
Copy link
Collaborator Author

fao89 commented Mar 14, 2024

/test all

@fao89 fao89 mentioned this pull request Mar 14, 2024
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/c2a55b20f5694f4b9ca5e87d3e513387

openstack-k8s-operators-content-provider FAILURE in 10m 01s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ dataplane-operator-docs-preview SUCCESS in 2m 34s

@fao89
Copy link
Collaborator Author

fao89 commented Mar 14, 2024

/test dataplane-operator-build-deploy-kuttl

@lewisdenny
Copy link

recheck

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/f3c4c7fb709a4b05a78f17d9391c8677

openstack-k8s-operators-content-provider FAILURE in 9m 33s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ dataplane-operator-docs-preview SUCCESS in 2m 16s

@lewisdenny
Copy link

recheck

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/e715f151065e4e03bdb48e9a2438e22c

openstack-k8s-operators-content-provider FAILURE in 9m 26s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ dataplane-operator-docs-preview SUCCESS in 2m 36s

@fao89 fao89 changed the title PoC: Generate sample from inline docs Test samples from inline docs Mar 19, 2024
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/4d0da4a22ed8470abcc83f6f4e7cd762

✔️ openstack-k8s-operators-content-provider SUCCESS in 38m 48s
podified-multinode-edpm-deployment-crc RETRY_LIMIT in 4s
cifmw-crc-podified-edpm-baremetal FAILURE in 16m 02s
✔️ dataplane-operator-docs-preview SUCCESS in 4m 53s

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/45157f206968446bbd85777b39a27e68

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 53m 20s
podified-multinode-edpm-deployment-crc FAILURE in 51m 43s
cifmw-crc-podified-edpm-baremetal FAILURE in 1h 29m 49s
✔️ dataplane-operator-docs-preview SUCCESS in 2m 30s

@fao89
Copy link
Collaborator Author

fao89 commented Mar 21, 2024

/test dataplane-operator-build-deploy-kuttl

@fao89
Copy link
Collaborator Author

fao89 commented Mar 21, 2024

/test dataplane-operator-build-deploy-kuttl

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/53367bfbf45e4c9fbebf1fe49c63a967

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 40m 28s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 15m 59s
cifmw-crc-podified-edpm-baremetal RETRY_LIMIT in 3s
✔️ dataplane-operator-docs-preview SUCCESS in 2m 31s

@fao89
Copy link
Collaborator Author

fao89 commented Mar 21, 2024

/test dataplane-operator-build-deploy-kuttl

@fao89
Copy link
Collaborator Author

fao89 commented Mar 21, 2024

/test dataplane-operator-build-deploy-kuttl

@fao89
Copy link
Collaborator Author

fao89 commented Mar 21, 2024

/test dataplane-operator-build-deploy-kuttl

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/dfdce514455647a997a6d19b2ec7fc0c

openstack-k8s-operators-content-provider FAILURE in 8m 13s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ dataplane-operator-docs-preview SUCCESS in 2m 22s

@fao89 fao89 force-pushed the inlinesamples branch 2 times, most recently from e8dc8c0 to cdb8e05 Compare March 22, 2024 18:23
@fao89
Copy link
Collaborator Author

fao89 commented Mar 22, 2024

/test dataplane-operator-build-deploy-kuttl

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/e57cd55d34554ff69d7425533ae9b68a

openstack-k8s-operators-content-provider FAILURE in 7m 56s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ dataplane-operator-docs-preview SUCCESS in 2m 10s

@fao89
Copy link
Collaborator Author

fao89 commented Mar 22, 2024

/test dataplane-operator-build-deploy-kuttl

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/0dd52f162deb40f9bfc0b72ca455572e

openstack-k8s-operators-content-provider FAILURE in 8m 18s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ dataplane-operator-docs-preview SUCCESS in 2m 54s

@fao89
Copy link
Collaborator Author

fao89 commented Mar 22, 2024

/test dataplane-operator-build-deploy-kuttl

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/ecfe61289bf545ddacb131a1c437c145

openstack-k8s-operators-content-provider FAILURE in 8m 37s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ dataplane-operator-docs-preview SUCCESS in 2m 13s

Comment on lines 114 to 117
- message: NodeSetBaremetalProvisionReady error occurred
reason: Error
severity: Error
status: "False"
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe it would require a CI change to enable BMO_SETUP

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fao89 fao89 marked this pull request as ready for review March 25, 2024 10:52
@openshift-ci openshift-ci bot requested review from abays and igallagh-redhat March 25, 2024 10:52
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/c16901eca16f44319f999420efaae951

openstack-k8s-operators-content-provider FAILURE in 8m 07s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ dataplane-operator-docs-preview SUCCESS in 2m 12s

@fao89
Copy link
Collaborator Author

fao89 commented Mar 25, 2024

/test dataplane-operator-build-deploy-kuttl

Signed-off-by: Fabricio Aguiar <[email protected]>
Copy link
Collaborator

@slagle slagle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this inverts the logic slighly on how we want to approach the samples.

IMO, it ought to be:

  1. minimal samples under config/samples that serve as kustomize base
  2. kustomize examples that kustomize the samples from 1
  3. A specific doc kustomize examples builds on the other examples
  4. kuttl tests use and docs both use what is generated from 3

This PR results in another top level CRs we have to maintain and continue to test. Instead, it should just all come from the base samples and kustomize examples.

Whether we end up documenting how to use kustomize, or a fully generated samples CRs is a separate question, as long as the source is kustomize for all of it.

@fao89
Copy link
Collaborator Author

fao89 commented Mar 25, 2024

I think this inverts the logic slighly on how we want to approach the samples.

IMO, it ought to be:

  1. minimal samples under config/samples that serve as kustomize base
  2. kustomize examples that kustomize the samples from 1
  3. A specific doc kustomize examples builds on the other examples
  4. kuttl tests use and docs both use what is generated from 3

This PR results in another top level CRs we have to maintain and continue to test. Instead, it should just all come from the base samples and kustomize examples.

Whether we end up documenting how to use kustomize, or a fully generated samples CRs is a separate question, as long as the source is kustomize for all of it.

1 and 2 are being addressed here: #764

I started this with docs to kuttl, for keeping the callouts,
I'll try to see if I can make kustomize add the callouts as comments to implement 3 and 4

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/4172ed356a90407b87a0fdf63f76631d

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 48m 02s
podified-multinode-edpm-deployment-crc FAILURE in 49m 58s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 25m 35s
✔️ dataplane-operator-docs-preview SUCCESS in 2m 54s

Signed-off-by: Fabricio Aguiar <[email protected]>
Copy link
Contributor

openshift-ci bot commented Mar 26, 2024

@fao89: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/precommit-check f63fb8a link true /test precommit-check

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@fao89
Copy link
Collaborator Author

fao89 commented Mar 26, 2024

I realize that if we are taking preprovisioned/baremetal samples, they are already tested on zuul jobs, so we don't need to add kuttl tests for them.
I'll update #764 to address 3 and 4

@fao89 fao89 closed this Mar 26, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants