Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: emit a namespace report of kube-system on failure #27

Merged
merged 1 commit into from
Jan 22, 2021

Conversation

consideRatio
Copy link
Member

@consideRatio consideRatio commented Jan 17, 2021

I initially considered if we could make it part of the action to debug itself on failure, but it wasn't possible to reference the namespace report action from the action itself. So, instead I'm opting to add a debugging step to our tests of the action.

There is a somewhat seldom occurring intermittent issue where we fail to get up and running, being stuck waiting for calico for example. When this has happened I have had no clear way to debug it, so I figure if it happens within this repo's tests we should at least have some debugging information available.


The kind of failures I've seen are the following, and I hope to find more information about this if it happens in general.

Waiting for daemon set spec update to be observed...
Waiting for daemon set "calico-node" rollout to finish: 0 out of 1 new pods have been updated...
Waiting for daemon set "calico-node" rollout to finish: 0 of 1 updated pods are available...
daemon set "calico-node" successfully rolled out
Waiting for deployment "calico-kube-controllers" rollout to finish: 0 of 1 updated replicas are available...
error: timed out waiting for the condition

This can help us capture and debug any intermittent failure that I've
seen happen when I use this action in other repo's. For example, a
failure to get calico up and running successfully.
@consideRatio consideRatio changed the title Try emit a namespace report of kube-system on failure ci: emit a namespace report of kube-system on failure Jan 17, 2021
@consideRatio consideRatio requested a review from manics January 21, 2021 19:59
Copy link
Member

@manics manics left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds fine to me! Though I was surprised by the comment that jupyterhub/action-k8s-namespace-report changes the kubeconfig namespace.

@manics manics merged commit 3b7b17d into jupyterhub:main Jan 22, 2021
@consideRatio
Copy link
Member Author

Sounds fine to me! Though I was surprised by the comment that jupyterhub/action-k8s-namespace-report changes the kubeconfig namespace.

Yeah it is not ideal, action-k8s-namespace-report preferably shouldn't do that :§

jupyterhub/action-k8s-namespace-report#3

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants