Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kubeadm/calico: use public IP #486

Merged
merged 3 commits into from
Nov 29, 2023
Merged

kubeadm/calico: use public IP #486

merged 3 commits into from
Nov 29, 2023

Conversation

tormath1
Copy link
Contributor

@tormath1 tormath1 commented Nov 27, 2023

On Digital Ocean, there are two network interfaces (one public and one private) - by default, Calico / Kubernetes was autodetecting the private one but doing this, the calico-node daemon set was not ready because of bgp issue.

this was not an issue until we started to have pod-to-elsewhere connections (like with NFS)


Locally tested with current stable:

$ cat _kola_temp/do-latest/test.tap
1..1
ok - kubeadm.v1.27.2.calico.base

@tormath1 tormath1 requested a review from a team November 27, 2023 16:42
@tormath1 tormath1 self-assigned this Nov 27, 2023
Noticed while debugging Calico on DO:
```
  Warning  Failed                  7m25s (x4 over 8m47s)  kubelet            Failed to pull image "ghcr.io/flatcar/calico/apiserver:v3.26.4": rpc error: code = Unknown desc = failed to pull and unpack image "ghcr.io/flatcar/calico/apiserver:v3.26.4": failed to resolve reference "ghcr.io/flatcar/calico/apiserver:v3.26.4": failed to authorize: failed to fetch anonymous token: unexpected status: 403 Forbidden
```

Signed-off-by: Mathieu Tortuyaux <[email protected]>
@tormath1 tormath1 changed the title kubeadm/calico: switch to VXLAN (always) kubeadm/calico: use public IP Nov 28, 2023
@tormath1 tormath1 requested a review from pothos November 28, 2023 17:35
@@ -379,6 +384,10 @@ kind: InitConfiguration
nodeRegistration:
kubeletExtraArgs:
volume-plugin-dir: "/opt/libexec/kubernetes/kubelet-plugins/volume/exec/"
{{ if eq .Platform "do" }}
# On digital ocean, the node IP is often not reachable - let's use the public one.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What means "often"?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question. I wanted to say something else I guess.

@tormath1
Copy link
Contributor Author

Tested again:

$ cat _kola_temp/do-latest/test.tap
1..3
ok - kubeadm.v1.26.5.calico.base
ok - kubeadm.v1.27.2.calico.base
ok - kubeadm.v1.28.1.calico.base

all pods and running / ready and NFS tests are passing.

@tormath1 tormath1 merged commit ccdd746 into flatcar-master Nov 29, 2023
2 checks passed
@tormath1 tormath1 deleted the tormath1/calico-do branch November 29, 2023 09:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants