Document encap mode installation for EKS #2929

jianjuns · 2021-10-25T02:49:06Z

Signed-off-by: Jianjun Shen [email protected]

Closes #867

codecov-commenter · 2021-10-25T03:13:27Z

Codecov Report

Merging #2929 (d0ac51d) into main (8336f7a) will decrease coverage by 20.99%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             main    #2929       +/-   ##
===========================================
- Coverage   61.59%   40.59%   -21.00%     
===========================================
  Files         283      158      -125     
  Lines       23644    19950     -3694     
===========================================
- Hits        14563     8099     -6464     
- Misses       7512    11080     +3568     
+ Partials     1569      771      -798

Flag	Coverage Δ
kind-e2e-tests	`?`
unit-tests	`40.59% <ø> (-0.25%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
pkg/ovs/openflow/default.go	`0.00% <0.00%> (-100.00%)`	⬇️
pkg/util/runtime/runtime.go	`0.00% <0.00%> (-100.00%)`	⬇️
pkg/agent/cniserver/pod_configuration_linux.go	`0.00% <0.00%> (-100.00%)`	⬇️
pkg/ovs/openflow/logs.go	`9.52% <0.00%> (-90.48%)`	⬇️
pkg/apis/controlplane/register.go	`0.00% <0.00%> (-90.00%)`	⬇️
pkg/agent/nodeportlocal/k8s/annotations.go	`0.00% <0.00%> (-83.88%)`	⬇️
pkg/agent/agent_linux.go	`0.00% <0.00%> (-80.00%)`	⬇️
pkg/agent/client.go	`0.00% <0.00%> (-77.42%)`	⬇️
pkg/ovs/ovsconfig/ovs_client_linux.go	`0.00% <0.00%> (-76.93%)`	⬇️
pkg/flowaggregator/certificate.go	`0.00% <0.00%> (-76.58%)`	⬇️
... and 233 more

antoninbas

thanks for validating this, it will be very useful to have that as a reference

do you want to also mention

the advantages of using encap mode (more Pods per Node, encryption)
what won't work anymore, notably aggregation

docs/eks-installation.md

jianjuns

the advantages of using encap mode (more Pods per Node, encryption)

Makes sense. Add some description in eks-installation.md.

what won't work anymore, notably aggregation

I found aggregation is working! Might be some changes in EKS.

docs/eks-installation.md

antoninbas · 2021-10-26T01:50:11Z

I found aggregation is working! Might be some changes in EKS.

I think aggregation for Antrea APIs work fine, but I'm not sure how aggregation to a regular Pod (not hostNetwork) can work. Did you check with the metrics server? What's the packet path in that case?

jianjuns · 2021-10-26T03:10:26Z

I think aggregation for Antrea APIs work fine, but I'm not sure how aggregation to a regular Pod (not hostNetwork) can work. Did you check with the metrics server? What's the packet path in that case?

Ah, you must be right. Let me check, and I can add that if it does not work. Do you have any other issues in mind?

antoninbas · 2021-10-26T03:16:06Z

@jianjuns you may want to test, but I think the built-in apiserver proxy doesn't work either because it relies on the apiserver being able to connect direcly to Pods: https://kubernetes.io/docs/tasks/access-application-cluster/access-cluster/#manually-constructing-apiserver-proxy-urls. So trying to use the proxy to connect to a Service or Pod should fail.

I can't think of anything else.

jianjuns · 2021-10-28T00:24:22Z

@antoninbas : added description about the control plane -> Pod connection issue.

antoninbas · 2021-10-28T17:39:14Z

docs/eks-installation.md

+
+In `encap` mode, Antrea acts as the primary CNI of an EKS cluster, and
+implements all Pod networking functionalities, including IPAM and routing across
+Nodes. The major benefit of Antrea as the primary CNI is that - it can get rid


I don't think you need the "-" here

Removed it.

antoninbas · 2021-10-28T17:39:52Z

docs/eks-installation.md

+Nodes. The major benefit of Antrea as the primary CNI is that - it can get rid
+of the Pods per Node limits with Amazon VPC CNI. For example, the default mode
+of VPC CNI allocates a secondary IP for each Pod, and the maximum number of Pods
+can be created on a Node is decided by the on the maximum number of elastic


Suggested change

can be created on a Node is decided by the on the maximum number of elastic

that can be created on a Node is decided by the maximum number of elastic

antoninbas · 2021-10-28T17:40:16Z

docs/eks-installation.md

+network interfaces and secondary IPs per interface that can be attached to an
+EC2 instance type. When Antrea is the primary CNI, Pods are connected to the
+Antrea overlay network and Pod IPs are allocated from the private CIDRs
+configured for an EKS cluster, and so number of Pods per Node is no longer


the number of Pods per Node

antoninbas · 2021-10-28T17:40:24Z

docs/eks-installation.md

+EC2 instance type. When Antrea is the primary CNI, Pods are connected to the
+Antrea overlay network and Pod IPs are allocated from the private CIDRs
+configured for an EKS cluster, and so number of Pods per Node is no longer
+limited by number of secondary IPs per instance.


antoninbas · 2021-10-28T17:41:22Z

docs/eks-installation.md

+configured for an EKS cluster, and so number of Pods per Node is no longer
+limited by number of secondary IPs per instance.
+
+Note: as a general limitation in EKS's custom CNI support, Antrea cannot be


as a general limitation when using custom CNIs with EKS, Antrea...

antoninbas · 2021-10-28T17:53:06Z

docs/eks-installation.md

+Note: as a general limitation in EKS's custom CNI support, Antrea cannot be
+installed to the EKS control plane Nodes. As a result, EKS control plane
+cannot initiate a connection to a Pod in Antrea overlay network, when Antrea
+runs in `encap` mode, and so applications that require the control plane to Pod


that require control plane to Pod connections

jianjuns · 2021-10-29T17:04:26Z

/skip-all

Signed-off-by: Jianjun Shen <[email protected]>

jianjuns · 2021-10-29T19:01:08Z

/skip-all

jianjuns added area/provider/aws Issues or PRs related to aws provider. kind/documentation Categorizes issue or PR as related to a documentation. labels Oct 25, 2021

jianjuns requested a review from antoninbas October 25, 2021 02:49

jianjuns force-pushed the eks-encap branch 2 times, most recently from 21c7615 to 748cf22 Compare October 25, 2021 03:02

jianjuns force-pushed the eks-encap branch from 748cf22 to 3f12cf0 Compare October 25, 2021 04:04

antoninbas reviewed Oct 25, 2021

View reviewed changes

jianjuns force-pushed the eks-encap branch from 3f12cf0 to 89d20fd Compare October 25, 2021 22:21

jianjuns commented Oct 25, 2021

View reviewed changes

jianjuns force-pushed the eks-encap branch from 89d20fd to 70d77cd Compare October 25, 2021 22:25

jianjuns force-pushed the eks-encap branch from 70d77cd to d0ac51d Compare October 28, 2021 00:23

antoninbas reviewed Oct 28, 2021

View reviewed changes

jianjuns force-pushed the eks-encap branch from d0ac51d to 26847d9 Compare October 28, 2021 21:25

antoninbas previously approved these changes Oct 28, 2021

View reviewed changes

jianjuns dismissed antoninbas’s stale review via c2e0c9c October 29, 2021 17:14

jianjuns force-pushed the eks-encap branch 3 times, most recently from c0c0af4 to 1ebe9d9 Compare October 29, 2021 17:47

Document encap mode installation for EKS

52f0c88

Signed-off-by: Jianjun Shen <[email protected]>

jianjuns force-pushed the eks-encap branch from 1ebe9d9 to 52f0c88 Compare October 29, 2021 17:59

antoninbas approved these changes Oct 29, 2021

View reviewed changes

jianjuns merged commit 55a18c0 into antrea-io:main Oct 29, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Document encap mode installation for EKS #2929

Document encap mode installation for EKS #2929

jianjuns commented Oct 25, 2021 •

edited

Loading

codecov-commenter commented Oct 25, 2021 •

edited

Loading

antoninbas left a comment

jianjuns left a comment •

edited

Loading

antoninbas commented Oct 26, 2021

jianjuns commented Oct 26, 2021

antoninbas commented Oct 26, 2021

jianjuns commented Oct 28, 2021

antoninbas Oct 28, 2021

jianjuns Oct 28, 2021

antoninbas Oct 28, 2021

jianjuns Oct 28, 2021

antoninbas Oct 28, 2021

jianjuns Oct 28, 2021

antoninbas Oct 28, 2021

jianjuns Oct 28, 2021

antoninbas Oct 28, 2021

jianjuns Oct 28, 2021

antoninbas Oct 28, 2021

jianjuns Oct 28, 2021

jianjuns commented Oct 29, 2021

jianjuns commented Oct 29, 2021

	can be created on a Node is decided by the on the maximum number of elastic
	that can be created on a Node is decided by the maximum number of elastic

Document encap mode installation for EKS #2929

Document encap mode installation for EKS #2929

Conversation

jianjuns commented Oct 25, 2021 • edited Loading

codecov-commenter commented Oct 25, 2021 • edited Loading

Codecov Report

antoninbas left a comment

Choose a reason for hiding this comment

jianjuns left a comment • edited Loading

Choose a reason for hiding this comment

antoninbas commented Oct 26, 2021

jianjuns commented Oct 26, 2021

antoninbas commented Oct 26, 2021

jianjuns commented Oct 28, 2021

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

jianjuns commented Oct 29, 2021

jianjuns commented Oct 29, 2021

jianjuns commented Oct 25, 2021 •

edited

Loading

codecov-commenter commented Oct 25, 2021 •

edited

Loading

jianjuns left a comment •

edited

Loading