Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds support for global circuit budget #6013

Merged
merged 18 commits into from
Jan 2, 2024
Merged

Adds support for global circuit budget #6013

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
46629af
Adds support for global circuit budget
davinci26 Dec 12, 2023
589633f
release note
davinci26 Dec 12, 2023
4237680
adds test and a docstring
davinci26 Dec 12, 2023
c42a27a
test metrics
davinci26 Dec 13, 2023
6c7e736
remove reddit parameters
davinci26 Dec 13, 2023
bdf1de3
PR comments
davinci26 Dec 15, 2023
8e354c4
revert change
davinci26 Dec 15, 2023
337431c
regenerate
davinci26 Dec 15, 2023
4151035
fixes pr comments
davinci26 Dec 18, 2023
47df638
Merge remote-tracking branch 'upstream/main' into retryBudget
davinci26 Dec 20, 2023
567d012
update metrics docs
davinci26 Dec 21, 2023
4f4825b
kick ci
davinci26 Dec 21, 2023
509d1ac
revert metric change
davinci26 Dec 21, 2023
f9edfc7
remove metrics part 2
davinci26 Dec 21, 2023
378cee4
remove metrics part 3
davinci26 Dec 24, 2023
5531f35
ws change
davinci26 Dec 24, 2023
5a2ada7
kick ci
davinci26 Dec 25, 2023
e4a5cbb
kick ci 2
davinci26 Dec 25, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions apis/projectcontour/v1alpha1/contourconfig.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -76,6 +76,11 @@ type ContourConfigurationSpec struct {
// +optional
Policy *PolicyConfig `json:"policy,omitempty"`

// GlobalCircuitBreakerDefaults specifies default circuit breaker budget across all services.
// If defined, this will be used as the default for all services.
// +optional
GlobalCircuitBreakerDefaults *GlobalCircuitBreakerDefaults `json:"circuitBreaker,omitempty"`
sunjayBhatia marked this conversation as resolved.
Show resolved Hide resolved
davinci26 marked this conversation as resolved.
Show resolved Hide resolved

// Metrics defines the endpoint Contour uses to serve metrics.
//
// Contour's default is { address: "0.0.0.0", port: 8000 }.
Expand Down Expand Up @@ -107,6 +112,21 @@ const (
EnvoyServerType XDSServerType = "envoy"
)

type GlobalCircuitBreakerDefaults struct {
// The maximum number of connections that a single Envoy instance allows to the Kubernetes Service; defaults to 1024.
// +optional
davinci26 marked this conversation as resolved.
Show resolved Hide resolved
MaxConnections uint32 `json:"maxConnections,omitempty" yaml:"maxConnections,omitempty"`
// The maximum number of pending requests that a single Envoy instance allows to the Kubernetes Service; defaults to 1024.
// +optional
MaxPendingRequests uint32 `json:"maxPendingRequests,omitempty" yaml:"maxPendingRequests,omitempty"`
// The maximum parallel requests a single Envoy instance allows to the Kubernetes Service; defaults to 1024
// +optional
MaxRequests uint32 `json:"maxRequests,omitempty" yaml:"maxRequests,omitempty"`
// The maximum number of parallel retries a single Envoy instance allows to the Kubernetes Service; defaults to 3.
// +optional
MaxRetries uint32 `json:"maxRetries,omitempty" yaml:"maxRetries,omitempty"`
}

// XDSServerConfig holds the config for the Contour xDS server.
type XDSServerConfig struct {
// Defines the XDSServer to use for `contour serve`.
Expand Down
20 changes: 20 additions & 0 deletions apis/projectcontour/v1alpha1/zz_generated.deepcopy.go
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 4 additions & 0 deletions changelogs/unreleased/6013-davinci26-small.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
## Support for Global Circuit Breaker Policy
davinci26 marked this conversation as resolved.
Show resolved Hide resolved

The way (circuit-breaker-annotations)[https://projectcontour.io/docs/1.27/config/annotations/] work currently is that when not present they are being defaulted to Envoy defaults. The Envoy defaults can be quite low for larger clusters with more traffic so if
a user accidentally deletes them or unset them this cause an issue. With this change we are providing contour administrators the ability to provide global defaults that are good. In that case even if the user forgets to set them or deletes them they can have the safety net of good defaults.
davinci26 marked this conversation as resolved.
Show resolved Hide resolved
3 changes: 3 additions & 0 deletions cmd/contour/serve.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -560,6 +560,7 @@
globalRateLimitService: contourConfiguration.RateLimitService,
maxRequestsPerConnection: contourConfiguration.Envoy.Cluster.MaxRequestsPerConnection,
perConnectionBufferLimitBytes: contourConfiguration.Envoy.Cluster.PerConnectionBufferLimitBytes,
globalCircuitBreakerDefaults: contourConfiguration.GlobalCircuitBreakerDefaults,

Check warning on line 563 in cmd/contour/serve.go

View check run for this annotation

Codecov / codecov/patch

cmd/contour/serve.go#L563 

Added line #L563 was not covered by tests
})

// Build the core Kubernetes event handler.
Expand Down Expand Up @@ -1117,6 +1118,7 @@
maxRequestsPerConnection *uint32
perConnectionBufferLimitBytes *uint32
globalRateLimitService *contour_api_v1alpha1.RateLimitServiceConfig
globalCircuitBreakerDefaults *contour_api_v1alpha1.GlobalCircuitBreakerDefaults
}

func (s *Server) getDAGBuilder(dbc dagBuilderConfig) *dag.Builder {
Expand Down Expand Up @@ -1209,6 +1211,7 @@
GlobalRateLimitService: dbc.globalRateLimitService,
PerConnectionBufferLimitBytes: dbc.perConnectionBufferLimitBytes,
SetSourceMetadataOnRoutes: true,
GlobalCircuitBreakerDefaults: dbc.globalCircuitBreakerDefaults,
davinci26 marked this conversation as resolved.
Show resolved Hide resolved
davinci26 marked this conversation as resolved.
Show resolved Hide resolved
},
}

Expand Down
15 changes: 8 additions & 7 deletions cmd/contour/servecontext.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -584,13 +584,14 @@ func (ctx *serveContext) convertToContourConfigurationSpec() contour_api_v1alpha
RootNamespaces: ctx.proxyRootNamespaces(),
FallbackCertificate: fallbackCertificate,
},
EnableExternalNameService: &ctx.Config.EnableExternalNameService,
GlobalExternalAuthorization: globalExtAuth,
RateLimitService: rateLimitService,
Policy: policy,
Metrics: &contourMetrics,
Tracing: tracingConfig,
FeatureFlags: ctx.Config.FeatureFlags,
EnableExternalNameService: &ctx.Config.EnableExternalNameService,
GlobalExternalAuthorization: globalExtAuth,
RateLimitService: rateLimitService,
Policy: policy,
GlobalCircuitBreakerDefaults: ctx.Config.GlobalCircuitBreakerDefaults,
davinci26 marked this conversation as resolved.
Show resolved Hide resolved
Metrics: &contourMetrics,
Tracing: tracingConfig,
FeatureFlags: ctx.Config.FeatureFlags,
}

xdsServerType := contour_api_v1alpha1.ContourServerType
Expand Down
27 changes: 24 additions & 3 deletions cmd/contour/servecontext_test.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -485,9 +485,10 @@ func TestConvertServeContext(t *testing.T) {
DisablePermitInsecure: ref.To(false),
FallbackCertificate: nil,
},
EnableExternalNameService: ref.To(false),
RateLimitService: nil,
GlobalExternalAuthorization: nil,
EnableExternalNameService: ref.To(false),
RateLimitService: nil,
GlobalExternalAuthorization: nil,
GlobalCircuitBreakerDefaults: nil,
Policy: &contour_api_v1alpha1.PolicyConfig{
RequestHeadersPolicy: &contour_api_v1alpha1.HeadersPolicy{},
ResponseHeadersPolicy: &contour_api_v1alpha1.HeadersPolicy{},
Expand Down Expand Up @@ -772,6 +773,26 @@ func TestConvertServeContext(t *testing.T) {
return cfg
},
},
"global circuit breaker defaults": {
getServeContext: func(ctx *serveContext) *serveContext {
ctx.Config.GlobalCircuitBreakerDefaults = &contour_api_v1alpha1.GlobalCircuitBreakerDefaults{
MaxConnections: 4,
MaxPendingRequests: 5,
MaxRequests: 6,
MaxRetries: 7,
}
return ctx
},
getContourConfiguration: func(cfg contour_api_v1alpha1.ContourConfigurationSpec) contour_api_v1alpha1.ContourConfigurationSpec {
cfg.GlobalCircuitBreakerDefaults = &contour_api_v1alpha1.GlobalCircuitBreakerDefaults{
MaxConnections: 4,
MaxPendingRequests: 5,
MaxRequests: 6,
MaxRetries: 7,
}
return cfg
},
},
"global external authorization": {
getServeContext: func(ctx *serveContext) *serveContext {
ctx.Config.GlobalExternalAuthorization = config.GlobalExternalAuthorization{
Expand Down
56 changes: 56 additions & 0 deletions examples/contour/01-crds.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,33 @@ spec:
Contour controller. It contains most of all the options that can be
customized, the other remaining options being command line flags.
properties:
circuitBreaker:
description: GlobalCircuitBreakerDefaults specifies default circuit
breaker budget across all services. If defined, this will be used
as the default for all services.
properties:
maxConnections:
description: The maximum number of connections that a single Envoy
instance allows to the Kubernetes Service; defaults to 1024.
format: int32
type: integer
maxPendingRequests:
description: The maximum number of pending requests that a single
Envoy instance allows to the Kubernetes Service; defaults to
1024.
format: int32
type: integer
maxRequests:
description: The maximum parallel requests a single Envoy instance
allows to the Kubernetes Service; defaults to 1024
format: int32
type: integer
maxRetries:
description: The maximum number of parallel retries a single Envoy
instance allows to the Kubernetes Service; defaults to 3.
format: int32
type: integer
type: object
debug:
description: Debug contains parameters to enable debug logging and
debug interfaces inside Contour.
Expand Down Expand Up @@ -3505,6 +3532,35 @@ spec:
used when provisioning a Contour instance that will influence aspects
of the Contour instance's runtime behavior.
properties:
circuitBreaker:
description: GlobalCircuitBreakerDefaults specifies default circuit
breaker budget across all services. If defined, this will be
used as the default for all services.
properties:
maxConnections:
description: The maximum number of connections that a single
Envoy instance allows to the Kubernetes Service; defaults
to 1024.
format: int32
type: integer
maxPendingRequests:
description: The maximum number of pending requests that a
single Envoy instance allows to the Kubernetes Service;
defaults to 1024.
format: int32
type: integer
maxRequests:
description: The maximum parallel requests a single Envoy
instance allows to the Kubernetes Service; defaults to 1024
format: int32
type: integer
maxRetries:
description: The maximum number of parallel retries a single
Envoy instance allows to the Kubernetes Service; defaults
to 3.
format: int32
type: integer
type: object
debug:
description: Debug contains parameters to enable debug logging
and debug interfaces inside Contour.
Expand Down
56 changes: 56 additions & 0 deletions examples/render/contour-deployment.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -258,6 +258,33 @@ spec:
Contour controller. It contains most of all the options that can be
customized, the other remaining options being command line flags.
properties:
circuitBreaker:
description: GlobalCircuitBreakerDefaults specifies default circuit
breaker budget across all services. If defined, this will be used
as the default for all services.
properties:
maxConnections:
description: The maximum number of connections that a single Envoy
instance allows to the Kubernetes Service; defaults to 1024.
format: int32
type: integer
maxPendingRequests:
description: The maximum number of pending requests that a single
Envoy instance allows to the Kubernetes Service; defaults to
1024.
format: int32
type: integer
maxRequests:
description: The maximum parallel requests a single Envoy instance
allows to the Kubernetes Service; defaults to 1024
format: int32
type: integer
maxRetries:
description: The maximum number of parallel retries a single Envoy
instance allows to the Kubernetes Service; defaults to 3.
format: int32
type: integer
type: object
debug:
description: Debug contains parameters to enable debug logging and
debug interfaces inside Contour.
Expand Down Expand Up @@ -3724,6 +3751,35 @@ spec:
used when provisioning a Contour instance that will influence aspects
of the Contour instance's runtime behavior.
properties:
circuitBreaker:
description: GlobalCircuitBreakerDefaults specifies default circuit
breaker budget across all services. If defined, this will be
used as the default for all services.
properties:
maxConnections:
description: The maximum number of connections that a single
Envoy instance allows to the Kubernetes Service; defaults
to 1024.
format: int32
type: integer
maxPendingRequests:
description: The maximum number of pending requests that a
single Envoy instance allows to the Kubernetes Service;
defaults to 1024.
format: int32
type: integer
maxRequests:
description: The maximum parallel requests a single Envoy
instance allows to the Kubernetes Service; defaults to 1024
format: int32
type: integer
maxRetries:
description: The maximum number of parallel retries a single
Envoy instance allows to the Kubernetes Service; defaults
to 3.
format: int32
type: integer
type: object
debug:
description: Debug contains parameters to enable debug logging
and debug interfaces inside Contour.
Expand Down
56 changes: 56 additions & 0 deletions examples/render/contour-gateway-provisioner.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,33 @@ spec:
Contour controller. It contains most of all the options that can be
customized, the other remaining options being command line flags.
properties:
circuitBreaker:
description: GlobalCircuitBreakerDefaults specifies default circuit
breaker budget across all services. If defined, this will be used
as the default for all services.
properties:
maxConnections:
description: The maximum number of connections that a single Envoy
instance allows to the Kubernetes Service; defaults to 1024.
format: int32
type: integer
maxPendingRequests:
description: The maximum number of pending requests that a single
Envoy instance allows to the Kubernetes Service; defaults to
1024.
format: int32
type: integer
maxRequests:
description: The maximum parallel requests a single Envoy instance
allows to the Kubernetes Service; defaults to 1024
format: int32
type: integer
maxRetries:
description: The maximum number of parallel retries a single Envoy
instance allows to the Kubernetes Service; defaults to 3.
format: int32
type: integer
type: object
debug:
description: Debug contains parameters to enable debug logging and
debug interfaces inside Contour.
Expand Down Expand Up @@ -3516,6 +3543,35 @@ spec:
used when provisioning a Contour instance that will influence aspects
of the Contour instance's runtime behavior.
properties:
circuitBreaker:
description: GlobalCircuitBreakerDefaults specifies default circuit
breaker budget across all services. If defined, this will be
used as the default for all services.
properties:
maxConnections:
description: The maximum number of connections that a single
Envoy instance allows to the Kubernetes Service; defaults
to 1024.
format: int32
type: integer
maxPendingRequests:
description: The maximum number of pending requests that a
single Envoy instance allows to the Kubernetes Service;
defaults to 1024.
format: int32
type: integer
maxRequests:
description: The maximum parallel requests a single Envoy
instance allows to the Kubernetes Service; defaults to 1024
format: int32
type: integer
maxRetries:
description: The maximum number of parallel retries a single
Envoy instance allows to the Kubernetes Service; defaults
to 3.
format: int32
type: integer
type: object
debug:
description: Debug contains parameters to enable debug logging
and debug interfaces inside Contour.
Expand Down
Loading