Skip to content
This repository has been archived by the owner on Sep 17, 2024. It is now read-only.

Add observations of mid-deploy scale-out events #12

Merged
merged 1 commit into from
Sep 4, 2024

Conversation

akash1810
Copy link
Member

What does this change?

Document the behaviour of scale-out events mid-deployment, i.e. the Ophan scenario.

In this test we deployed [application version](../dist) `ABC` to `500` in the stack
[`ScalingAsgRollingUpdate`](../packages/cdk/lib/scaling-asg-rolling-update.ts) (CFN stack `playground-CODE-scaling-asg-rolling-update`).

The aim of this test is to understand the behaviour in the ["Ophan scenario"](https://github.com/guardian/riff-raff/issues/1342).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor: I don't think this aim is applicable in this scenario?

Suggested change
The aim of this test is to understand the behaviour in the ["Ophan scenario"](https://github.com/guardian/riff-raff/issues/1342).

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, not sure I agree. Any deployment can fail, and we can scale at any time. To me, "Ophan scenario" is "we need to scale during deployment", there's no restriction on if the artifact being deployed is good or bad.

TBH I was tempted to merge the two documents together, but it didn't read very clearly.

The aim of this test is to understand the behaviour in the ["Ophan scenario"](https://github.com/guardian/riff-raff/issues/1342).

## Highlights
The deployment leaves the service over-capacity.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess this is similar to the findings in https://github.com/guardian/testing-asg-rolling-update/blob/main/observations/healthy-to-unhealthy.md#highlights (but at least in this case we know it will eventually scale down automatically!)

Copy link
Contributor

@jacobwinch jacobwinch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These docs are very clear (even if the test results aren't quite what we were hoping for!) 👍

@akash1810 akash1810 merged commit 3d0f02c into main Sep 4, 2024
3 checks passed
@akash1810 akash1810 deleted the aa/scale-out-mid-deploy branch September 4, 2024 12:12
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants