Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FLINK-36460] Expand the matrix for the smoke test. #4

Closed
wants to merge 5 commits into from

Conversation

SamBarker
Copy link
Owner

The goal is to remove namespace from the main CI run based on apache#881 (comment)

What is the purpose of the change

(For example: This pull request adds a new feature to periodically create and maintain savepoints through the FlinkDeployment custom resource.)

Brief change log

(for example:)

  • Periodic savepoint trigger is introduced to the custom resource
  • The operator checks on reconciliation whether the required time has passed
  • The JobManager's dispose savepoint API is used to clean up obsolete savepoints

Verifying this change

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

  • Added integration tests for end-to-end deployment with large payloads (100MB)
  • Extended integration test for recovery after master (JobManager) failure
  • Manually verified the change by running a 4 node cluster with 2 JobManagers and 4 TaskManagers, a stateful streaming program, and killing one JobManager and two TaskManagers during the execution, verifying that recovery happens correctly.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (yes / no)
  • The public API, i.e., is any changes to the CustomResourceDescriptors: (yes / no)
  • Core observer or reconciler logic that is regularly executed: (yes / no)

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

@SamBarker SamBarker force-pushed the ci_jobs_refactor branch 2 times, most recently from 63e0e73 to 6e29615 Compare October 10, 2024 04:26
@SamBarker SamBarker changed the title [FlINK-XXXX] Expand the matrix for the smoke test. [FLINK-36460] Expand the matrix for the smoke test. Oct 10, 2024
@SamBarker SamBarker force-pushed the ci_jobs_refactor branch 5 times, most recently from 6442c91 to 56c87b0 Compare October 14, 2024 04:22
@SamBarker SamBarker force-pushed the ci_jobs_refactor branch 3 times, most recently from 8cf03c3 to b7f0ee0 Compare October 15, 2024 02:57
@SamBarker SamBarker force-pushed the ci_jobs_refactor branch 3 times, most recently from cfc7967 to b854817 Compare October 25, 2024 04:13
@SamBarker
Copy link
Owner Author

merged upstream

@SamBarker SamBarker closed this Nov 3, 2024
@SamBarker SamBarker deleted the ci_jobs_refactor branch November 3, 2024 20:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant