Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

upgrades,jobs: stub the auto config runner #98440

Merged
merged 2 commits into from
Mar 16, 2023

Conversation

knz
Copy link
Contributor

@knz knz commented Mar 11, 2023

Epic: CRDB-23559
Informs #98431.

This change is part of a larger project to perform auto-configuration in newly created clusters. One of the components will be the "auto config runner", a job which receives configuration to apply from the environment, creates other jobs to apply this configuration, and stores the execution results.

This commit stubs the job, which means allocating a cluster version for it and instantiating it via a cluster migration. The job is otherwise idle at this point.

Release note: None

@knz knz requested review from ajwerner and a team March 11, 2023 19:42
@knz knz requested review from a team as code owners March 11, 2023 19:42
@cockroach-teamcity
Copy link
Member

This change is Reviewable

@knz knz force-pushed the 20230311-auto-config-job branch 2 times, most recently from 3a760ec to c7819e1 Compare March 11, 2023 20:13
@knz knz requested a review from a team March 11, 2023 20:13
@knz knz force-pushed the 20230311-auto-config-job branch 2 times, most recently from b4bbd28 to 82fb959 Compare March 11, 2023 22:14
@knz knz force-pushed the 20230311-auto-config-job branch from 82fb959 to 92c3e7d Compare March 12, 2023 16:43
@knz knz force-pushed the 20230311-auto-config-job branch from 92c3e7d to 919f208 Compare March 12, 2023 16:52
craig bot pushed a commit that referenced this pull request Mar 12, 2023
98458: jobs: avoid race conditions in tests r=miretskiy a=knz

Needed for #98440.
Epic: CRDB-23559

When investigating jobs created during cluster migrations I found that the unit tests in the jobs packages have a race condition with the registry, because they register new job types (adding new constructors) concurrently with job adoption occurring during startup (using constructors).

This patch fixes it.

Release note: None

Co-authored-by: Raphael 'kena' Poss <[email protected]>
@knz knz force-pushed the 20230311-auto-config-job branch from 919f208 to 4d20185 Compare March 13, 2023 00:06
@knz knz added the A-multitenancy Related to multi-tenancy label Mar 13, 2023
@knz knz requested review from adityamaru and dt March 13, 2023 13:57
@knz knz force-pushed the 20230311-auto-config-job branch from 4d20185 to ad19f6a Compare March 13, 2023 21:56
@knz knz force-pushed the 20230311-auto-config-job branch from ad19f6a to d4e795e Compare March 13, 2023 22:09
@knz knz force-pushed the 20230311-auto-config-job branch 2 times, most recently from 9c00e99 to 6cce3af Compare March 13, 2023 23:28
@knz knz removed the request for review from a team March 13, 2023 23:32
@knz knz requested a review from mgartner March 15, 2023 22:23
@knz knz force-pushed the 20230311-auto-config-job branch from c122a8c to b6824ff Compare March 15, 2023 23:35
@knz knz requested a review from a team as a code owner March 15, 2023 23:35
@knz knz requested a review from a team March 15, 2023 23:35
@knz knz requested a review from a team as a code owner March 15, 2023 23:35
@knz knz removed request for a team and mgartner March 15, 2023 23:39
@knz knz force-pushed the 20230311-auto-config-job branch 3 times, most recently from c31f79a to 5d550d4 Compare March 16, 2023 00:44
This change is part of a larger project to perform auto-configuration
in newly created clusters. One of the components will be the "auto
config runner", a job which receives configuration to apply from
the environment, creates other jobs to apply this configuration,
and stores the execution results.

This commit stubs the job, which means allocating a cluster version
for it and instantiating it via a cluster migration.
The job is otherwise idle at this point.

Release note: None
@knz knz force-pushed the 20230311-auto-config-job branch 3 times, most recently from e7f845f to 82db75b Compare March 16, 2023 12:29
@knz
Copy link
Contributor Author

knz commented Mar 16, 2023

bors r=stevendanna,ajwerner

@knz
Copy link
Contributor Author

knz commented Mar 16, 2023

bors r-

@craig
Copy link
Contributor

craig bot commented Mar 16, 2023

Canceled.

@knz
Copy link
Contributor Author

knz commented Mar 16, 2023

bors r=stevendanna,ajwerner

@knz knz force-pushed the 20230311-auto-config-job branch from 82db75b to 1eba4bd Compare March 16, 2023 13:13
@craig
Copy link
Contributor

craig bot commented Mar 16, 2023

🕐 Waiting for PR status (GitHub check) to be set, probably by CI. Bors will automatically try to run when all required PR statuses are set.

@knz knz force-pushed the 20230311-auto-config-job branch from 1eba4bd to 56c64e3 Compare March 16, 2023 13:20
@craig
Copy link
Contributor

craig bot commented Mar 16, 2023

Canceled.

@knz
Copy link
Contributor Author

knz commented Mar 16, 2023

bors r=stevendanna,ajwerner

@craig
Copy link
Contributor

craig bot commented Mar 16, 2023

Build succeeded:

@craig craig bot merged commit dbbf20d into cockroachdb:master Mar 16, 2023
@knz knz deleted the 20230311-auto-config-job branch March 16, 2023 14:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-multitenancy Related to multi-tenancy
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants