Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move to MySQL 8.0 as the default template generation (#11153) #11769

Merged
merged 34 commits into from
Nov 30, 2022

Conversation

rsajwani
Copy link
Contributor

@rsajwani rsajwani commented Nov 17, 2022

  • Move towards MySQL 8.0 as the default template generation

This upgrades the remaining things to Ubuntu 20.04 and makes MySQL 8.0 the default we run tests against. We still have tests for MySQL 5.7 but those are now explicitly opted into.

This should finish up the Ubuntu 20.04 upgrade and also makes things easier for the future when we need to upgrade again.

Signed-off-by: Dirkjan Bussink [email protected]

  • CI: rename shard vtorc_8.0 to vtorc_5.7, change expected test output for 8.0

Signed-off-by: deepthi [email protected]

  • CI: increase timeout for 8.0 tests on the actual test step from 30 to 45 mins

Signed-off-by: deepthi [email protected]

  • CI: increase timeout to 45 minutes for mysql57 tests too. We really only need this for vtorc, but I've made the change to the template so all tests get it.

Signed-off-by: deepthi [email protected]

  • CI: fix vtorc test to work with both 5.7 and 8.0

Signed-off-by: deepthi [email protected]

  • CI: missed docker flag in mysql57 template, one more fix to vtorc test

Signed-off-by: deepthi [email protected]

  • removing spaces from pb file

Signed-off-by: Rameez Sajwani [email protected]

  • removing spaces in pb file part 2

Signed-off-by: Rameez Sajwani [email protected]

Signed-off-by: Dirkjan Bussink [email protected]
Signed-off-by: deepthi [email protected]
Signed-off-by: Rameez Sajwani [email protected]
Co-authored-by: deepthi [email protected]
Co-authored-by: Rameez Sajwani [email protected]

Description

There are two main changes in CI workflow been done as part of this PR.

  • Move to ubuntu 20.04
  • Upgrade Mysql 5.7 to Mysql 8.0.31 (latest)

This PR cherry-pick (#11153) the change from main where we have made Mysql8.0.x as default database (from Mysql 5.7). We used the same approach as used in 'main' which is using mysql-apt-config to install mysql server. Currently it is 8.0.31.

A lot of vreplication tests were failing. The reason for failure was the machine was running out of resources. We change innodb_buffer_pool_size = 16M in order to get around that.

Related Issue(s)

close #11511

Checklist

  • "Backport to:" labels have been added if this change should be back-ported
  • Tests were added or are not required
  • Documentation was added or is not required

Deployment Notes

…1153)

* Move towards MySQL 8.0 as the default template generation

This upgrades the remaining things to Ubuntu 20.04 and makes MySQL 8.0
the default we run tests against. We still have tests for MySQL 5.7 but
those are now explicitly opted into.

This should finish up the Ubuntu 20.04 upgrade and also makes things
easier for the future when we need to upgrade again.

Signed-off-by: Dirkjan Bussink <[email protected]>

* CI: rename shard vtorc_8.0 to vtorc_5.7, change expected test output for 8.0

Signed-off-by: deepthi <[email protected]>

* CI: increase timeout for 8.0 tests on the actual test step from 30 to 45 mins

Signed-off-by: deepthi <[email protected]>

* CI: increase timeout to 45 minutes for mysql57 tests too. We really only need this for vtorc, but I've made the change to the template so all tests get it.

Signed-off-by: deepthi <[email protected]>

* CI: fix vtorc test to work with both 5.7 and 8.0

Signed-off-by: deepthi <[email protected]>

* CI: missed docker flag in mysql57 template, one more fix to vtorc test

Signed-off-by: deepthi <[email protected]>

* removing spaces from pb file

Signed-off-by: Rameez Sajwani <[email protected]>

* removing spaces in pb file part 2

Signed-off-by: Rameez Sajwani <[email protected]>

Signed-off-by: Dirkjan Bussink <[email protected]>
Signed-off-by: deepthi <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Co-authored-by: deepthi <[email protected]>
Co-authored-by: Rameez Sajwani <[email protected]>
@vitess-bot
Copy link
Contributor

vitess-bot bot commented Nov 17, 2022

Review Checklist

Hello reviewers! 👋 Please follow this checklist when reviewing this Pull Request.

General

  • Ensure that the Pull Request has a descriptive title.
  • If this is a change that users need to know about, please apply the release notes (needs details) label so that merging is blocked unless the summary release notes document is included.

If a new flag is being introduced:

  • Is it really necessary to add this flag?
  • Flag names should be clear and intuitive (as far as possible)
  • Help text should be descriptive.
  • Flag names should use dashes (-) as word separators rather than underscores (_).

If a workflow is added or modified:

  • Each item in Jobs should be named in order to mark it as required.
  • If the workflow should be required, the maintainer team should be notified.

Bug fixes

  • There should be at least one unit or end-to-end test.
  • The Pull Request description should include a link to an issue that describes the bug.

Non-trivial changes

  • There should be some code comments as to why things are implemented the way they are.

New/Existing features

  • Should be documented, either by modifying the existing documentation or creating new documentation.
  • New features should have a link to a feature request issue or an RFC that documents the use cases, corner cases and test cases.

Backward compatibility

  • Protobuf changes should be wire-compatible.
  • Changes to _vt tables and RPCs need to be backward compatible.
  • vtctl command output order should be stable and awk-able.
  • RPC changes should be compatible with vitess-operator
  • If a flag is removed, then it should also be removed from VTop, if used there.

@rsajwani rsajwani changed the title Move towards MySQL 8.0 as the default template generation (#11153) [Don't review]Move towards MySQL 8.0 as the default template generation (#11153) Nov 18, 2022
@rsajwani rsajwani self-assigned this Nov 18, 2022
@rsajwani rsajwani added Component: Build/CI Type: Release Type: Enhancement Logical improvement (somewhere between a bug and feature) labels Nov 18, 2022
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
Signed-off-by: Rameez Sajwani <[email protected]>
@rsajwani rsajwani mentioned this pull request Nov 26, 2022
14 tasks
@rsajwani rsajwani marked this pull request as ready for review November 30, 2022 07:36
@rsajwani rsajwani changed the title [Don't review]Move towards MySQL 8.0 as the default template generation (#11153) Move towards MySQL 8.0 as the default template generation (#11153) Nov 30, 2022
@rsajwani rsajwani changed the title Move towards MySQL 8.0 as the default template generation (#11153) Move to MySQL 8.0 as the default template generation (#11153) Nov 30, 2022
.github/docker/cluster_test_vreplication_v2/Dockerfile Outdated Show resolved Hide resolved
go/vt/mysqlctl/mysqld.go Show resolved Hide resolved
test/ci_workflow_gen.go Outdated Show resolved Hide resolved
Copy link
Contributor

@rohit-nayak-ps rohit-nayak-ps left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

vrep changes lgtm

Copy link
Member

@GuptaManan100 GuptaManan100 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@deepthi deepthi merged commit d3a8b39 into vitessio:release-14.0 Nov 30, 2022
@deepthi deepthi deleted the mysql-cherrypick11153 branch November 30, 2022 23:36
@dbussink dbussink added the Backport This is a backport label Dec 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Backport This is a backport Component: Build/CI Type: Enhancement Logical improvement (somewhere between a bug and feature) Type: Release
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants