Plan: Python 3.8 support for Ubuntu 20.04

[nzlosh]

As per the TSC discussion on 2nd March 2021 it was decided to add support for Python3.8 on Ubuntu 20.04 (focal).

To achieve this goal, the following actions must be carried out:

• st2
  • add support for mongodb 4.4 (Only mongodb-server v4.4 packages for Focal)
    Bump pymongo to >=3.11 (https://docs.mongodb.com/drivers/pymongo/#mongodb-compatibility)
  • Mongo 4.4 compatibility tracked in issue MongoDB 4.4 support tracking issue st2#5249
  • add support for python3.8 to unit tests (github actions)
  • add support for unit tests to run against mongo 4.0 and 4.4 (github actions)
  • update version of eventlet to >=27.0 to benefit from monkey patch supporting python3.7+ threading.
  • Add focal to .circleci packages - Add focal and remove xenial st2#5283
• st2-packages
  • Integrate focal package building.
  • Add focal to CircleCI package build.
  • Add python3.8 to cli test post package build.
• st2packaging-dockerfiles
  • Add focal to packagingbuild.
  • Add focal to packagingtest.
  • Publish docker images.
• st2ci
  • changes for unstable runs and PR runs - @amanda11
  • changes for stable runs - @amanda11
• stcd
  • changes for unstable runs - @amanda11
  • changes for release - @amanda11
• ansible-st2 - @winem
  • pre-release changes for U20
  • post-release travis runs for stable U20
• puppet-st2 @rush-skills
• st2docs
  • Add Ubuntu 20.04 (focal) documentation. st2docs#1072
• orquesta
  • unit-tests updated with python3.8 support. Add python3.8 support to tests using tox-gh-actions orquesta#236
• st2chatops - update O/S built on - @amanda11
• st2web - add focal to builds @amanda11
• st2-aut-ldap Add py38 st2-auth-ldap#95 thanks @amanda11
• st2-rbac-backend Add py3.8 UT st2-rbac-backend#52 thanks @amanda11

[arm4b]

That's very helpful, thanks a lot @nzlosh 👍
cc @winem

[Kami]

Just FYI - StackStorm/st2vagrantdev#12.

[Kami]

add support for unit tests to run against mongo 4.0, 4.2 and 4.4 (github actions)

As discussed on Slack, that's probably not easily achievable at this point since it would inflate our build matrix and slow things down too much.

In the past, we did run tests against multiple MongoDB versions on Travis CI, but it got removed since it was slow.

So our option is to run unit + integration tests only against Mongo 4.0 or Mongo 4.4.

Right now we use 4.4, which I think is fine and probably better since there are some small changes with projection queries which used to work in MongoDB 4.0, but not in 4.4 - so in theory, as long as those tests pass on 4.4, they should also pass on 4.0.

And we will have some version specific coverage with end to end tests anyway (Bionic will exercise 4.0 and Focal will exercise 4.4).

[nzlosh]

The focal packages are now available on packagecloud.
@nmaludy do you have the bandwidth to integrate focal with puppet?
@amanda11 / @winem do either of you have bandwidth to integrate focal with ansible?

[arm4b]

+@cognifloyd, hopefully, he could also help with adding U20 for Ansible.

[rush-skills]

Currently, we don't run integration tests against python3.8 in puppet modules. Is this required? @amanda11 @nmaludy

[arm4b]

It looks we're all set here with adding py3.8 for Ubuntu20.