🚀 Release v1.40.0

[pcrespov]

In preparation for release. Here an initial (incomplete) list of tasks to prepare before releasing:

• Prepare staging
• Check changelog 🚨
• Check devops ⚠️
• Test assessment: e2e-testing
• Test assessment: targeted-testing
• Test assessment: user-testing ✅
• Release summary
• Release assessment

---

Prepare staging

Motivation

All changes from Athena sprint

Check changelog 🚨

## Added / Changed / Fixed Features

- ♻️ Login: refactoring websever.login plugin (2/3) (#3590)
- ✨ Login.2FA: Improve phone registration (#3624)
- ♻️  Login.2FA: Resend sms (1/2) (#3577) (#3318)
- ✨ API: Studies ports. apiserver api `0.4.2` (#3623), webserver api `0.12` (#3621)
- ✨ Autoscaling: have only one ec2 client (#3643)
- ✨ Autoscaling: automatically cleanup nodes from the docker swarm (#3617)
- ✨ Autoscaling: migrate autoscaling  (⚠️ devops) (#3566) 🚨
- 🐛 UI: Avoid duplicated new buttons (#3648)
- ✨ UI: Rocket-lite Navigation Bar review (#3619)
- ✨ UI: React to study:open 409 error code (#3618)
- ✨ UI: Request service frontend after successful ping (#3598)
- ✨ Tags: tags for groups w/ access-rights (#3595)(#3591) (⚠️ devops) (#3584) (#3587) 🚨
- ✨ Resources: Allow to limit number of opened studies per user (🗃️ DB change) (#3615)
- ✨ Resources: Allow to override dy-service resources (#3608)
- ✨ Products: extends products plugin (⚠️ devops) (#3540) 🚨
- ♻️ Products: Replaces SMTP_SENDER by the products email (⚠️ devops) (#3576)
- 🐛 Products: fix default product (⚠️ devops ) (#3552) 🚨
- ♻️  Products.UI: Extends products (#3557)
- ♻️ Agent: Simple readable agent logs (⚠️ devops) (#3599)
- ♻️ Agent: making agent output more readable (#3594)
- ♻️  Dy-Services: refactor dy-sidecar output directories event detection (#3476) 🚨
- ✨ Dy-Services: start/Stop services 2 (#3637)



## Security / Maintenance Platform & Infrastructure

- 🔨 e2e: voila (and TIP) (#3651)
- 🔨 e2e: publications (#3650)
- 🔨 e2e: double timeout when running optimizer (#3641)
- 🔨 e2e: close Preparing Inputs window (#3642)
- 🔨 e2e: tutorials Grouping review (#3636)
- 🔨 e2e: autoscaling: connect with rabbitmq (#3620)
- 🔨 e2e: Increase S4L startup time (#3575)
- 🔨 CI: fixes public-api tests (#3649)
- 🔨 CI: Is3569/flaky public api test (#3634)
- ⬆️ Upgrade: python-socketio + flakyness (#3631)(#3622)(#3630)
- ⬆️ Upgrade: tests and tools of non-``services`` (#3640)
- ⬆️ Upgrade: traefik to 2.9.5 latest version (#3605)
- ♻️ Maintenance: Use common RabbitMQ client  (⚠️ devops) (#3502) 🚨


**Legend**

- ✨ New feature
- 🐛 Fixes bugs
- ♻️ Refactors code
- ⬆️ Upgrades dependencies
- 🔒️ Fixes security issues
- 🔨 Adds or updates development scripts or CI.
- 📌 Cherry-picked to production or staging
- 🚨 Has to be target/user testsed ,✅ target/User tests done
- ⚠️ Changes relevant to devops
- 🗃️ Changes in the database

Check devops ⚠️

Test assessment: e2e-testing

• Tue 13: OK
• Wed 14: OK
• Thu 15: OK

Test assessment: targeted-testing ✅

These are the commits marked with 🚨

• ✨ Autoscaling: migrate autoscaling (⚠️ devops)
  • (✨ Migrate autoscaling (⚠️ devops) osparc-simcore#3566) 🚨
• ✨ Tags: tags for groups w/ access-rights (#3595)(#3591) (⚠️ devops)
  • (✨ Is765/tags for groups (⚠️ devops) osparc-simcore#3584) (#3587) 🚨 @pcrespov
• ✨ Products: extends products plugin (⚠️ devops)
  • (✨ Is765/extends products plugin (⚠️ devops)  osparc-simcore#3540) 🚨 @pcrespov
• 🐛 Products: fix default product (⚠️ devops )
  • (Is765/fix default product (⚠️ devops ) osparc-simcore#3552) 🚨@pcrespov
• ♻️ Dy-Services: refactor dy-sidecar output directories event detection
  • (♻️ Refactor dy-sidecar output directories event detection osparc-simcore#3476) 🚨
• ♻️ Maintenance: Use common RabbitMQ client (⚠️ devops)
  • (♻️ Use common RabbitMQ client (⚠️ devops) osparc-simcore#3502) 🚨

Test assessment: user-testing

SKIPPED

Release summary

• what: make release-prod version=1.40.0 git_sha=dfa049a29100f120d1a253f9ef8b9303ee923a79
  • at staging_athena3 (last pre-release of last sprint)
• who: @mrnicegyu11 @Surfict @pcrespov
• when: MONDAY Dec.19 (tempative)

Release assessment

[pcrespov]

New commits since

• dfa049a29 (tag: staging_athena3) ✨🐛 e2e: Voila (and TIP) (#3651)
• 5d22707d2 ♻️ Is3318/refactoring websever.login plugin (2/3) (#3590)
• 0f04727b1 ✨ Autoscaling: have only one ec2 client (#3643)
• 43192a276 e2e: publications (#3650)
• 1f4aa36cc Revert "Revert "⬆️ Maintenance: Upgrade python-socketio + flakyness (… (#3631)
• 0cea2a5d2 🔨 Fixes public-api tests (#3649)
• 3f8a317e9 ♻️ Refactor dy-sidecar output directories event detection (#3476)
• 51cc7cb06 🐛 Bugfix: Avoid duplicated new buttons (#3648)
• 7afec125a ⬆️ Maintenance: upgrades tests and tools of non-services (#3640)
• 6a8d3be29 close Preparing Inputs window (#3642)
• 8d8a065a0 double timeout when running optimizer (#3641)
• ae822a1b5 (tag: staging_Athena1) ✨ Start/Stop services 2 (#3637)
• 3701d49f7 (tag: staging_Athena2) ✨ Autoscaling: connect with rabbitmq (#3620)
• 57c88057d ✨Tutorials Grouping review (#3636)
• db2ff3649 🐛✨ Add Dipole Antenna e2e test (#3632)
• e7a1efbc3 ✅ Is3569/flaky public api test (#3634)
• 4b2db6c39 ✨Improve phone registration (#3624)
• 0323aaa0d ✨ Rocket-lite Navigation Bar review (#3619)
• 719bf1c4a Revert "⬆️ Maintenance: Upgrade python-socketio + flakyness (#3622)" (#3630)
• db03a2871 ⬆️ Maintenance: Upgrade python-socketio + flakyness (#3622)
• 51d6df368 ✨ Is686/apiserver api 0.4.2: studies ports (#3623)
• c1d30ff35 ✨ Is686/webserver api 0.12: project ports metadata (#3621)
• 936bac00b ✨Autoscaling: automatically cleanup nodes from the docker swarm (#3617)
• 9152bf8c4 ✨ React to study:open 409 error code (#3618)
• 5d3fdaae3 ✨Group Templates by Tag (#3587)
• 758f7ed81 ✨ Allow to limit number of opened studies per user (🗃️ DB change) (#3615)
• c07709395 ✨ Allow to override dy-service resources (#3608)
• 179112356 ✨ Migrate autoscaling (⚠️ devops) (#3566)
• 3189f112b ♻️ Replaces SMTP_SENDER by the products email (⚠️ devops) (#3576)
• db493ed7c upgrade traefik to 2.9.5 latest version (#3605)
• 491a35443 ♻️ Simple readable agent logs (⚠️ devops) (#3599)
• 1bca2e5ce flaky pylint: moves helpers to pytest_simcore (#3603)
• 95d4e91ca Request service frontend after successful ping (#3598)
• 35d30df0a ♻️ making agent output more readable (#3594)
• 1e043e224 ✨ FE: Tags response includes access-rights (#3595)
• c05eddded Is765/tags response include access-rights (#3591)
• 6bce0432a ♻️ changed dierctor-v2 -> dy-sidecar API retry policy (#3583) 📌 [v1.39.0]
• 2b6811979 🐛 Stopping container without starting them no longer raises error (#3589) 📌 [ v1.39.0]
• 352b36034 🐛♻️ No more /health errors when starting sidecars (#3586) 📌 [v1.39.0]
• e9d138604 optional instructions (#3593) 📌 [v1.39.0]
• 036a8c6f0 ♻️ Is3318/resend sms: refactoring (1/2) (#3577)
• 8508b4ef3 ✨ Is765/tags for groups (⚠️ devops) (#3584)
• 59e59b5fd 🐛 agent rclone configuration fixes (#3580) 📌 [v1.39.0]
• b3b01c5ee e2e: Increase S4L startup time (#3575)
• 163e2161a Is765/fix default product (⚠️ devops ) (#3552)
• f8bce034f 🐛 agent running in production now has access to rclone (#3571)
• c370521f7 ♻️ Use common RabbitMQ client (⚠️ devops) (#3502)
• 45ca6ad9b ✨♻️ Extends products: frontend (#3557)
• 4e1907884 force progress value to be between 1 and 99 (#3560) 📌 [v1.39.0]
• dcedd7462 ♻️ Rerevise docker networks dk (bis) (⚠️ devops) (#3564) 📌 [v1.39.0]
• 850f53575 dont add /var/lib/docker/volumes in global docker-compose file (#3563) 📌 [v1.39.0]
• a028fcd48 ✨ Is765/extends products plugin (⚠️ devops) (#3540)

[pcrespov]

@sanderegg had to re-apply hotfix https://github.com/ITISFoundation/osparc-simcore/releases/tag/v1.39.3. Next time we should make hot-fixes both in staging and production

[Surfict]

Done today. Not tied to the release itself but Dalco09 was down.

[pcrespov]

HOTFIXED: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v1.40.1

[mrnicegyu11]

Release summary:

• The known issue of postgres14 not handling sudden restarts well (WAL corrupted) occurred again and was fixed with the workflow given in the incident report
• Apart from this the release went relatively smooth