🚀 Release v1.51.0

[pcrespov]

Release version

1.51.0

Commit SHA

b91f344

Previous pre-release

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_Mithril4

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

Permalink feature in production ready before SCM

Changes

staging_Mithril1

• ⬆️ Autoscaling: requirements update #3916 by @sanderegg
• 🔨 Is3635/service settings jsonschemas #3703 (Refactor osparc stack env-var handling #3635) by @pcrespov
• 🐛 Fixes /scheduled_maintenance entrypoint #3926 by @pcrespov
• ✨Progress is now sent to the FE when closing a study #3919 by @GitHK
• ✨ Frontend: Responsive Navigation Bar #3925 by @odeimaiz
• Bump minimist, mkdirp and extract-zip #3927 by @dependabot
• ✨ Adds entrypoint to check invitation and get associated email #3856 by @pcrespov
• ✨ S4L e2e: wait for S4L Splash Screen to disappear #3933 by @odeimaiz
• ✨Frontend User registration: Check Invitation email from token #3935 by @odeimaiz
• ⬆️ Maintenance/reqs upgrade (test/tools & service security patch) (⚠️ devops) 🚨  #3928 by @matusdrobuliak66
• 🐛 Using a more proper message type #3936 by @GitHK
• ⬆️ Removing fastapi constraints + upgrade #3945 by @matusdrobuliak66
• 📝 Doc conventions, 🔨 issue templates and ♻️ error messages #3930 by @pcrespov
• 🐛 Attempt to avoid connection pool running out of connections #3947 by @GitHK
• 🐛 Fix issue parsing service without resources #3942 by @GitHK
• ⬆️ Maintenance: upgrade dask libraries #3949 by @sanderegg
• 🐛 Fix stop container log fetching edge case #3956 by @GitHK
• ✨Adding rabbitmq based RPC for IPC between services #3909 by @GitHK
• 🔨 Upgrading pip version #3957 by @matusdrobuliak66
• ✨ Frontend: Organization details #3955 by @odeimaiz
• ✨ User Notifications (⚠️ devops) 🚨 #3937 by @odeimaiz
• ♻️ FastAPI long running unique tasks resume if running #3948 by @GitHK
• ✨ Frontend: Ask for confirmation before demoting an Organization to Viewer #3961 by @odeimaiz
• 🎨 Frontend: Improve UX for "Download of Study Data" #3963 by @odeimaiz

Full Changelog: staging_ResistanceIsFutile16...staging_Mithril1
Release issue: ITISFoundation/osparc-issues#896

staging_Mithril2

• ♻️ add osparc-gateway-server to repo (⚠️ DEVOPS) #3960 by @sanderegg
• ♻️Autoscaling: set default termination time of EC2 instance to 1 minute #3970 by @sanderegg
• ⬆️⚗️ Bump traefik version #3967 by @mrnicegyu11
• 🐛 Fix: Thumbnail width on Large Card #3973 by @odeimaiz
• 🐛 Bug/autoscaling datetime failure #3976 [📌 to v1.50.1] by @pcrespov
• 📝 Maintenance: adds status badges and adds new fields in template forms for bug issues #3978 by @pcrespov
• 🐛 raising agent limit to 1G #3972 by @GitHK
• ⬆️ CI: upgrade ubuntu/buildx #3979 by @sanderegg
• ✨ Is3940/public api can run a job on a given cluster (part 1) #3958 by @pcrespov
• 🚑️ add more logging to GC #3982 [📌 to v1.50.2] by @GitHK
• 🚑️ Fix GC error while trying to close service #3985 [📌 to v1.50.2] by @GitHK
• ✨ Frontend: File Picker: Abort file upload button #3980 by @odeimaiz
• ♻️ Maintenance: cleanup catalog #3983 by @sanderegg
• 🎨 Frontend: Improve anonymous' UI #3988 by @odeimaiz
• ✨ Error pages when published studies dispatcher fails, access rights fixes and plugin refactoring #3962 by @pcrespov
• 🐛 Fix: Service Catalog filter by type #3995 by @odeimaiz

Full Changelog: staging_Mithril1...staging_Mithril2
Release Issue: #4002

staging_Mithril3

• 🎨 Frontend: auto-start service when double clicking in service #4000 by @odeimaiz
• 🐛 Bugfix: Let users make Services Public #3997 by @odeimaiz
• ✨ Is829/jlab login required #4001 (jLab: you need to be logged in osparc-issues#829) by @pcrespov
• ✨ Personalized resources: Allow override of computational service needed resources (⚠️ devops) #3989 by @sanderegg

Full Changelog: staging_Mithril2...staging_Mithril3
Release Issue #4009

staging_Mithril4

• 🐛 Is812/email case insensitive v2 (⚠️ devops) 🚨 #3998 by @matusdrobuliak66
• ♻️ director-v2 SchedulerData legacy data format update #4005 by @GitHK
• 🐛Docker buildx 0.10.2 does not resolve correctly ENVs in docker-compose labels section #4016 by @sanderegg
• ✨Extends web-server OAS with nih-sparc specific entrypoints #3984 by @pcrespov
• 🔨 Maintenance: Is3942/issue templates releases #4015 by @pcrespov
• 🐛CATALOG_SERVICES_DEFAULT_RESOURCES missing a S in docker-compose #4017 by @sanderegg

Full Changelog: staging_Mithril3...staging_Mithril4
Release Issue #4020

Devops check 👷

• Review changes above with (⚠️ devops)
  • catalog environ missing (check issue opened by @sanderegg )
• Add changes (if any) and release tags in https://github.com/ITISFoundation/osparc-ops-environments/tags
• Add changes (if any) and release tags in osparc ops configurations

Tests assessment: e2e testing check 🧪

• vtk links failing staging
• gc in aws-staging. @mrnicegyu11 looking into it.

Test assessment: targeted-testing 🔍️

• Check changes by @GitHK
• Check changes by @sanderegg
• Check changes by @pcrespov
• Check with @elisabettai

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=1.51.0  git_sha=b91f3442b25888e3997d20af24fb769e80f53921

• Draft release changelog
• Announce maintenance. Tue, Mar.28 from 10:30 - 12:00 am :
• redis

     { 
       "start": "2023-03-28T08:30:00.000Z", 
       "end":   "2023-03-28T10:00:00.000Z", 
       "reason": "Release v1.51.0"
     }

  • aws
  • dalco
  • tip
• status page
  • osparc
  • s4l
• mattermost channels
  • maintenance
  • power users

Releasing 🚀

• Maintenance page up 👷
• Release by publishing draft
• Check release CI
• Check deployed
  • aws deploy
  • dalco deploy
  • tip deploy
• Delete announcement
• Check e2e runs
• Announce

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v1.51.0

[pcrespov]

WARNING: see time!

[mrnicegyu11]

BLOCKED

Issue #4027 until understood / fixed is a blocker for me to release to prod, please provide some comforting words for poor mrnicegyu11 or fix the bugs. thanks :)

Update: We released anyway.

[mrnicegyu11]

Even though issue #4027 impacts production, we released. For now, dynamic services that dont close need to be monitored constantly to prevent resource derivation.
The procedure is as follows:

- monitor matermost channel osparc-batman for alert
- open portainer for deployment that caused alert
- open services tab in portainer
- search for service with the $NODE_UUID from the mattermost alert
- if no sidecar is shown: do nothing. all is fine.
- if sidecar is there: open a shell in the director-v2 container
- run command: simcore-service-director-v2 close-and-save-service $NODE_UUID
- if the command printed above cause errors: write in osparc core team chat about it, a backend dev needs to check
- if the message "Finished cleanup for service $NODE_UUID" is printed, the hanging sidecar was successfully cleaned up

See also: ITISFoundation/osparc-ops-environments#128

Aftermath:

Forever hanging sidecars CC @GitHK @pcrespov @sanderegg :

osparc.io

• dy-sidecar_f6299542-3d23-5067-8ae0-e6addd6b33a0
• dy-sidecar_eb71c1e7-94db-48c7-9eec-011511bafddf
• dy-sidecar_b1c8ad49-d862-53a4-9f7e-4fba678d0b78

dalco

• dy-sidecar_32116d2d-cdda-5d0b-8145-146f5a621d14

tip

• dy-sidecar_969c4d64-788f-5c79-b189-851b6eb30857

Issues

• Due to a human error, a docker node placement constraint was briefly set wrong on tip.itis.swiss, and resolved after 10min.