🚀 Release v1.56.0

[matusdrobuliak66]

Release version

1.56.0

Commit SHA

9e9e23417cc6a5df98f34761c52bf1023e55e667

Previous pre-release

#4482

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

Release to production

Changes

Staging Watermelon3

Release Issue: #4430

• ♻️ Refactors projects plugin sub-modules as controller-service-repository #4389 by @pcrespov
• 🎨 Redesign: Study information page #4396 by @odeimaiz
• ✨ (⚠️ devops) 🗃️ Is922 resource tracking/1. version of regular scraping #4380 by @matusdrobuliak66
• ✨ Frontend: Student competition announcement #4404 by @odeimaiz
• 🐛Autoscaling: fix listing of nodes with common prefix #4410 by @sanderegg
• ⬆️ Upgrade api-server requirements and includes pagination library #4411 by @pcrespov
• ✨ Personalized resource limits: add API to change node resources ⚠️🗃️ #4374 by @sanderegg
• 🐛 Bugfix: FP extractLabelFromLink + Announcement Validator #4414 by @odeimaiz
• 🐛 increase time before killing migration app #4418 by @sanderegg
• ✨ Previews: 2D images and 3D scenes #4412 by @odeimaiz

Staging Watermelon4

Release Issue: #4454

• 🐛 🗃️ fix resource tracking not starting + adding project uuid to tracking table #4416 by @matusdrobuliak66
• ♻️Storage API specs are now autogenerated 🚨 #4413 by @GitHK
• ✨Frontend: Personalized resource limits #4415 by @odeimaiz
• ✨ Is994/resource tracking service auto populate missing data #4420 by @matusdrobuliak66
• ♻️Maintenance: webserver openapi users now auto-generated #4424 by @sanderegg
• 🐛 Fix webserver storage OpenAPI schema #4426 by @GitHK
• ♻️ Moves webserver's projects api models to models_library #4425 by @pcrespov
• ✨Personalized resource limits: only allow specific groups to override resources #4417 by @sanderegg
• ✨Maintenance: add Ruff #4432 by @sanderegg
• ♻️Personalized resource limits: remove services limitations table 🗃️ #4428 by @sanderegg
• 🎨🐛Maintenance: fix CI build image issue #4434 by @sanderegg
• 🚚 fix name of client repo #4372 by @bisgaard-itis
• ✨ API jobs pagination (1st round) #4407 by @pcrespov
• ♻️ Renames osparc environments as osparc variables and secrets #4443 by @pcrespov

Staging Watermelon5

Release Issue: #4482

• ✨ Frontend: ask backend for override services specifications #4446 by @odeimaiz
• 🐛Personalized-resource-limits: return default value when no product is defined #4449 by @sanderegg
• ♻️ Updates public API openapi specs (under dev) and cleanup #4437 by @pcrespov
• ✨ 🗃️ (⚠️ DEVOPS) Is995/resource tracking list containers #4445 by @matusdrobuliak66
• 🎨 Frontend: Improve study homepage #4451 by @odeimaiz
• ✨Computational backend: passing labels and envs 🗃️ #4429 by @sanderegg
• ♻️ Maintenance: Enhanced logs on sms service errors and tests image labels #4456 by @pcrespov
• ♻️ Maintenance: Remove director-v0 client from webserver #4461 by @sanderegg
• ✨ Computational backend: set container limits as labels ⚠️ (devops checks on grafana dashboards!) 🚨 #4453 by @sanderegg
• ✨ Frontend: Usage overview #4455 by @odeimaiz
• 🐛upgrade dask-sidecar cuda version to properly detect GPU nodes #4466 by @sanderegg
• 📝 Document backwards compatibility #4457 by @bisgaard-itis
• 🔨 Update public api system tests #4444 by @bisgaard-itis
• ♻️ Updated models for job/studies metadata in public-api #4465 by @pcrespov
• 🐛 Fixes replace operation in projects and uninitialized variable in health-check  #4469 by @pcrespov
• ✨ Adds custom project's metadata in the webserver API #4421 by @pcrespov

No response

Devops check 👷

• Prometheus retention time was shortened on dalco-prod ( https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/166805fa3988198562a1712fbbecde2e1a9fd43c ): Monitoring stack needs to be restarted and the functionaility of prometheus / grafana after the reboot needs to be checked. @mrnicegyu11
• Assure Propagate changes of repo.config in master to all deploys  osparc-ops-environments#255 correctly propagates @pcrespov
• Add changes (if any) and release tags in https://github.com/ITISFoundation/osparc-ops-environments/tags @mrnicegyu11
• Add changes (if any) and release tags in osparc-ops-deployment-configuration (osparc.io & osparc.speag.com & tip.itis.swiss) @mrnicegyu11
• 4 new ENV vars need to be added to the osparc-ops-deployment-configuration (to all deployments) @matusdrobuliak66
  • RESOURCE_USAGE_TRACKER_PROMETHEUS_URL
  • RESOURCE_USAGE_TRACKER_PROMETHEUS_USERNAME
  • RESOURCE_USAGE_TRACKER_PROMETHEUS_PASSWORD
  • RESOURCE_USAGE_TRACKER_HOST
• Double-check when deploying to production whether there are no data in the resource_tracker_container_table @matusdrobuliak66
• ♻️Storage API specs are now autogenerated 🚨 #4413 @GitHK
• ✨ Computational backend: set container limits as labels ⚠️ (devops checks on grafana dashboards!) 🚨 #4453 @GitHK
• Double check the invitation service password! @mrnicegyu11 @matusdrobuliak66

Tests assessment: e2e testing check 🧪

No response

Test assessment: targeted-testing 🔍️

No response

Test assessment: user-testing 🧐

No response

Summary 📝

• Prepare release link

make release-prod version=1.56.0  git_sha=9e9e23417cc6a5df98f34761c52bf1023e55e667

• Draft release changelog
• Announce maintenance ( ** ANNOUNCE AT LEAST 24 HOURS BEFORE ** )
• redis {"start": "2023-07-13T12:00:00.000Z", "end": "2023-07-13T13:30:00.000Z", "reason": "Release 1.56.0"}
  • aws
  • dalco
  • tip
• status page (https://manage.statuspage.io/)
  • osparc
  • s4l
• mattermost channels
  • maintenance
  • power users

Releasing 🚀

• Maintenance page up.

cd /deployment/production/osparc-ops-environments
make up-maintenance
make down-maintenance

• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Release by publishing draft
• Check release CI
• Check deployed
  • aws deploy
  • dalco deploy
  • tip deploy
• Check testing endpoint ex. https://testing.osparc.speag.com/
• Delete announcement
• Check e2e runs
• Announce

:tada: https://github.com/ITISFoundation/osparc-simcore/releases/tag/v<M.m.0>

[matusdrobuliak66]

(⚠️ DEV-OPS) Set auto-deployment agent on all production deployments to scale 0 as default value

[matusdrobuliak66]

(⚠️ DEV-OPS) I have seen some pending maintenance on AWS Production RDS: New Operating System Update is available

[mrnicegyu11]

(⚠️ DEV-OPS) dalco prometheus was running out of RAM and was constantly restarting. I have on machine daclo01 manually decreased the retention time to 90d, which will propagate upon the next prod release (see: https://git.speag.com/oSparc/osparc-ops-deployment-configuration/-/commit/f842e70a36c7d289a4dd41e6fc39c1786dc43115 ). Also, I have manually increased prometheus RAM on all production deployments.

Tasks during the release:

• The monitoring stacks should be re-created on all deployments
• It needs to be made sure that prometheus starts and runs stably for some minutes on all deployments
• It needs to be made sure that the change of retention time to 90d on dalco is in place and no data shorter than 90d is somehow lost

[mrnicegyu11]

@YuryHrytsuk and me looked at it, looks good. All devops changes acknowledged.

• The deployment agent is already scaled to 0 replica on all production deployments
• Other devops tasks listed are clear and actionable

[GitHK]

ask me tomorrow to have a look for #4453

[GitHK]

No issues on all 3 deployments with #4453
I'm OK to release

[matusdrobuliak66]

Prolonging the release by 1. hour

[matusdrobuliak66]

Release Notes:

• release CI was confused when the already hotfix branch was prepared before the release
• DB migration needed to be restarted on Dalco Production (during migration the container restarted which caused confusion for the DB)
• Invitation service password needed to be manually changed (still problem with the special characters)

[matusdrobuliak66]

Right after the release, we needed to modify the invitation password (remove special characters) in the invitation service env vars. DevOps will look into it.

[matusdrobuliak66]

AWS DB upgrade was not done, should be done next time.