🚀 Pre-release master -> staging_sevenPeaks2

[matusdrobuliak66]

What kind of pre-release?

master branch

Sprint Name

sevenPeaks

Pre-release version

2

Commit SHA

a4d9fec

Did the commit CI suceeded?

• The commit CI succeeded.

Motivation

• Weekly release

What Changed

• ⬆️ Maintenance: upgrades invitations service requirements #4977 by @pcrespov
• ✨adding dynamic-scheduler service (⚠️ devops) #4973 by @GitHK
• ✨ adding background check for running services (⚠️ OPS) 🗃️  #4925 by @matusdrobuliak66
• ✨ webserver: payments-method RCP client and new one-time payments with payment-method #4979 by @pcrespov
• 🎨 releasing process: allow sprint names with numbers #4989 by @sanderegg
• ♻️ Improve release templates #4990 by @GitHK
• ✨ dynamic-sidecar receives prometheus metrics networks if defined ⚠️ #4986 by @GitHK
• ♻️ Maintenance: reduce code duplication #4982 by @pcrespov
• 🐛 Reduce DB connection locking in storage #4984 by @GitHK
• ✨ add default wallet getter #4985 by @bisgaard-itis
• ✨Computational autoscaling: find out which EC2 type is necessary #4975 by @sanderegg
• Bump @babel/traverse from 7.8.6 to 7.23.2 #4877 by @dependabot
• ♻️ director-v2 settings refactoring #4993 by @GitHK
• 📝 updated e2e local debug instructions #4978 by @GitHK
• ⬆️ Maintenance: upgrade of clusters-keeper #4997 by @sanderegg
• ⬆️ Maintenance: Upgrade of storage #4998 by @sanderegg
• 🎨 Add user_id to api server profile #5002 by @bisgaard-itis
• + Buttons missing in sim4life.io #4987 #5001 by @jsaq007
• 🔨 Removes respx library from base requirements listing (fastapi.in) #5003 by @pcrespov
• ✨♻️ Generates invitations with product (⚠️ devops) #4995 by @pcrespov
• 🐛 removed wrong injected metric from dynamic-sidecar #5005 by @GitHK
• 📝 Add update env reminder #5009 by @YuryHrytsuk
• 🐛 Attempt to fix 400 RequestTimeout when uploading to S3 ⚠️ #4996 by @GitHK
• 🐛Prevent autoscaling from creating workers indefinitely #5008 by @sanderegg
• ✨Clusters keeper: shutdown all workers on cluster close #5010 by @sanderegg
• ♻️ Computational backend: set RAM margin to 10% #5013 by @sanderegg
• ♻️ improve error handling of pricing plans in webserver #4980 by @matusdrobuliak66
• ♻️🎨 Invitations service responds with product #5007 by @pcrespov
• 🐛Director-v2: fix unit test #5018 by @sanderegg
• 🐛 parameterized serviceName in the e2e test #5016 by @matusdrobuliak66
• ✨ listen to wallet events in payment system #5012 by @matusdrobuliak66
• Share wallet bug #5021 by @ignapas
• ♻️Autoscaling: Debug logs for issue with scaling up #5025 by @sanderegg
• 📝 Maintenance: cleanup readme and vscode settings #5023 by @pcrespov
• 🐛 adding missing env var to docker-compose.yaml #5011 by @GitHK
• ✨ Re-introduce aws-library #5031 by @sanderegg
• 🐛Dynamic autoscaling: not scaling beside 1 machine #5026 by @sanderegg
• ♻️ Clusters-keeper: renamed ENV variables #5032 by @sanderegg

Devops check ⚠️ devops

• Add changes (if any) and release tags in https://github.com/ITISFoundation/osparc-ops-environments/tags
• Add changes (if any) and release tags in osparc-ops-deployment-configuration (staging.osparc.io & osparc-staging.speag.com)
• CHECK / ASSERT grafana_import pipeline stage fails in aws staging osparc-ops-environments#420

e2e testing check 🧪

No response

Summary 📝

• make release-staging name=sevenPeaks version=2 git_sha=a4d9fecdbc53dc354a5c44fc4a2cb1d82ceab3a9
  • https://github.com/ITISFoundation/osparc-simcore/releases/new?prerelease=1&target=<commit_sha>&tag=staging_<sprint_name><version>&title=Staging%20<sprint_name><version>
• Draft pre-release
• Announce (add redis key maintenance in every concerned deployment)

  {"start": "2023-02-01T12:30:00.000Z", "end": "2023-02-01T13:00:00.000Z", "reason": "Release ResistanceIsFutile9 "}

• Announce release in Mattermost

  :loud_sound:  Maintenance scheduled for **NAMED_DAY DD. MM from START_TIME - END_TIME**.
  =========================================================================
  
  @all Be aware that you will automatically be logged out and your projects stopped and saved during the maintenance time. Affected:
  *   [https://staging.osparc.io](https://staging.osparc.io/)
  *   [https://https://staging.s4l-lite.io/](https://https://staging.s4l-lite.io//)
  
  and on premises:
  *   [https://osparc-staging.speag.com](https://osparc-staging.speag.com/)
  *   [https://tip-staging.speag.com](https://tip-staging.speag.com/)
  *   [https://s4l-staging.speag.com](https://s4l-staging.speag.com/)
  *   [https://s4l-lite-staging.speag.com](https://s4l-lite-staging.speag.com/)
  
  
  Reason: Scheduled staging-release of STAGING_NAME_AND_VERSION.
  
  Thanks for your understanding and sorry for the inconveniences,
  
  Your friendly oSparc Team
  
  

Releasing

• Release (release draft)
• Check Release CI
• Check hanging sidecars. Helper command to run in director-v2 CLI simcore-service-director-v2 close-and-save-service <uuid>
• Check deployed
  • aws deploy
  • dalco deploy
• Delete announcement
• Check e2e runs
• Announce

https://github.com/ITISFoundation/osparc-simcore/releases/tag/staging_<sprint_name><version>

[matusdrobuliak66]

Summary:

• in dalco migration service successfully claimed that the job is done with the correct alembic version. but in was not migrated in reality when we checked in the DB. We needed to restart the migration service.
• New founding: When you re-pull the image and restart the service, it does not take the latest image!
• Director v0 had a health check problem therefore it was restarting and was not able to start (assumption: docker-swarm/docker resources problems, after all other services were deployed, the scaling director to 0 and back up helped)
• Clusters keeper environment variable CLUSTERS_KEEPER_EC2_SECRET_ACCESS_KEY was wrongly setup in the docker-compose.yml file therefore empty value was propagated (currently it was fixed manually in Portainer, in the next PR it will be fixed in the code)
• Cluster keeper could not start because he didn't have enough resources (OPS will have a look into it)