✨ Enhance compatibility-check for catalog service's ports including units

[pcrespov]

What do these changes do?

This PR enhances port's compatibility-check logic between catalog services which is used by the front-end to determine how "two services can connect" (see catalog_utils.py and screenshot below).

Port units are now parsed, validated and formatted using pint. Notice that this PR only adds this library on the catalog plugin.

Highlights

• Some new can_connect rules :
  • unitless can connect unit (and the contrary)
  • wider units compatibility (e.g. miles can connect with mm). Notice that in later PR we will introduce the conversion of these units when the data flows from one service to the next.
• service input/outputs models returned by API contains html-formated units in the fields unitLong and unitShort

Extras

• 🐛 gunicorn log uses same log level as app

Related issue/s

• M6 Support for unit conversion and detection of compatible ports osparc-issues#515

How to test

$ cd services/web/server
$ make install-dev
$ pytest --pdb -vv tests/**/test_catalog*.py

• test auto-connect using demo units function service
  

Checklist

• Adds units plugin? since will be used in catalog and projects?
  • creates instance in app
• Openapi changes? make openapi-specs, git commit ... and then make version-*)
• Unit tests for the changes exist
• Runs in the swarm
• Documentation reflects the changes

[codecov]

Codecov Report

Merging #2913 (4f279c3) into master (a920852) will increase coverage by 1.3%.
The diff coverage is 78.6%.

@@           Coverage Diff            @@
##           master   #2913     +/-   ##
========================================
+ Coverage    78.2%   79.6%   +1.3%     
========================================
  Files         671     671             
  Lines       27787   27828     +41     
  Branches     3224    3229      +5     
========================================
+ Hits        21743   22162    +419     
+ Misses       5259    4914    -345     
+ Partials      785     752     -33     

Flag	Coverage Δ
integrationtests	65.7% <34.5%> (+<0.1%)	⬆️
unittests	75.3% <78.6%> (+0.5%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
.../src/models_library/function_service/demo_units.py	100.0% <ø> (ø)
.../src/simcore_service_webserver/catalog_handlers.py	37.7% <25.0%> (-0.9%)	⬇️
...er/src/simcore_service_webserver/catalog_models.py	88.6% <73.6%> (-0.3%)	⬇️
...ver/src/simcore_service_webserver/catalog_utils.py	86.0% <86.0%> (ø)
...ls-library/src/models_library/projects_nodes_io.py	96.3% <100.0%> (+0.2%)	⬆️
...eb/server/src/simcore_service_webserver/catalog.py	100.0% <100.0%> (ø)
...rvice_datcore_adapter/utils/requests_decorators.py	71.0% <0.0%> (-7.9%)	⬇️
.../simcore_service_catalog/db/repositories/groups.py	72.9% <0.0%> (-5.5%)	⬇️
.../director/src/simcore_service_director/producer.py	62.7% <0.0%> (+1.0%)	⬆️
...tor_v2/modules/dynamic_sidecar/scheduler/events.py	93.7% <0.0%> (+1.1%)	⬆️
... and 41 more

[GitHK]

👍 Works for me, please check some questions and especially the yarl pinning. Not sure why we would like to do that.

[GitHK]

Could you add when this could be unpinned? I cannot find the reference from the comment.

[pcrespov]

what do you mean? I think the line 26 is pretty clear, ritgh? This is the test

osparc-simcore/services/web/server/tests/unit/isolated/test_utils.py

Line 54 in 6939ced

def test_yarl_url_compose_changed_with_latest_release():

[sanderegg]

Very cool, but please not ureg...

[KZzizzle]

very cool - excited to see this in action!

[odeimaiz]

👌