✨ Enhancement/improve progress messages

[sanderegg]

What do these changes do?

Brings more progress messages to the frontend:

• cluster up-scaling
• sidecar image pulling (might come later)
• state push/pull
• inputs pull
• outputs pull
• service image pulling
• comp. service running

This PR enables a new exchange in RabbitMQ for progress information.
This progress are forwarded to the webclient with the nodeProgress event that contains:

{
  "user_id": int,
  "project_id": uuid,
  "node_id": uuid,
  "progress_type": str,
  "progress": 0-1.0
}

progress type can be of the following:

"COMPUTATION_RUNNING"

"CLUSTER_UP_SCALING"
"SIDECAR_PULLING"
"SERVICE_INPUTS_PULLING"
"SERVICE_OUTPUTS_PULLING"
"SERVICE_STATE_PULLING"
"SERVICE_IMAGES_PULLING"

"SERVICE_STATE_PUSHING"
"SERVICE_OUTPUTS_PUSHING"

NOTE:
for the SERVICE_IMAGES_PULLING as well as for SIDECAR_PULLING it is not possible to know the layer sizes a priori. therefore the progress might "go back in time"

Bonus:

• log messages now contain a log level based on python logging system as an int
• fix regex for docker generic tags such as envoyproxy/envoy:latest

Related issue/s

How to test

Checklist

[codecov]

Codecov Report

Merging #3773 (177b882) into master (cca02d0) will increase coverage by 1.3%.
The diff coverage is 68.5%.

@@           Coverage Diff            @@
##           master   #3773     +/-   ##
========================================
+ Coverage    84.8%   86.2%   +1.3%     
========================================
  Files         915     759    -156     
  Lines       38866   34795   -4071     
  Branches      791     387    -404     
========================================
- Hits        32978   29994   -2984     
+ Misses       5678    4696    -982     
+ Partials      210     105    -105     

Flag	Coverage Δ
integrationtests	66.8% <76.9%> (-0.1%)	⬇️
unittests	83.0% <65.7%> (+1.0%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...s/models-library/src/models_library/basic_regex.py	100.0% <ø> (ø)
...rector_v2/modules/comp_scheduler/dask_scheduler.py	89.4% <ø> (ø)
...e_service_director_v2/modules/projects_networks.py	75.2% <ø> (ø)
...c/simcore_service_dynamic_sidecar/core/rabbitmq.py	92.0% <40.0%> (-5.8%)	⬇️
...imcore_service_autoscaling/dynamic_scaling_core.py	87.1% <55.0%> (-3.3%)	⬇️
...mcore_service_dynamic_sidecar/core/docker_utils.py	75.0% <55.1%> (-25.0%)	⬇️
...src/simcore_sdk/node_ports_common/file_io_utils.py	88.7% <55.5%> (+0.3%)	⬆️
...vice_dynamic_sidecar/modules/long_running_tasks.py	92.1% <57.1%> (-1.8%)	⬇️
...simcore_service_webserver/computation_subscribe.py	95.3% <75.0%> (-3.0%)	⬇️
.../src/simcore_service_autoscaling/utils/rabbitmq.py	96.7% <83.3%> (-3.3%)	⬇️
... and 170 more

[odeimaiz]

👍

[GitHK]

👍

[pcrespov]

Great! some comments

[codeclimate]

Code Climate has analyzed commit 177b882 and detected 0 issues on this pull request.

View more on Code Climate.

[sonarcloud]

Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
1 Code Smell

No Coverage information
0.0% Duplication