-
Notifications
You must be signed in to change notification settings - Fork 240
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update e2e tests to use convert_model #2152
Update e2e tests to use convert_model #2152
Conversation
c092836
to
eea552f
Compare
Codecov Report
Additional details and impacted files@@ Coverage Diff @@
## develop #2152 +/- ##
============================================
+ Coverage 36.60% 90.53% +53.92%
============================================
Files 485 486 +1
Lines 43722 43862 +140
============================================
+ Hits 16006 39709 +23703
+ Misses 27716 4153 -23563
Flags with carried forward coverage won't be shown. Click here to find out more. |
702e1ef
to
e919e08
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good to see usage of dataclasses, test fixtures and type hints - don't forget to take opportunities to set up type hints even if they weren't therer before.
2b9e02e
to
3c805f9
Compare
view/all/job/ci-maintenance/job/pt_e2e_tests/job/NNCF/job/nightly/job/TriggerBetta/55 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you provide summary results and builds?
@alexsu52 ci-maintenance/job/pt_e2e_tests/job/NNCF/job/nightly/job/TriggerBetta/75/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great stuff!!!
Changes
--export-model-path
instead of--to-onnx
that select output type by suffix '.xml' or '.onnx'.results.csv
.results.csv
.target_ov
andtarget_pt
to define reference metrics for backends.unet_mapillary_int8
andunet_mapillary_magnitude_sparsity_int8
models by 123448.resnet18_imagenet_binarization_dorefa
model by 22543.Updates in CI:
final e2e_result.html
for e2e tests.After merge requires update ci-pipelines.
Related tickets
117885
Tests
tests/torch/test_sota_checkpoints.py
TODO