[OTE-TEST] Disable obsolete test cases #1220

harimkang · 2022-08-24T06:21:12Z

Summary

This PR includes :

Remove (Change to skip) some model template test cases for OTE-CI test (some external backend's API & performance tests)
Fixed some library version conflict issue (in OTE CI venv)
Fixed some test cases not working (MPA ote_cli tests)
Add MPA pre-commit tests (not for pydocstyle -> will check it out later)
Resolve prettier issue (data/car_tree_bug/annotations/hierarchical_default.json)
Resolve black issue (ote_cli/ote_cli/utils/hpo.py)

Result of this PR

validation-report: http://validationreports.sclab.intel.com:8006/reports/build_number_report?test_session_build_number=pr-ote-test-590&environment=iotg-dev-workstation-17

harimkang · 2022-09-16T01:22:14Z

run ote-test

external/model-preparation-algorithm/init_venv.sh

external/model-preparation-algorithm/tests/ote_cli/test_detection.py

external/model-preparation-algorithm/tests/ote_cli/test_segmentation.py

goodsong81

LGTM. What a job!

JihwanEom

LGTM! Thanks for your effort!

harimkang · 2022-09-16T07:20:05Z

validation-report: http://validationreports.sclab.intel.com:8006/reports/build_number_report?test_session_build_number=pr-ote-test-599&environment=iotg-dev-workstation-17
This PR is for OTE-CI to work properly, so i will merge it here and solve the FAILED test in other PRs.

…1284) * Update submodule branch (#1222) * Enhance training schedule for multi-label classification (#1212) * [CVS-88098] Remove initialize from export functions (#1226) * Train graph added (#1211) Co-authored-by: Lee, Soobee <[email protected]> * Add @attrs decorator for base configs (#1229) Signed-off-by: Songki Choi <[email protected]> Co-authored-by: Harim Kang <[email protected]> * Pretrained weight download error in MobilenetV3-large-1 of deep-object-reid in SC (#1233) * [Anomaly Task] Revert hpo template (#1230) * 🐞 [Anomaly Task] Fix progress bar (#1223) * [CVS-90555] Fix NaN value in classification (#1244) * update hpo_config.yaml (#1240) * [CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248) * Turned off pruning_support visibility for anomaly models (CVS-91015) * Disabled pruning for EfficientNet-V2-S (CVS-90400) * [Anomaly Task] 🐞 Fix inference when model backbone changes (#1242) * Fix CVS-91469 sseg compatibility issue * [CVS-91472] Add pruning_supported value (#1263) * Pruning supported tweaks (#1256) * [CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248) * Turned off pruning_support visibility for anomaly models (CVS-91015) * Disabled pruning for EfficientNet-V2-S (CVS-90400) * Revert "[CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248)" (#1269) * [OTE-TEST] Disable obsolete test cases (#1220) * [OTE-TEST] hot-fix for MPA performance tests (#1273) * Expose early stopping hyper-parameters for all tasks (#1241) * Resolve pre-commit issues (#1272) * Remove LazyEarlyStopHook in model_multilabel.py (#1281) * Removed xfail (#1239) Signed-off-by: Songki Choi <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Jaeguk Hyun <[email protected]> Co-authored-by: Nikita Savelyev <[email protected]> Co-authored-by: Vladisalv Sovrasov <[email protected]> Co-authored-by: Jihwan Eom <[email protected]> Co-authored-by: Songki Choi <[email protected]> Co-authored-by: Soobee Lee <[email protected]> Co-authored-by: Lee, Soobee <[email protected]> Co-authored-by: Eugene Liu <[email protected]> Co-authored-by: Emily Chun <[email protected]> Co-authored-by: ljcornel <[email protected]> Co-authored-by: Eunwoo Shin <[email protected]>

* Add tiling module (#1200) * Update submodule branch (#1222) * Enhance training schedule for multi-label classification (#1212) * [CVS-88098] Remove initialize from export functions (#1226) * Train graph added (#1211) * Add @attrs decorator for base configs (#1229) * Pretrained weight download error in MobilenetV3-large-1 of deep-object-reid in SC (#1233) * [Anomaly Task] Revert hpo template (#1230) * 🐞 [Anomaly Task] Fix progress bar (#1223) * [CVS-90555] Fix NaN value in classification (#1244) * update hpo_config.yaml (#1240) * [CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248) * [Anomaly Task] 🐞 Fix inference when model backbone changes (#1242) * [CVS-91472] Add pruning_supported value (#1263) * Pruning supported tweaks (#1256) * [CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248) * Revert "[CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248)" (#1269) * [OTE-TEST] Disable obsolete test cases (#1220) * [OTE-TEST] hot-fix for MPA performance tests (#1273) * [Anomaly Task] ✨ Upgrade anomalib (#1243) * Expose early stopping hyper-parameters for all tasks (#1241) * Resolve pre-commit issues (#1272) * Remove LazyEarlyStopHook in model_multilabel.py (#1281) * Removed xfail (#1239) * Implement IB loss for incremental learning in multi-class classification (#1289) * Edit num_workers and change MPA repo as a latest (#1314) * fix annotation bug (#1320) * Valid POT configs for small HRNet models (#1313) * Disable NNCF optimization for FP16 models (#1312) * fliter object less than 1 pixel (#1305) * Fix some tests (#1322) * [Develop] Move drop_last into MPA (#1357) * Apply changes from releases/v0.3.1-geti1.0.0 (#1337) * anomaly save_model bugfix (#1300) * upgrade networkx module version (#1303) * Forward CVS-94422 size bug fix PR to release branch (#1326) * Valid POT configs for small HRNet models (#1317) * [Release branch] Disable NNCF optimization for FP16 models (#1319) * [RELEASE] CVS-95549 - Hierarchical classification training failed without obvious reason (#1329) * Fix h-label: per-group softmax (#1332) * Fix dataset length bug in mpa task (#1338) * Fix drop_last key issue for det/set (#1340) * Hot-fix for OV inference for iseg output (#1345) * Fix nncf model export bug (#1346) * Fixed merge error (#1359) * Update evaluation iou_thr of ins-seg (#1354) * fix pre-commit test (#1366) * Fix dataset item tests (#1360) * Fix OV Inference issues (tiling tests & detection tests) (#1361) * fix black & add xfail test cases (#1367) * Update check_nncf_graph. (#1330) * [Develop] Hot-fix OV inference issue in rotated detection (#1375) * [Develop] updated documents (#1383) * [CVS-94911] Fix difference between train and validation normalization pipeline (#1310) * Update configs for padim model (#1378) * updated QUICK_START_GUIDE.md (#1397) * Change ote threshold of openvino test for cls (#1401) * Normalize top-1 metrics to [0, 1] (#1394) * Tiling deployment (#1387) * Replace current saliency map generation with Recipro-CAM for cls (#1363) * Class-wise saliency map generation for the detection task (#1402) * Change submodule to develop (#1410) * Send full dataset to POT optimization function (#1379) & Convert NaN to num to make visible in geti UI (#1413) * Add active score evaluation to the classification task * [release/0.4.0][OTX] Enabling GPU execution for exported code (#1416) * [OTE][Release][XAI] Detection fix two stage bbox_head error (#1414) * Update SDK commit for exportable code (#1423) * HRNet-x and HRNe-18--mod2 configs update (#1419) * [Release] Enable tiling oriented detection for v0.4.0/geti1.1.0 (#1427) * [OTE][Releases v0.4.0][XAI] Hot-fix for Detection fix two stage error (#1433) * Temporary MPA branch while dev->otx merge process * Update doc & install for dev->otx changes * Update ote_sdk -> otx.api * Update ote_cli -> otx.cli * Update external/mmsegmentation -> otx/algorithms/segmentation * Align saliency map media instantiation over tasks (#1447) * Update external/d-o-r -> otx/algorithms/classification * Update external/mmdetection -> otx/algorithms/detection * Update external/mpa -> otx/algorithms/* * Fix CLI test run for better error message * Numpy constraint for deprecated np.bool error * Capture stderr only * Align numpy requirement * [OTX/Anomaly] Add changes from external to otx (#1452) * Add changes from external to otx * Address PR comments * Update config files + remove backbone from base * Fix pre-merge checks * Fix pre-commit issues * Update exportable code commit * Fix indent error * Fix flake8 issue * Resolve softmax issue w/ FIXME for future work * Add tiling tests * Revert MPA branch to otx Signed-off-by: Songki Choi <[email protected]> Co-authored-by: Eugene Liu <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Jaeguk Hyun <[email protected]> Co-authored-by: Nikita Savelyev <[email protected]> Co-authored-by: Jihwan Eom <[email protected]> Co-authored-by: Harim Kang <[email protected]> Co-authored-by: Soobee Lee <[email protected]> Co-authored-by: Lee, Soobee <[email protected]> Co-authored-by: Emily Chun <[email protected]> Co-authored-by: ljcornel <[email protected]> Co-authored-by: Eunwoo Shin <[email protected]> Co-authored-by: dlyakhov <[email protected]> Co-authored-by: kprokofi <[email protected]> Co-authored-by: Sungman Cho <[email protected]> Co-authored-by: Yunchu Lee <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Alexander Dokuchaev <[email protected]> Co-authored-by: Vladislav Sovrasov <[email protected]> Co-authored-by: Evgeny Tsykunov <[email protected]> Co-authored-by: Galina Zalesskaya <[email protected]> Co-authored-by: dongkwan-kim <[email protected]>

* make logfile saved in save-model-to directory * enable train * make main process train also * bugfix * refactor multi gpu training * make all processs have same output path * prevent child process from being termated by fokred main process * refactor multigpu implementation * refactor multi gpu implementation * modify argument help sentence * add multi gpu test code * align with pre-commit test * separate multi GPU manager class * modify train cli argument 'save-logs-to' to 'output-path' * remove tray excpet during killing child process * apply output_path to all tasks * change print to logger * skip multi gpu test if number of gpu is insufficient * fix typo * multi gpu test bugfix * isort fix * test case bugfix * fix typo and change some variable name * [OTX] Apply changes in develop to feature/otx branch (#1436) * Add tiling module (#1200) * Update submodule branch (#1222) * Enhance training schedule for multi-label classification (#1212) * [CVS-88098] Remove initialize from export functions (#1226) * Train graph added (#1211) * Add @attrs decorator for base configs (#1229) * Pretrained weight download error in MobilenetV3-large-1 of deep-object-reid in SC (#1233) * [Anomaly Task] Revert hpo template (#1230) * 🐞 [Anomaly Task] Fix progress bar (#1223) * [CVS-90555] Fix NaN value in classification (#1244) * update hpo_config.yaml (#1240) * [CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248) * [Anomaly Task] 🐞 Fix inference when model backbone changes (#1242) * [CVS-91472] Add pruning_supported value (#1263) * Pruning supported tweaks (#1256) * [CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248) * Revert "[CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248)" (#1269) * [OTE-TEST] Disable obsolete test cases (#1220) * [OTE-TEST] hot-fix for MPA performance tests (#1273) * [Anomaly Task] ✨ Upgrade anomalib (#1243) * Expose early stopping hyper-parameters for all tasks (#1241) * Resolve pre-commit issues (#1272) * Remove LazyEarlyStopHook in model_multilabel.py (#1281) * Removed xfail (#1239) * Implement IB loss for incremental learning in multi-class classification (#1289) * Edit num_workers and change MPA repo as a latest (#1314) * fix annotation bug (#1320) * Valid POT configs for small HRNet models (#1313) * Disable NNCF optimization for FP16 models (#1312) * fliter object less than 1 pixel (#1305) * Fix some tests (#1322) * [Develop] Move drop_last into MPA (#1357) * Apply changes from releases/v0.3.1-geti1.0.0 (#1337) * anomaly save_model bugfix (#1300) * upgrade networkx module version (#1303) * Forward CVS-94422 size bug fix PR to release branch (#1326) * Valid POT configs for small HRNet models (#1317) * [Release branch] Disable NNCF optimization for FP16 models (#1319) * [RELEASE] CVS-95549 - Hierarchical classification training failed without obvious reason (#1329) * Fix h-label: per-group softmax (#1332) * Fix dataset length bug in mpa task (#1338) * Fix drop_last key issue for det/set (#1340) * Hot-fix for OV inference for iseg output (#1345) * Fix nncf model export bug (#1346) * Fixed merge error (#1359) * Update evaluation iou_thr of ins-seg (#1354) * fix pre-commit test (#1366) * Fix dataset item tests (#1360) * Fix OV Inference issues (tiling tests & detection tests) (#1361) * fix black & add xfail test cases (#1367) * Update check_nncf_graph. (#1330) * [Develop] Hot-fix OV inference issue in rotated detection (#1375) * [Develop] updated documents (#1383) * [CVS-94911] Fix difference between train and validation normalization pipeline (#1310) * Update configs for padim model (#1378) * updated QUICK_START_GUIDE.md (#1397) * Change ote threshold of openvino test for cls (#1401) * Normalize top-1 metrics to [0, 1] (#1394) * Tiling deployment (#1387) * Replace current saliency map generation with Recipro-CAM for cls (#1363) * Class-wise saliency map generation for the detection task (#1402) * Change submodule to develop (#1410) * Send full dataset to POT optimization function (#1379) & Convert NaN to num to make visible in geti UI (#1413) * Add active score evaluation to the classification task * [release/0.4.0][OTX] Enabling GPU execution for exported code (#1416) * [OTE][Release][XAI] Detection fix two stage bbox_head error (#1414) * Update SDK commit for exportable code (#1423) * HRNet-x and HRNe-18--mod2 configs update (#1419) * [Release] Enable tiling oriented detection for v0.4.0/geti1.1.0 (#1427) * [OTE][Releases v0.4.0][XAI] Hot-fix for Detection fix two stage error (#1433) * Temporary MPA branch while dev->otx merge process * Update doc & install for dev->otx changes * Update ote_sdk -> otx.api * Update ote_cli -> otx.cli * Update external/mmsegmentation -> otx/algorithms/segmentation * Align saliency map media instantiation over tasks (#1447) * Update external/d-o-r -> otx/algorithms/classification * Update external/mmdetection -> otx/algorithms/detection * Update external/mpa -> otx/algorithms/* * Fix CLI test run for better error message * Numpy constraint for deprecated np.bool error * Capture stderr only * Align numpy requirement * [OTX/Anomaly] Add changes from external to otx (#1452) * Add changes from external to otx * Address PR comments * Update config files + remove backbone from base * Fix pre-merge checks * Fix pre-commit issues * Update exportable code commit * Fix indent error * Fix flake8 issue * Resolve softmax issue w/ FIXME for future work * Add tiling tests * Revert MPA branch to otx Signed-off-by: Songki Choi <[email protected]> Co-authored-by: Eugene Liu <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Jaeguk Hyun <[email protected]> Co-authored-by: Nikita Savelyev <[email protected]> Co-authored-by: Jihwan Eom <[email protected]> Co-authored-by: Harim Kang <[email protected]> Co-authored-by: Soobee Lee <[email protected]> Co-authored-by: Lee, Soobee <[email protected]> Co-authored-by: Emily Chun <[email protected]> Co-authored-by: ljcornel <[email protected]> Co-authored-by: Eunwoo Shin <[email protected]> Co-authored-by: dlyakhov <[email protected]> Co-authored-by: kprokofi <[email protected]> Co-authored-by: Sungman Cho <[email protected]> Co-authored-by: Yunchu Lee <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Alexander Dokuchaev <[email protected]> Co-authored-by: Vladislav Sovrasov <[email protected]> Co-authored-by: Evgeny Tsykunov <[email protected]> Co-authored-by: Galina Zalesskaya <[email protected]> Co-authored-by: dongkwan-kim <[email protected]> * Apply latest MPA openvinotoolkit/model_preparation_algorithm#105 Signed-off-by: Songki Choi <[email protected]> Signed-off-by: Songki Choi <[email protected]> Co-authored-by: eunwoosh <[email protected]> Co-authored-by: Eugene Liu <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Jaeguk Hyun <[email protected]> Co-authored-by: Nikita Savelyev <[email protected]> Co-authored-by: Jihwan Eom <[email protected]> Co-authored-by: Harim Kang <[email protected]> Co-authored-by: Soobee Lee <[email protected]> Co-authored-by: Lee, Soobee <[email protected]> Co-authored-by: Emily Chun <[email protected]> Co-authored-by: ljcornel <[email protected]> Co-authored-by: dlyakhov <[email protected]> Co-authored-by: kprokofi <[email protected]> Co-authored-by: Sungman Cho <[email protected]> Co-authored-by: Yunchu Lee <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Alexander Dokuchaev <[email protected]> Co-authored-by: Vladislav Sovrasov <[email protected]> Co-authored-by: Evgeny Tsykunov <[email protected]> Co-authored-by: Galina Zalesskaya <[email protected]> Co-authored-by: dongkwan-kim <[email protected]>

* Initial commit: integrate MPA intothe OTX * Update Self-SL for seg * Enable pre-commit tests by ignoring imports, remove useless requirements * Edit the requirements * Add dist folder * fix black * [OTX] Rebase latest changes for MPA merge (#1468) * make logfile saved in save-model-to directory * enable train * make main process train also * bugfix * refactor multi gpu training * make all processs have same output path * prevent child process from being termated by fokred main process * refactor multigpu implementation * refactor multi gpu implementation * modify argument help sentence * add multi gpu test code * align with pre-commit test * separate multi GPU manager class * modify train cli argument 'save-logs-to' to 'output-path' * remove tray excpet during killing child process * apply output_path to all tasks * change print to logger * skip multi gpu test if number of gpu is insufficient * fix typo * multi gpu test bugfix * isort fix * test case bugfix * fix typo and change some variable name * [OTX] Apply changes in develop to feature/otx branch (#1436) * Add tiling module (#1200) * Update submodule branch (#1222) * Enhance training schedule for multi-label classification (#1212) * [CVS-88098] Remove initialize from export functions (#1226) * Train graph added (#1211) * Add @attrs decorator for base configs (#1229) * Pretrained weight download error in MobilenetV3-large-1 of deep-object-reid in SC (#1233) * [Anomaly Task] Revert hpo template (#1230) * 🐞 [Anomaly Task] Fix progress bar (#1223) * [CVS-90555] Fix NaN value in classification (#1244) * update hpo_config.yaml (#1240) * [CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248) * [Anomaly Task] 🐞 Fix inference when model backbone changes (#1242) * [CVS-91472] Add pruning_supported value (#1263) * Pruning supported tweaks (#1256) * [CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248) * Revert "[CVS-90400, CVS-91015] NNCF pruning supported tweaks (#1248)" (#1269) * [OTE-TEST] Disable obsolete test cases (#1220) * [OTE-TEST] hot-fix for MPA performance tests (#1273) * [Anomaly Task] ✨ Upgrade anomalib (#1243) * Expose early stopping hyper-parameters for all tasks (#1241) * Resolve pre-commit issues (#1272) * Remove LazyEarlyStopHook in model_multilabel.py (#1281) * Removed xfail (#1239) * Implement IB loss for incremental learning in multi-class classification (#1289) * Edit num_workers and change MPA repo as a latest (#1314) * fix annotation bug (#1320) * Valid POT configs for small HRNet models (#1313) * Disable NNCF optimization for FP16 models (#1312) * fliter object less than 1 pixel (#1305) * Fix some tests (#1322) * [Develop] Move drop_last into MPA (#1357) * Apply changes from releases/v0.3.1-geti1.0.0 (#1337) * anomaly save_model bugfix (#1300) * upgrade networkx module version (#1303) * Forward CVS-94422 size bug fix PR to release branch (#1326) * Valid POT configs for small HRNet models (#1317) * [Release branch] Disable NNCF optimization for FP16 models (#1319) * [RELEASE] CVS-95549 - Hierarchical classification training failed without obvious reason (#1329) * Fix h-label: per-group softmax (#1332) * Fix dataset length bug in mpa task (#1338) * Fix drop_last key issue for det/set (#1340) * Hot-fix for OV inference for iseg output (#1345) * Fix nncf model export bug (#1346) * Fixed merge error (#1359) * Update evaluation iou_thr of ins-seg (#1354) * fix pre-commit test (#1366) * Fix dataset item tests (#1360) * Fix OV Inference issues (tiling tests & detection tests) (#1361) * fix black & add xfail test cases (#1367) * Update check_nncf_graph. (#1330) * [Develop] Hot-fix OV inference issue in rotated detection (#1375) * [Develop] updated documents (#1383) * [CVS-94911] Fix difference between train and validation normalization pipeline (#1310) * Update configs for padim model (#1378) * updated QUICK_START_GUIDE.md (#1397) * Change ote threshold of openvino test for cls (#1401) * Normalize top-1 metrics to [0, 1] (#1394) * Tiling deployment (#1387) * Replace current saliency map generation with Recipro-CAM for cls (#1363) * Class-wise saliency map generation for the detection task (#1402) * Change submodule to develop (#1410) * Send full dataset to POT optimization function (#1379) & Convert NaN to num to make visible in geti UI (#1413) * Add active score evaluation to the classification task * [release/0.4.0][OTX] Enabling GPU execution for exported code (#1416) * [OTE][Release][XAI] Detection fix two stage bbox_head error (#1414) * Update SDK commit for exportable code (#1423) * HRNet-x and HRNe-18--mod2 configs update (#1419) * [Release] Enable tiling oriented detection for v0.4.0/geti1.1.0 (#1427) * [OTE][Releases v0.4.0][XAI] Hot-fix for Detection fix two stage error (#1433) * Temporary MPA branch while dev->otx merge process * Update doc & install for dev->otx changes * Update ote_sdk -> otx.api * Update ote_cli -> otx.cli * Update external/mmsegmentation -> otx/algorithms/segmentation * Align saliency map media instantiation over tasks (#1447) * Update external/d-o-r -> otx/algorithms/classification * Update external/mmdetection -> otx/algorithms/detection * Update external/mpa -> otx/algorithms/* * Fix CLI test run for better error message * Numpy constraint for deprecated np.bool error * Capture stderr only * Align numpy requirement * [OTX/Anomaly] Add changes from external to otx (#1452) * Add changes from external to otx * Address PR comments * Update config files + remove backbone from base * Fix pre-merge checks * Fix pre-commit issues * Update exportable code commit * Fix indent error * Fix flake8 issue * Resolve softmax issue w/ FIXME for future work * Add tiling tests * Revert MPA branch to otx Signed-off-by: Songki Choi <[email protected]> Co-authored-by: Eugene Liu <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Jaeguk Hyun <[email protected]> Co-authored-by: Nikita Savelyev <[email protected]> Co-authored-by: Jihwan Eom <[email protected]> Co-authored-by: Harim Kang <[email protected]> Co-authored-by: Soobee Lee <[email protected]> Co-authored-by: Lee, Soobee <[email protected]> Co-authored-by: Emily Chun <[email protected]> Co-authored-by: ljcornel <[email protected]> Co-authored-by: Eunwoo Shin <[email protected]> Co-authored-by: dlyakhov <[email protected]> Co-authored-by: kprokofi <[email protected]> Co-authored-by: Sungman Cho <[email protected]> Co-authored-by: Yunchu Lee <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Alexander Dokuchaev <[email protected]> Co-authored-by: Vladislav Sovrasov <[email protected]> Co-authored-by: Evgeny Tsykunov <[email protected]> Co-authored-by: Galina Zalesskaya <[email protected]> Co-authored-by: dongkwan-kim <[email protected]> * Apply latest MPA openvinotoolkit/model_preparation_algorithm#105 Signed-off-by: Songki Choi <[email protected]> Signed-off-by: Songki Choi <[email protected]> Co-authored-by: eunwoosh <[email protected]> Co-authored-by: Eugene Liu <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Jaeguk Hyun <[email protected]> Co-authored-by: Nikita Savelyev <[email protected]> Co-authored-by: Jihwan Eom <[email protected]> Co-authored-by: Harim Kang <[email protected]> Co-authored-by: Soobee Lee <[email protected]> Co-authored-by: Lee, Soobee <[email protected]> Co-authored-by: Emily Chun <[email protected]> Co-authored-by: ljcornel <[email protected]> Co-authored-by: dlyakhov <[email protected]> Co-authored-by: kprokofi <[email protected]> Co-authored-by: Sungman Cho <[email protected]> Co-authored-by: Yunchu Lee <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Alexander Dokuchaev <[email protected]> Co-authored-by: Vladislav Sovrasov <[email protected]> Co-authored-by: Evgeny Tsykunov <[email protected]> Co-authored-by: Galina Zalesskaya <[email protected]> Co-authored-by: dongkwan-kim <[email protected]> * Resolve some flake8 issues * Fix semisl trainer import (#1471) Co-authored-by: Lee, Soobee <[email protected]> * Fixisort * Rebase and fix isort Signed-off-by: Songki Choi <[email protected]> Co-authored-by: Songki Choi <[email protected]> Co-authored-by: eunwoosh <[email protected]> Co-authored-by: Eugene Liu <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Jaeguk Hyun <[email protected]> Co-authored-by: Nikita Savelyev <[email protected]> Co-authored-by: Jihwan Eom <[email protected]> Co-authored-by: Harim Kang <[email protected]> Co-authored-by: Soobee Lee <[email protected]> Co-authored-by: Lee, Soobee <[email protected]> Co-authored-by: Emily Chun <[email protected]> Co-authored-by: ljcornel <[email protected]> Co-authored-by: dlyakhov <[email protected]> Co-authored-by: kprokofi <[email protected]> Co-authored-by: Yunchu Lee <[email protected]> Co-authored-by: Ashwin Vaidya <[email protected]> Co-authored-by: Alexander Dokuchaev <[email protected]> Co-authored-by: Vladislav Sovrasov <[email protected]> Co-authored-by: Evgeny Tsykunov <[email protected]> Co-authored-by: Galina Zalesskaya <[email protected]> Co-authored-by: dongkwan-kim <[email protected]>

Disable some models

ab556f5

harimkang added the DO NOT MERGE label Aug 24, 2022

github-actions bot added the ALGO Any changes in OTX Algo Tasks implementation label Aug 24, 2022

harimkang added ENHANCE Enhancement of existing features TEST Any changes in tests and removed ALGO Any changes in OTX Algo Tasks implementation labels Aug 26, 2022

Update test init

9d7bd3f

github-actions bot added ALGO Any changes in OTX Algo Tasks implementation and removed TEST Any changes in tests labels Aug 26, 2022

harimkang added 7 commits August 26, 2022 17:32

Disable mmdet Sample

bb1063a

Remove mmdet e2e test

038bd45

Remove training test

2e1aa1c

Change to Skip state for cli test

2536816

Reflect some fix

858ce86

Split test cases to tasks

c3a73e4

Set black & conftest flake

4ba9f2e

github-actions bot added the CLI Any changes in OTE CLI label Aug 30, 2022

ote_cli file naming change

7e12c22

github-actions bot added the TEST Any changes in tests label Aug 30, 2022

harimkang added 6 commits August 30, 2022 16:13

import issue fix

0dfcc9b

Fix some import

3c4d080

Fix filename for test cache

59154e9

Check for MPA tests

d29fce0

Collection issue

bb49046

cls req fix

223faa6

github-actions bot added the DEPENDENCY Any changes in any dependencies (new dep or its version) should be produced via Change Request on PM label Sep 5, 2022

Update mmdet const

6a4f6c7

github-actions bot removed the DEPENDENCY Any changes in any dependencies (new dep or its version) should be produced via Change Request on PM label Sep 5, 2022

harimkang added 2 commits September 5, 2022 15:31

Disable params tests

4766bd7

Remedy fix

410355c

harimkang added 6 commits September 7, 2022 13:15

Apply black format in MPA test codes

b09f8da

pytest initial setting fix

2f9bd88

Add MPA pre-commit tests

01f9de7

Add pre-commit to MPA

7947032

test_template_file to MPA & anomaly

422c786

Enable black format to test_template file

acb60fe

harimkang marked this pull request as ready for review September 15, 2022 00:22

harimkang requested a review from a team as a code owner September 15, 2022 00:22

harimkang removed the DO NOT MERGE label Sep 15, 2022

harimkang added 3 commits September 16, 2022 09:18

Rebase develop branch

61d8f53

Temporal disable pydocstyle test of MPA

860e86e

Change ote_cli tests train_params

078f9a2

harimkang requested review from chuneuny-emily, JihwanEom, jaegukhyun, goodsong81 and supersoob September 16, 2022 01:39

JihwanEom reviewed Sep 16, 2022

View reviewed changes

external/model-preparation-algorithm/init_venv.sh Show resolved Hide resolved

external/model-preparation-algorithm/tests/ote_cli/test_detection.py Show resolved Hide resolved

external/model-preparation-algorithm/tests/ote_cli/test_segmentation.py Show resolved Hide resolved

goodsong81 approved these changes Sep 16, 2022

View reviewed changes

JihwanEom approved these changes Sep 16, 2022

View reviewed changes

harimkang merged commit e08f547 into develop Sep 16, 2022

harimkang deleted the harimkan/disable-obsolete-tests branch September 16, 2022 07:21

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[OTE-TEST] Disable obsolete test cases #1220

[OTE-TEST] Disable obsolete test cases #1220

harimkang commented Aug 24, 2022 •

edited

Loading

harimkang commented Sep 16, 2022

goodsong81 left a comment

JihwanEom left a comment

harimkang commented Sep 16, 2022

[OTE-TEST] Disable obsolete test cases #1220

[OTE-TEST] Disable obsolete test cases #1220

Conversation

harimkang commented Aug 24, 2022 • edited Loading

Summary

This PR includes :

Result of this PR

harimkang commented Sep 16, 2022

goodsong81 left a comment

Choose a reason for hiding this comment

JihwanEom left a comment

Choose a reason for hiding this comment

harimkang commented Sep 16, 2022

harimkang commented Aug 24, 2022 •

edited

Loading