Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure CI: Enable nGaph ONNX check #2631

Merged
merged 80 commits into from
Feb 5, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
80 commits
Select commit Hold shift + click to select a range
4416527
GitHub CI: Add nGraph ONNX check
Oct 12, 2020
a199c65
Fix job name
Oct 12, 2020
e5e2f70
Fix commands
Oct 12, 2020
904df18
Merge remote-tracking branch 'upstream/master' into ngaph_onnx
Oct 12, 2020
89754a5
Enable nGraph Docker
Oct 12, 2020
6688094
Fix
Oct 12, 2020
cb0d371
Fix
Oct 12, 2020
e1c099f
Fix
Oct 12, 2020
4818ad6
Remove Actions
Oct 13, 2020
342a11c
Decrease a number of workers for executing models tests
rblaczkowski Oct 14, 2020
58e3ac2
Enable "Docker run tests"
Oct 14, 2020
c78ed51
Unset parallel execution
rblaczkowski Oct 14, 2020
2113270
Add cloning models
Oct 15, 2020
c565466
Merge branch 'master' into ngaph_onnx
Oct 16, 2020
67b58dc
Update model_zoo_preprocess.sh cmd
Oct 19, 2020
847dda5
Fix model_zoo_preprocess.sh cmd
Oct 19, 2020
c8d2609
Add share
Oct 19, 2020
e3b9e40
ls -alR /mnt/onnxtestdata
Oct 19, 2020
3bf7ddf
Change path
Oct 20, 2020
648efe4
move clone models
Oct 20, 2020
dd01e9d
Update script
Oct 20, 2020
636c2cb
Add wget
Oct 21, 2020
4263c38
Update
Oct 24, 2020
c6632f9
Merge branch 'master' into ngaph_onnx
Oct 24, 2020
f7e06a2
Update to master
Oct 24, 2020
040c290
Merge branch 'ngaph_onnx' of https://github.com/azhogov/openvino into…
Oct 24, 2020
a2c08b8
Update
Oct 24, 2020
d5de619
Update
Oct 24, 2020
1f41e90
clone into tmp
Oct 24, 2020
cf2a802
Enable clone
Oct 24, 2020
a39cb03
Fix
Oct 24, 2020
4069bed
Use model_zoo_preprocess
Oct 24, 2020
09898f6
Add copy to share
Oct 24, 2020
e130f6f
Enable tests
Oct 24, 2020
ee0f1a3
Get MSFT
Oct 24, 2020
069a96f
Run tests
Oct 24, 2020
de1f25a
Try 16 cores
Oct 24, 2020
e063aa2
rub tests
Oct 24, 2020
78ac4d8
list models
Oct 24, 2020
e81845f
run tests
Oct 26, 2020
7ddd690
Run tests, no --model_zoo_xfail
Oct 28, 2020
6e83ca3
Run tests, -n 8
Oct 28, 2020
916d383
Run tests, -n 1
Oct 28, 2020
cb2fd20
Run tests, -n 4
Oct 28, 2020
733144e
Run tests, -n 2
Oct 28, 2020
4ea1616
Merge branch 'master' into ngaph_onnx
Oct 30, 2020
5884616
Merge branch 'master' into ngaph_onnx
Nov 3, 2020
8291ca3
Run with -n 1
Nov 3, 2020
cd7ef4b
Update info
Nov 3, 2020
2c2f07f
Merge branch 'master' into ngaph_onnx
Nov 5, 2020
4ec459b
Merge branch 'master' into ngaph_onnx
Nov 5, 2020
8ec4a08
Merge remote-tracking branch 'upstream/master' into ngaph_onnx
rblaczkowski Jan 19, 2021
3b35a2b
First try to run onnx ci:
rblaczkowski Jan 19, 2021
e82c302
Enable steps
rblaczkowski Jan 20, 2021
0dc25bf
Update cmake
rblaczkowski Jan 20, 2021
7559534
Add destination for cmake build
rblaczkowski Jan 20, 2021
70933fc
Try to fix cmake build
rblaczkowski Jan 20, 2021
be9944d
set ninja and instal dependencies
rblaczkowski Jan 20, 2021
547effb
Merge branch 'master' into ngaph_onnx
Jan 29, 2021
dc15d09
Revert changes from Blaczkowski, Rafal
Feb 1, 2021
647248f
Add swapfile 15 GB, run on AMD CPU 16 cores, 64 GB RAM
Feb 1, 2021
dbbf15c
Enable model_zoo_preprocess.sh
Feb 1, 2021
1537ac9
Add reference-if-able
Feb 1, 2021
e101743
Update
Feb 1, 2021
897dd8e
Merge branch 'master' into ngaph_onnx
Feb 1, 2021
c68c8a7
test_zoo_models.py -n 8
Feb 1, 2021
c826615
Fix clone
Feb 1, 2021
0a8702e
Set LIN_VMSS_VENV_EPHEMERAL_WU2, F8s_v2
Feb 1, 2021
07bc3e5
git clone --single-branch
Feb 1, 2021
74fe670
test_zoo_models.py -n 6, D16as_v4
Feb 2, 2021
79a0ab6
-n 4
Feb 2, 2021
ad55322
clean
Feb 2, 2021
a377848
-n 2
Feb 2, 2021
ed54a71
-n 4, swap 48 GB
Feb 2, 2021
224b2a3
E16ds_v4 (16-128), -n 8
Feb 5, 2021
92b9940
-n 8
Feb 5, 2021
8437faa
Merge branch 'master' into ngaph_onnx
Feb 5, 2021
5e60e86
Set LIN_VMSS_VENV_ONNX_WU2
Feb 5, 2021
489c3f3
-n 4
Feb 5, 2021
c5b1526
del -n 16 for ut
Feb 5, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions .ci/azure/linux.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,11 +38,10 @@ jobs:
curl -H Metadata:true --noproxy "*" "http://169.254.169.254/metadata/instance?api-version=2019-06-01"
whoami
uname -a
which python3
python3 --version
which java
java -version
gcc --version
echo Python3 info ; which python3 ; python3 --version
echo Python info ; which python ; python --version
echo Java info ; which java ; java -version
echo gcc info ; which gcc ; gcc --version
lsb_release
env
cat /proc/cpuinfo
Expand All @@ -51,6 +50,7 @@ jobs:
vmstat -s
df
lsblk -o NAME,HCTL,SIZE,MOUNTPOINT | grep -i "sd"
free -h
displayName: 'System info'

- script: |
Expand Down
83 changes: 29 additions & 54 deletions .ci/azure/linux_ngraph_onnx.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,10 @@ jobs:
- job: nGraph_ONNX_Lin

# About 150% of total time
timeoutInMinutes: 60
timeoutInMinutes: 45

pool:
name: LIN_VMSS_VENV_F8S_WU2
name: LIN_VMSS_VENV_ONNX_WU2

variables:
system.debug: true
Expand All @@ -15,81 +15,56 @@ jobs:
BUILD_TYPE: Release
REPO_DIR: $(Build.Repository.LocalPath)
WORK_DIR: $(Pipeline.Workspace)/_w
BUILD_DIR: $(WORK_DIR)/build
BIN_DIR: $(REPO_DIR)/bin/intel64/$(BUILD_TYPE)
INSTALL_DIR: $(WORK_DIR)/install
MODELS_DIR: /mnt/onnxtestdata/models
TMP_DIR: /mnt/tmp

steps:
- checkout: self
clean: true
lfs: false
submodules: recursive
path: openvino

- script: |
curl -H Metadata:true --noproxy "*" "http://169.254.169.254/metadata/instance?api-version=2019-06-01"
whoami
uname -a
which python3
python3 --version
gcc --version
echo Python3 info ; which python3 ; python3 --version
echo Python info ; which python ; python --version
echo Java info ; which java ; java -version
echo gcc info ; which gcc ; gcc --version
lsb_release
env
cat /proc/cpuinfo
cat /proc/meminfo
cat /etc/fstab
vmstat -s
df
lsblk -o NAME,HCTL,SIZE,MOUNTPOINT | grep -i "sd"
free -h
displayName: 'System info'

- script: |
rm -rf $(WORK_DIR) ; mkdir $(WORK_DIR)
sudo rm -rf $(TMP_DIR) ; sudo mkdir $(TMP_DIR) ; sudo chmod 777 -R $(TMP_DIR)
displayName: 'Make dir'

- script: |
sudo apt --assume-yes install libusb-1.0-0-dev
python3 -m pip install -r ./inference-engine/ie_bridges/python/requirements.txt
# For running Python API tests
python3 -m pip install -r ./inference-engine/ie_bridges/python/src/requirements-dev.txt
displayName: 'Install dependencies'
enabled: false
- checkout: self
clean: true
lfs: false
submodules: recursive
path: openvino

- script: |
wget https://github.com/ninja-build/ninja/releases/download/v1.10.0/ninja-linux.zip
unzip ninja-linux.zip
sudo cp -v ninja /usr/local/bin/
workingDirectory: $(WORK_DIR)
displayName: 'Install Ninja'
enabled: false
- script: docker build --tag=openvino-onnx-ci-image --file=.ci/openvino-onnx/Dockerfile .
displayName: 'Docker build'

- task: CMake@1
inputs:
# CMake must get Python 3.x version by default
cmakeArgs: -GNinja -DCMAKE_BUILD_TYPE=$(BUILD_TYPE) -DENABLE_VPU=OFF -DENABLE_GNA=OFF -DENABLE_OPENCV=OFF -DENABLE_CPPLINT=OFF -DENABLE_TESTS=OFF -DENABLE_MKL_DNN=ON -DENABLE_CLDNN=OFF -DENABLE_PROFILING_ITT=OFF -DENABLE_SAMPLES=OFF -DENABLE_SPEECH_DEMO=OFF -DENABLE_PYTHON=ON -DPYTHON_EXECUTABLE=/usr/bin/python3.6 -DNGRAPH_ONNX_IMPORT_ENABLE=ON -DNGRAPH_INTERPRETER_ENABLE=ON -DNGRAPH_DEBUG_ENABLE=OFF -DNGRAPH_DYNAMIC_COMPONENTS_ENABLE=ON -DCMAKE_INSTALL_PREFIX=$(INSTALL_DIR) $(REPO_DIR)
workingDirectory: $(BUILD_DIR)
enabled: false
- script: ngraph/python/tests/test_onnx/model_zoo_preprocess.sh -d $(TMP_DIR) -o
displayName: 'Get models'

- script: ninja
workingDirectory: $(BUILD_DIR)
displayName: 'Build'
- script: |
ls -alR $(MODELS_DIR)
ls -alR $(TMP_DIR)
displayName: 'List models'
enabled: false

- script: make install
workingDirectory: $(BUILD_DIR)
displayName: 'Install'
enabled: false
- script: sudo fallocate -l 48G /swapfile ; sudo mkswap /swapfile ; sudo swapon /swapfile ; df ; free -h
displayName: 'Create swap'

- script: |
ls -alR $(REPO_DIR)/bin/
ls -alR $(INSTALL_DIR)
displayName: 'List files'
enabled: false

- script: docker build --tag=openvino-onnx-ci-image --file=$(REPO_DIR)/.ci/openvino-onnx/Dockerfile .
workingDirectory: $(BUILD_DIR)
displayName: 'Docker build'
enabled: false
docker run --name openvino-onnx-ci-container --volume $(TMP_DIR)/model_zoo:/root/.onnx/model_zoo --volume $(MODELS_DIR)/msft:/root/.onnx/model_zoo/MSFT openvino-onnx-ci-image
displayName: 'Docker run'

- script: docker run --name openvino-onnx-ci-container openvino-onnx-ci-image
workingDirectory: $(BUILD_DIR)
displayName: 'Docker run tests'
enabled: false
2 changes: 1 addition & 1 deletion ngraph/python/tox.ini
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ commands=
flake8 --ignore=D100,D101,D102,D103,D104,D105,D107,W503 tests/ # ignore lack of docs in tests
mypy --config-file=tox.ini {posargs:src/}
pytest --backend={env:NGRAPH_BACKEND} tests -v -k 'not _cuda' --ignore=tests/test_onnx/test_zoo_models.py
pytest --backend={env:NGRAPH_BACKEND} tests/test_onnx/test_zoo_models.py -v -n 10 -k 'not _cuda' --model_zoo_xfail
pytest --backend={env:NGRAPH_BACKEND} tests/test_onnx/test_zoo_models.py -v -n 4 -k 'not _cuda' --model_zoo_xfail

[testenv:devenv]
envdir = devenv
Expand Down