Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase approx abs #2826

Conversation

AlexanderDokuchaev
Copy link
Collaborator

Changes

Increase abs from 1e-2 to 3e-2

Reason for changes

Size of pruned and not prunned IR models can changes by openvino version.
it's not first time when reference size required to be change, so increase threshold to be more tolerance.

2024.2
desc0 pruned_file_bytes=596  not_pruned_file_bytes=932
desc1 pruned_file_bytes=1004  not_pruned_file_bytes=1340
desc2 pruned_file_bytes=2552  not_pruned_file_bytes=2756
desc3 pruned_file_bytes=584  not_pruned_file_bytes=872
desc4 pruned_file_bytes=748  not_pruned_file_bytes=940
desc5 pruned_file_bytes=1156  not_pruned_file_bytes=1900
desc6 pruned_file_bytes=1240  not_pruned_file_bytes=1900
desc7 pruned_file_bytes=620  not_pruned_file_bytes=956

2024.3
desc0 pruned_file_bytes=604  not_pruned_file_bytes=940
desc1 pruned_file_bytes=1004  not_pruned_file_bytes=1340
desc2 pruned_file_bytes=2552  not_pruned_file_bytes=2756
desc3 pruned_file_bytes=584  not_pruned_file_bytes=872
desc4 pruned_file_bytes=748  not_pruned_file_bytes=940
desc5 pruned_file_bytes=1228  not_pruned_file_bytes=1972
desc6 pruned_file_bytes=1312  not_pruned_file_bytes=1972
desc7 pruned_file_bytes=620  not_pruned_file_bytes=956

Tests

sparsity.movement.test_model_saving.TestONNXExport.test_ngraph_pruning
sparsity.movement.test_model_saving.TestONNXExport.test_ngraph_pruning

@AlexanderDokuchaev AlexanderDokuchaev requested a review from a team as a code owner July 18, 2024 16:02
@github-actions github-actions bot added the NNCF PT Pull requests that updates NNCF PyTorch label Jul 18, 2024
@AlexanderDokuchaev
Copy link
Collaborator Author

precommit/job/ubuntu20_precommit_pytorch/6653/

@KodiaqQ KodiaqQ requested review from KodiaqQ and removed request for KodiaqQ July 22, 2024 11:23
@AlexanderDokuchaev AlexanderDokuchaev merged commit e70befd into openvinotoolkit:develop Jul 22, 2024
12 checks passed
AlexanderDokuchaev added a commit to AlexanderDokuchaev/nncf that referenced this pull request Jul 22, 2024
### Changes

Increase abs from 1e-2 to 3e-2

### Reason for changes

Size of pruned and not prunned IR models can changes by openvino
version.
it's not first time when reference size required to be change, so
increase threshold to be more tolerance.

```
2024.2
desc0 pruned_file_bytes=596  not_pruned_file_bytes=932
desc1 pruned_file_bytes=1004  not_pruned_file_bytes=1340
desc2 pruned_file_bytes=2552  not_pruned_file_bytes=2756
desc3 pruned_file_bytes=584  not_pruned_file_bytes=872
desc4 pruned_file_bytes=748  not_pruned_file_bytes=940
desc5 pruned_file_bytes=1156  not_pruned_file_bytes=1900
desc6 pruned_file_bytes=1240  not_pruned_file_bytes=1900
desc7 pruned_file_bytes=620  not_pruned_file_bytes=956

2024.3
desc0 pruned_file_bytes=604  not_pruned_file_bytes=940
desc1 pruned_file_bytes=1004  not_pruned_file_bytes=1340
desc2 pruned_file_bytes=2552  not_pruned_file_bytes=2756
desc3 pruned_file_bytes=584  not_pruned_file_bytes=872
desc4 pruned_file_bytes=748  not_pruned_file_bytes=940
desc5 pruned_file_bytes=1228  not_pruned_file_bytes=1972
desc6 pruned_file_bytes=1312  not_pruned_file_bytes=1972
desc7 pruned_file_bytes=620  not_pruned_file_bytes=956
```

### Tests

sparsity.movement.test_model_saving.TestONNXExport.test_ngraph_pruning
sparsity.movement.test_model_saving.TestONNXExport.test_ngraph_pruning
KodiaqQ added a commit that referenced this pull request Jul 23, 2024
### Changes

Increase abs from 1e-2 to 3e-2

### Reason for changes

Size of pruned and not prunned IR models can changes by openvino
version.
it's not first time when reference size required to be change, so
increase threshold to be more tolerance.

```
2024.2
desc0 pruned_file_bytes=596  not_pruned_file_bytes=932
desc1 pruned_file_bytes=1004  not_pruned_file_bytes=1340
desc2 pruned_file_bytes=2552  not_pruned_file_bytes=2756
desc3 pruned_file_bytes=584  not_pruned_file_bytes=872
desc4 pruned_file_bytes=748  not_pruned_file_bytes=940
desc5 pruned_file_bytes=1156  not_pruned_file_bytes=1900
desc6 pruned_file_bytes=1240  not_pruned_file_bytes=1900
desc7 pruned_file_bytes=620  not_pruned_file_bytes=956

2024.3
desc0 pruned_file_bytes=604  not_pruned_file_bytes=940
desc1 pruned_file_bytes=1004  not_pruned_file_bytes=1340
desc2 pruned_file_bytes=2552  not_pruned_file_bytes=2756
desc3 pruned_file_bytes=584  not_pruned_file_bytes=872
desc4 pruned_file_bytes=748  not_pruned_file_bytes=940
desc5 pruned_file_bytes=1228  not_pruned_file_bytes=1972
desc6 pruned_file_bytes=1312  not_pruned_file_bytes=1972
desc7 pruned_file_bytes=620  not_pruned_file_bytes=956
```

### Tests

sparsity.movement.test_model_saving.TestONNXExport.test_ngraph_pruning

Co-authored-by: Nikita Malinin <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NNCF PT Pull requests that updates NNCF PyTorch
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants