Skip to content

Commit

Permalink
Added similarity for weight compression with 2024.4 (#2958)
Browse files Browse the repository at this point in the history
### Changes

as stated in the title

### Reason for changes

same as in #2954

### Tests

- [x] job with 2024.3
(job/NNCF/job/manual/job/post_training_weight_compression/169)

![image](https://github.com/user-attachments/assets/65176721-e19c-4c14-9d46-433e85c84732)
- [x] job with RC 2024.4
(job/NNCF/job/manual/job/post_training_weight_compression/167)

![image](https://github.com/user-attachments/assets/46683431-a6d1-4d6b-bcb4-d7c00e12ce8c)
- [x] job with 2024.5
(job/NNCF/job/manual/job/post_training_weight_compression/168)

![image](https://github.com/user-attachments/assets/34d72695-ed0d-4310-9a13-588f2aac98ec)
  • Loading branch information
ljaljushkin authored Sep 11, 2024
1 parent c0e24ec commit 4401d44
Show file tree
Hide file tree
Showing 2 changed files with 22 additions and 12 deletions.
22 changes: 22 additions & 0 deletions tests/post_training/data/wc_reference_data_2024.4.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
tinyllama_data_aware_awq_stateful_backend_OV:
metric_value: 0.85571
num_int4: 94
num_int8: 124
tinyllama_data_aware_awq_scale_estimation_backend_OV:
metric_value: 0.86355
num_int4: 94
num_int8: 124
tinyllama_data_aware_awq_scale_estimation_stateful_backend_OV:
metric_value: 0.86355
num_int4: 94
num_int8: 124
tinyllama_data_aware_gptq_backend_OV:
metric_value: 0.86521
num_int4: 94
num_int8: 124
metrics_xfail_reason: "Issue-148819"
tinyllama_scale_estimation_per_channel_backend_OV:
metric_value: 0.80853
num_int4: 188
num_int8: 124
metrics_xfail_reason: "Issue-148819"
12 changes: 0 additions & 12 deletions tests/post_training/data/wc_reference_data_2024.5.yaml
Original file line number Diff line number Diff line change
@@ -1,15 +1,3 @@
tinyllama_data_aware_awq_stateful_backend_OV:
metric_value: 0.85571
num_int4: 94
num_int8: 124
tinyllama_data_aware_awq_scale_estimation_backend_OV:
metric_value: 0.86355
num_int4: 94
num_int8: 124
tinyllama_data_aware_awq_scale_estimation_stateful_backend_OV:
metric_value: 0.86355
num_int4: 94
num_int8: 124
tinyllama_data_aware_gptq_backend_OV:
metric_value: 0.81664
num_int4: 94
Expand Down

0 comments on commit 4401d44

Please sign in to comment.