Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix #23553: [OP CONFORMANCE][TEMPLATE] Interpolate test fails in op c… #23636

Closed
wants to merge 15 commits into from

Conversation

runzhangDL
Copy link

The test case failed because it uses a channel-last input pattern, while the linear_onnx_func() assume that all input data have the batch and channel in their first two dimensions. I've added extra condition check in the channel-last case and made it valid to continue the following operations.

Note: The implementation for channel-last input should be different from current one. However, after the input check has been changed, the test case passed already, so I didn't change the following implementation. Please let me know if there are concerns with this and I am happy to add extra adjustment.

@praasz
Copy link
Contributor

praasz commented Mar 25, 2024

build_jenkins

@mlukasze
Copy link
Contributor

hey @runzhangDL please correct formatting to bass clang tests

@runzhangDL
Copy link
Author

hey @runzhangDL please correct formatting to bass clang tests

Sure, will update soon. Do I need to fix other failed checks?

@t-jankowski
Copy link
Contributor

hey @runzhangDL please correct formatting to bass clang tests

Sure, will update soon. Do I need to fix other failed checks?

I looks like these changes cause below failures - copied from Linux Static CC (Ubuntu 22.04, Python 3.11, Clang) logs. To reproduce it locally use ./bin/intel64/Debug/ov_onnx_frontend_tests

C++ exception with description "Exception from src/inference/src/cpp/infer_request.cpp:223:
Exception from reference/interpolate.hpp:430:
Axes are not correct!

[  FAILED  ] 11 tests, listed below:
[  FAILED  ] INTERPRETER.onnx_resize11_empty_constant_as_input
[  FAILED  ] INTERPRETER.onnx_resize10_down_scales_const_linear
[  FAILED  ] INTERPRETER.onnx_resize10_up_scales_const_linear
[  FAILED  ] INTERPRETER.onnx_resize11_down_scales_linear_asymmetric
[  FAILED  ] INTERPRETER.onnx_resize11_up_scales_linear_asymmetric
[  FAILED  ] INTERPRETER.onnx_resize11_up_sizes_linear_asymmetric
[  FAILED  ] INTERPRETER.onnx_resize11_down_sizes_linear_pytorch_half_pixel
[  FAILED  ] INTERPRETER.onnx_upsample6_bilinear_infer
[  FAILED  ] INTERPRETER.onnx_upsample8_linear_infer
[  FAILED  ] INTERPRETER.onnx_upsample9_scales_const_linear_infer
[  FAILED  ] INTERPRETER.onnx_empty_initializers_handling

@runzhangDL
Copy link
Author

runzhangDL commented Mar 25, 2024

NTERPRETER.onnx_resize11_up_scales_linear_asymmetric

Ok I will try to look into it. It might be easier if I can see the test cases detail to debug why they failed.

@iefode
Copy link
Contributor

iefode commented Apr 1, 2024

@mitruska Could you please take a look?

@iefode iefode added conformance ExternalPR External contributor labels Apr 1, 2024
@runzhangDL
Copy link
Author

Still working on this, will require a bit more time. It will help if someone can confirm whether we need to add support for batch-last case on interpolation, which might cause failure of other test cases? Or we just remove the interpolation case where batch was put in the last dimension?

@runzhangDL
Copy link
Author

Sorry for the delay, I was distracted by my courseworks, and will look into this issue soon.

Copy link
Contributor

@mitruska mitruska left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello @iefode and @runzhangDL, I can see the work is in progress;)
For any changes in the Interpolate reference implementation, please add corresponding unit test to:

std::vector<InterpolateV4TestParams> generateParamsForInterpolate_v4_linear_onnx() {

@mlukasze
Copy link
Contributor

mlukasze commented Apr 5, 2024

build_jenkins

@runzhangDL
Copy link
Author

I am still working on the interpolation implementation, should be done soon

@github-actions github-actions bot removed the Stale label May 21, 2024
@iefode
Copy link
Contributor

iefode commented Jun 3, 2024

@mitruska Hi Mitrus, I've added the channel-last test case at the bottom. It is basically the same to the previous test case but move the spatial axis from (2,3) to (1,2) and channel at the last. The input and expected output should be the same, because only spatial dimension was changed. The test case run successfully in my local machine. Please take a look if it is convenient and let me know any other edits are needed

@mitruska Could you please take a look?

Comment on lines +644 to +649
{ "linear_onnx.resize_downsample_scales_linear_align_corners_channel_last",
Shape{1, 2, 4, 1},
{1, 2},
Shape{1, 1, 2, 1},
{0.6f, 0.6f},
{1, 2},
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test case is okay, but it would be good to add few more tests,
especially with the last dimension not equal to 1.

@mlukasze
Copy link
Contributor

hey @runzhangDL, will you find a time to finish this PR?

Copy link
Contributor

github-actions bot commented Jul 3, 2024

This PR will be closed in a week because of 2 weeks of no activity.

@github-actions github-actions bot added the Stale label Jul 3, 2024
@mlukasze
Copy link
Contributor

mlukasze commented Jul 3, 2024

@t-jankowski & @mitruska
could you take a look, please?

@github-actions github-actions bot removed the Stale label Jul 4, 2024
@runzhangDL
Copy link
Author

hey @runzhangDL, will you find a time to finish this PR?

Apology for the late reply. I will try to finish what I left now. I am currently not sure whether my implementation is correct, because the test code didn't work out to me.

@mlukasze
Copy link
Contributor

mlukasze commented Jul 8, 2024

thanks! let us check it

Copy link
Contributor

This PR will be closed in a week because of 2 weeks of no activity.

@github-actions github-actions bot added the Stale label Jul 23, 2024
@mlukasze mlukasze enabled auto-merge July 23, 2024 05:26
@mlukasze mlukasze requested a review from mitruska July 25, 2024 05:41
@github-actions github-actions bot removed the Stale label Jul 26, 2024
@mlukasze
Copy link
Contributor

build_jenkins

Copy link
Contributor

This PR will be closed in a week because of 2 weeks of no activity.

@github-actions github-actions bot added the Stale label Aug 14, 2024
Copy link
Contributor

This PR was closed because it has been stalled for 2 week with no activity.

@github-actions github-actions bot closed this Aug 22, 2024
auto-merge was automatically disabled August 22, 2024 00:20

Pull request was closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: Core OpenVINO Core (aka ngraph) category: TEMPLATE OpenVINO Template plugin conformance ExternalPR External contributor Stale
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Good First Issue]: [OP CONFORMANCE][TEMPLATE] Interpolate test fails in op conformance
6 participants