Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GPU] Move event completion wait to first of execute_impl #23363

Merged

Conversation

wilson-seok
Copy link
Contributor

Details:

  • Move event completion wait to first of execute_impl

Tickets:

  • 129373

@wilson-seok wilson-seok requested review from a team as code owners March 11, 2024 07:42
@github-actions github-actions bot added the category: GPU OpenVINO GPU plugin label Mar 11, 2024
@ahnyoung-paul
Copy link
Contributor

Could you please check the performance of loop models? thanks.

@wilson-seok
Copy link
Contributor Author

Could you please check the performance of loop models? thanks.

There is no performance regression in the target model. Thanks!

// Wait for event completion
for (auto& e : events) {
e->wait();
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe this will cause regression..
I guess that the target issue is the event of "execution condition" right?
then I think we need to wait for only that event specifically, not for all events..

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I updated the event wait for only execution_condition. Thanks!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@yeonbok No performance regression in several loop including models. Thanks!

Copy link
Contributor

@ahnyoung-paul ahnyoung-paul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will review it again after the code fixing.

@wilson-seok
Copy link
Contributor Author

I will review it again after the code fixing.

I updated it! Thanks!

@yeonbok yeonbok added this pull request to the merge queue Mar 13, 2024
Merged via the queue into openvinotoolkit:master with commit 1a769ce Mar 13, 2024
92 checks passed
@wilson-seok wilson-seok deleted the loop_wait_for_event_completion branch March 13, 2024 05:31
praasz pushed a commit to praasz/openvino that referenced this pull request Mar 13, 2024
…olkit#23363)

### Details:
 - Move event completion wait to first of execute_impl

### Tickets:
 - 129373
vishniakov-nikolai pushed a commit to vishniakov-nikolai/openvino that referenced this pull request Mar 13, 2024
…olkit#23363)

### Details:
 - Move event completion wait to first of execute_impl

### Tickets:
 - 129373
alvoron pushed a commit to alvoron/openvino that referenced this pull request Apr 29, 2024
…olkit#23363)

### Details:
 - Move event completion wait to first of execute_impl

### Tickets:
 - 129373
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: GPU OpenVINO GPU plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants