Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[XLA:GPU] Add profiler annotation for sequential thunk. #21134

Conversation

shawnwang18
Copy link
Contributor

@shawnwang18 shawnwang18 commented Jan 8, 2025

This PR wraps sequential thunk with profiler annotations, which will make loop iterations, and conditional branch more easy to read in the profiler.

The nsys profile looks like this:

image

@shawnwang18 shawnwang18 added the kokoro:force-run Forces CI to rerun label Jan 8, 2025
@kokoro-team kokoro-team removed the kokoro:force-run Forces CI to rerun label Jan 8, 2025
@shawnwang18 shawnwang18 requested a review from ezhulenev January 8, 2025 09:51
copybara-service bot pushed a commit that referenced this pull request Jan 11, 2025
Imported from GitHub PR #21134

This PR wraps sequential thunk with profiler annotations, which will make loop iterations, and conditional branch more easy to read in the profiler.

The nsys profile looks like this:

![image](https://github.com/user-attachments/assets/8a3dd0be-4e1a-4516-ae64-b376336799bd)

Copybara import of the project:

--
eea74b8 by Shawn Wang <[email protected]>:

add nvtx marker for sequential thunk

Merging this change closes #21134

FUTURE_COPYBARA_INTEGRATE_REVIEW=#21134 from shawnwang18:shawnw/add_profiler_for_while_body_cond eea74b8
PiperOrigin-RevId: 713359421
copybara-service bot pushed a commit to tensorflow/tensorflow that referenced this pull request Jan 11, 2025
Imported from GitHub PR openxla/xla#21134

This PR wraps sequential thunk with profiler annotations, which will make loop iterations, and conditional branch more easy to read in the profiler.

The nsys profile looks like this:

![image](https://github.com/user-attachments/assets/8a3dd0be-4e1a-4516-ae64-b376336799bd)

Copybara import of the project:

--
eea74b86f5e2b71c915553ec302e16645927e191 by Shawn Wang <[email protected]>:

add nvtx marker for sequential thunk

Merging this change closes #21134

FUTURE_COPYBARA_INTEGRATE_REVIEW=openxla/xla#21134 from shawnwang18:shawnw/add_profiler_for_while_body_cond eea74b86f5e2b71c915553ec302e16645927e191
PiperOrigin-RevId: 713359421
copybara-service bot pushed a commit to tensorflow/tensorflow that referenced this pull request Jan 11, 2025
Imported from GitHub PR openxla/xla#21134

This PR wraps sequential thunk with profiler annotations, which will make loop iterations, and conditional branch more easy to read in the profiler.

The nsys profile looks like this:

![image](https://github.com/user-attachments/assets/8a3dd0be-4e1a-4516-ae64-b376336799bd)

Copybara import of the project:

--
eea74b86f5e2b71c915553ec302e16645927e191 by Shawn Wang <[email protected]>:

add nvtx marker for sequential thunk

Merging this change closes #21134

PiperOrigin-RevId: 714296359
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants