Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[vulkan] Add conform API methods to memory allocator to fix block allocations #8130

Merged
merged 7 commits into from
Mar 6, 2024

Conversation

derek-gerstmann
Copy link
Contributor

@derek-gerstmann derek-gerstmann commented Mar 1, 2024

As reported in #8079 ...

Vulkan's API permits any arbitrary alignment and padding on every Buffer allocation, which means that the memory requirements have to be queried for every block and region prior to binding device memory.

Previously, we were only querying the requirements on the creation of the block, and assuming that all regions (which used the same device memory pool, and physical allocation) would match. This was an invalid assumption, and was only partially fixed in #8087.

This PR introduces a new conform callback API which allows block and region allocations to query the memory requirements before the block allocator actually binds memory and creates/splits regions.

I also added more test cases in /test/runtime/runtime_internal_block_allocator to verify the size, alignment and offsets are constrained as expected.

Fixes #8079

Derek Gerstmann added 2 commits March 1, 2024 08:48
Override conform requests for Vulkan memory allocator
Cleanup memory requirement constraints for Vulkan
Add conform test cases to block_allocator runtime test.
@steven-johnson
Copy link
Contributor

Some minor compilation errors need fixing

@derek-gerstmann derek-gerstmann merged commit 754e6ec into main Mar 6, 2024
19 checks passed
steven-johnson pushed a commit that referenced this pull request Jun 7, 2024
…ocations (#8130)

* Add conform API methods to block and region allocator classes
Override conform requests for Vulkan memory allocator
Cleanup memory requirement constraints for Vulkan
Add conform test cases to block_allocator runtime test.

* Clang format/tidy pas

* Fix unsigned int comparisons

* Clang format pass

* Fix other unsigned int comparisons

* Fix mismatched template types for max()

* Fix whitespace for clang format

---------

Co-authored-by: Derek Gerstmann <[email protected]>
steven-johnson added a commit that referenced this pull request Jun 24, 2024
* [vulkan] Fix Vulkan SIMT mappings for GPU loop vars.  (#8259)

* Fix Vulkan SIMT mappings for GPU loop vars. Previous refactoring
accidentally used the fully qualified var name rather than the
categorized vulkan intrinsic name.

* Avoid formatting the GPU kernel to a string for Vulkan (since it's binary SPIR-V needs to remain intact).

---------

Co-authored-by: Derek Gerstmann <[email protected]>
Co-authored-by: Steven Johnson <[email protected]>

* Update CodeGen_Vulkan_Dev.cpp

* [vulkan] Add conform API methods to memory allocator to fix block allocations (#8130)

* Add conform API methods to block and region allocator classes
Override conform requests for Vulkan memory allocator
Cleanup memory requirement constraints for Vulkan
Add conform test cases to block_allocator runtime test.

* Clang format/tidy pas

* Fix unsigned int comparisons

* Clang format pass

* Fix other unsigned int comparisons

* Fix mismatched template types for max()

* Fix whitespace for clang format

---------

Co-authored-by: Derek Gerstmann <[email protected]>

* Backport fixes for Vulkan in src/runtime/internal for allocations.

---------

Co-authored-by: Derek Gerstmann <[email protected]>
Co-authored-by: Derek Gerstmann <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Vulkan backend bug in region_allocator
2 participants