Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[python/r] Dense arrays can fail to consolidate with out-of-bounds error [tracking] #3383

Closed
johnkerl opened this issue Nov 23, 2024 · 2 comments

Comments

@johnkerl
Copy link
Member

johnkerl commented Nov 23, 2024

As of #2407 and in particular core 2.27 support for core's "current domain" (soma "domain") in dense arrays written by tiledbsoma, a consolidation invoked by TileDB-Py/TileDB-R/Core can fail with

A range was set outside of the current domain

This is a core defect, not a tiledbsoma defect, but this GitHub issue is for tracking.

(Also note that tiledbsoma does not expose a consolidation API.)

[sc-59793]

@johnkerl johnkerl self-assigned this Nov 25, 2024
@johnkerl johnkerl added blocker and removed blocker labels Nov 25, 2024
@johnkerl johnkerl changed the title [python/r] Dense arrays can fail to consolidate [tracking] [python/r] Dense arrays can fail to consolidate with out-of-bounds error [tracking] Nov 27, 2024
@johnkerl
Copy link
Member Author

The core PR TileDB-Inc/TileDB#5390 is approved

@johnkerl
Copy link
Member Author

johnkerl commented Dec 2, 2024

This will go out with core 2.27.0. Closing, as TileDB-Inc/TileDB#5390 tracks this.

Additionally, that fix will go into the next tiledb-py release, not the upcoming tiledbsoma 1.15.0, as tiledbsoma does not (yet) expose the core conslidation API. (Another good reason not to have a tiledbsoma tracking issue open for this.)

@johnkerl johnkerl closed this as completed Dec 2, 2024
ihnorton pushed a commit to TileDB-Inc/TileDB that referenced this issue Dec 4, 2024
…rent domain (#5390)

This PR addresses a bug in the `Domain::expand_to_tiles(NDRange*)`
function, which previously did not respect the current domain. The lack
of this consideration led to errors when the tile extent was larger than
the current domain, causing out-of-bounds issues during consolidation.
To resolve this, the PR introduces a new function that appropriately
accounts for the current domain.

[sc-59793] and
single-cell-data/TileDB-SOMA#3383

Huge kudos to @-johnkerl for getting 99.9% of this done.

---
TYPE: BUG
DESC: This PR fixes a bug in `Domain::expand_to_tiles(NDRange*)`, which
failed to respect the current domain, causing errors when tile extents
exceeded it. A new function is introduced to properly account for the
current domain during consolidation.

---------

Co-authored-by: John Kerl <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant