Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Start doc on data attributes / data locators #45

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

mwiebe
Copy link
Contributor

@mwiebe mwiebe commented Apr 17, 2014

No description provided.

@mrocklin
Copy link
Member

Is this roughly how DyND thinks?

Sometimes we use datashape with storage mechanisms like JSON or SQL or compressed HDF5 for which this kind of thinking probably doesn't make sense. How do we handle this mismatch?

@mwiebe
Copy link
Contributor Author

mwiebe commented Apr 17, 2014

This is along the lines of how DyND thinks, yes. In DyND, each type is associated with an array metadata layout, and gets a little bit of memory for that in each array object.

An array of type strided * pointer[int32] has a bit of array metadata information for strided with size and stride data items, immediately followed by some for pointer with an offset and a reference to track ownership of the block of memory all the pointers are pointing into, and then nothing for the int32.

By making the dattr be json, it's going to be less performant but more portable. Things like the reference to track memory ownership for the pointer type probably don't belong in here either.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants