Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add DynamicRowView and its reader #5075

Closed

Conversation

laithsakka
Copy link
Contributor

Summary:
A DynamicRowView can represent a row vector of any width of any types, without having to be typed.
It has two functions:

  1. size() : width of the struct.
  2. at(int i) : return generic view for the field i.

This simplify and enable writing functions with rows of unknown
or unlimited types. This is also needed to support row types
in the GenericWriter copy_from operation.

next diff will plug DynamicRowView and DynamicRowWriter in the
simple function interface and then row support for generic writer
copy_from operation will be added.

Differential Revision: D46299159

@netlify
Copy link

netlify bot commented May 30, 2023

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit 05ed1ee
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/647f9f19c25070000830a566

@facebook-github-bot facebook-github-bot added CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported labels May 30, 2023
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D46299159

laithsakka added a commit to laithsakka/velox that referenced this pull request May 30, 2023
Summary:
Pull Request resolved: facebookincubator#5075

A DynamicRowView can represent a row vector of any width of any types, without having to be typed.
It has two functions:
1. size() : width of the struct.
2. at(int i) : return generic view for the field i.

This simplify and enable writing functions with rows of unknown
or unlimited types. This is also needed  to support row types
in the GenericWriter copy_from operation.

next diff will plug DynamicRowView and DynamicRowWriter in the
simple function interface and then row support for generic writer
copy_from operation will be added.

Differential Revision: D46299159

fbshipit-source-id: 6380cee1ce487664f727cba3d485adf629ead46d
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D46299159

laithsakka added a commit to laithsakka/velox that referenced this pull request May 31, 2023
Summary:
Pull Request resolved: facebookincubator#5075

A DynamicRowView can represent a row vector of any width of any types, without having to be typed.
It has two functions:
1. size() : width of the struct.
2. at(int i) : return generic view for the field i.

This simplify and enable reading vectors of rows with unknown
or unlimited types. This is also needed  to support row types
in the GenericWriter copy_from operation.

This can't be used in the simple function interface as top level because our
function signature does not support it but it generics can be casted
to it. It is needed to enable row
support in generic writer copy_from operation will be added.

Differential Revision: D46299159

fbshipit-source-id: d54e6dc6405ddbdfc6a252a0d028c864278485ff
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D46299159

Summary:
Pull Request resolved: facebookincubator#5075

A DynamicRowView can represent a row vector of any width of any types, without having to be typed.
It has two functions:
1. size() : width of the struct.
2. at(int i) : return generic view for the field i.

This simplify and enable reading vectors of rows with unknown
or unlimited types. This is also needed  to support row types
in the GenericWriter copy_from operation.

This can't be used in the simple function interface as top level because our
function signature does not support it but it generics can be casted
to it. It is needed to enable row
support in generic writer copy_from operation will be added.

Reviewed By: kevinwilfong, kagamiori

Differential Revision: D46299159

fbshipit-source-id: 41ba4d49197f9f71e66f13157175ef79f4efba2f
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D46299159

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 7f43495.

@conbench-facebook
Copy link

Conbench analyzed the 1 benchmark run on commit 7f43495f.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants