Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[query_data_files] Utility for querying and decoding results into Arrow buffers #2451

Closed
wants to merge 17 commits into from

Conversation

arnikola
Copy link
Collaborator

@arnikola arnikola commented Jul 8, 2020

What this PR does / why we need it:
POC on decoding directly to Apache Arrow buffers

@arnikola arnikola changed the title Arnikola/arrow iter poc [dbnode] POC for decoding results into Arrow buffers Jul 8, 2020
Copy link
Collaborator

@linasm linasm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@arnikola in addition to annotation (and, way more importantly), we need access to Tags, Id and time Unit.

@arnikola arnikola changed the title [dbnode] POC for decoding results into Arrow buffers [query_data_files] Utility for querying and decoding results into Arrow buffers Jul 22, 2020
@arnikola arnikola marked this pull request as ready for review July 22, 2020 02:43
Copy link
Collaborator

@linasm linasm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe series_block_iterator.go needs its own set of unit tests. That panic on EOF (#2451 (comment)) was caught by tests of a higher level component, but that is too indirect and too incomprehensive.

@arnikola
Copy link
Collaborator Author

I believe series_block_iterator.go needs its own set of unit tests. That panic on EOF (#2451 (comment)) was caught by tests of a higher level component, but that is too indirect and too incomprehensive.

Yeah need to add the test for this, but that bug was fixed in the pr for the integration i believe

@arnikola arnikola added the P: Low label Aug 7, 2020
@arnikola
Copy link
Collaborator Author

arnikola commented Nov 3, 2020

Not going this path

@arnikola arnikola closed this Nov 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants