Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parquet: plan read ranges ahead of time and fetch them in the background #477

Open
svb-alt opened this issue Sep 26, 2024 · 3 comments
Open

Comments

@svb-alt
Copy link

svb-alt commented Sep 26, 2024

No description provided.

@alex-zaitsev alex-zaitsev changed the title Plan read ranges ahead of time and fetch them in the background Parquet: plan read ranges ahead of time and fetch them in the background Sep 27, 2024
@alex-zaitsev
Copy link
Member

@arthurpassos , could be covered by ClickHouse#69862

@arthurpassos
Copy link
Collaborator

@arthurpassos , could be covered by ClickHouse#69862

Indeed, let's see what is the outcome

@liuneng1994
Copy link

I have only done prefetching in a single thread. Theoretically, it can also be implemented in a multi-threaded model, but it requires a relatively large change in the row group segmentation strategy because prefetching requires serial execution of row groups. There is a lack of corresponding test sets to verify the performance benefits of the row group segmentation strategy.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants