[GLUTEN-3582] Support PageIndex #4634
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
10 tasks
|
Run Gluten Clickhouse CI |
2 similar comments
|
Run Gluten Clickhouse CI |
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
41bb7c6
to
ee697ce
Compare
|
Run Gluten Clickhouse CI |
1 similar comment
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
ee697ce
to
75c80bf
Compare
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
75c80bf
to
fc21728
Compare
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
fc21728
to
3602d3f
Compare
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
3602d3f
to
f3da025
Compare
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
f3da025
to
a0f3609
Compare
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
a0f3609
to
4274304
Compare
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
4274304
to
5546a07
Compare
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
5546a07
to
90ec782
Compare
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
90ec782
to
9d0f4f1
Compare
|
Run Gluten Clickhouse CI |
|
|
|
Run Gluten Clickhouse CI |
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
9d0f4f1
to
43ffaeb
Compare
|
Run Gluten Clickhouse CI |
add ParquetFileReaderExtBase add readColumnChunkPageBase simpilefy build read remove redundant codes reemove current_row_group_ std::vector<int32_t> row_groups_ => std::deque<int32_t> row_groups_ std::vector<std::unique_ptr<RowRanges>> row_group_row_ranges_ => std::unordered_map<int32_t, std::unique_ptr<RowRanges>> row_group_row_ranges_ std::vector<std::unique_ptr<ColumnIndexStore>> row_group_column_index_stores_ => std::unordered_map<int32_t, std::unique_ptr<ColumnIndexStore>> row_group_column_index_stores_; remove std::vector<std::unique_ptr<parquet::RowGroupMetaData>> row_group_metas_; remove std::vector<std::shared_ptr<parquet::RowGroupPageIndexReader>> row_group_index_readers_
(cherry picked from commit bce0c6668d7bb397127eefeac1943d4c02cf79dc)
fix a stupid bug! add testDataPath getTpcdsDataPath() => tpcdsDataPath getClickHouseLibPath() => clickHouseLibPath
(cherry picked from commit bb0267135243ff8ad980b0521d8302e150a2c4e4)
(cherry picked from commit 98dc9a79bf4f372ecabcac9b47aa06cd328f1aa4)
(cherry picked from commit 2fb41831f4e338503ff620ce5eac9917bdb68f6a)
(cherry picked from commit 1ace73205a033e14ca1659f063eb1df65c3e9969)
(cherry picked from commit e7d8fbe701fcd92fb6cb167686602561adc26ec4)
(cherry picked from commit 1ee0516e2eadf045b4aec63de67cf5cb97810217)
(cherry picked from commit 1e9cdd3b08eb4e026a739ee558e9c2dd0c4c88fb)
…nges>>; using ColumnIndexStoreMap = absl::flat_hash_map<Int32, std::unique_ptr<ColumnIndexStore>>; (cherry picked from commit 610fcd038d24d54fa30bcc40ab0d4d39f60dd0c4)
baibaichen
force-pushed
the
feature/ColumnIndex
branch
from
7c9e7fc
to
a4de18d
Compare
|
Run Gluten Clickhouse CI |
|
LGTM |
Around 8 seconds improvment |
|
Let's Merge |
19 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
getStream(Fixes: #3582)
How was this patch tested?
Using Existed UT