[CH-434] convert partition name to lower case #435
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Refactor releasing process
Simplify strip for new packages
…l_flag Resurrect build hash
…ash_v2 One more try to resurrect build hash
New package clickhouse-keeper
Docker release and regular builds
Fix automatic bucket prefix for master
…id IPv6, IPv4 values
…ease Backport release to 22.3
Backport ClickHouse#35799 to 22.3: Fix extract function parser
Backport ClickHouse#35733 to 22.3: Added settings for insert of invalid IPv6, IPv4 values
Backport ClickHouse#35820 to 22.3: Avoid processing per-column TTL multiple times
- Allow define version as file - Add inline cache - Fix auto_release_type function
Support functions position/locate
…ence#354) ShuffleSplitter improvement: support multiple subdirs
Support full join with join condition Co-authored-by: shuai.li <[email protected]>
Support Decimal type in Gluten Co-authored-by: shuai.li <[email protected]>
…like Column 'deviceid' is not presented in input data (Kyligence#388)
Co-authored-by: shuai.li <[email protected]>
…voking of JNI_Onload and finalized once at exit (Kyligence#377)
Co-authored-by: shuai.li <[email protected]>
Support partitioning with expressions
Co-authored-by: Robert Schulze <[email protected]>
|
Can one of the admins verify this patch? |
taiyang-li
reviewed
Apr 17, 2023
| @@ -12,5 +12,6 @@ class StringUtils | |||
| public: | |||
| static PartitionValues parsePartitionTablePath(const std::string & file); | |||
| static bool isNullPartitionValue(const std::string & value); | |||
| static std::string toLowerCase(const std::string & value); | |||
There was a problem hiding this comment.
it is better to use boost::to_lower or boost::to_lower_copy, like in other places of CH codes
taiyang-li
reviewed
Apr 17, 2023
| @@ -13,15 +13,25 @@ PartitionValues StringUtils::parsePartitionTablePath(const std::string & file) | |||
| auto position = item.find('='); | |||
| if (position != std::string::npos) | |||
| { | |||
| result.emplace_back(PartitionValue(item.substr(0,position), item.substr(position+1))); | |||
| result.emplace_back(PartitionValue(toLowerCase(item.substr(0,position)), item.substr(position+1))); | |||
There was a problem hiding this comment.
应该不止这个地方要改。
下面这段代码，从partition_values中搜索name之前，也需要将name统一转化成小写。
There was a problem hiding this comment.
parquet文件中的列名匹配是否忽略大小写，是由FormatSetting::ORC::case_insensitive_column_matching和FormatSetting::Parquet::case_insensitive_column_matching控制的。这里最好也加上相应的开关判断。
liuneng1994
force-pushed
the
clickhouse_backend
branch
from
6528ff0
to
52be833
Compare
lwz9103
force-pushed
the
clickhouse_backend
branch
2 times, most recently
from
dc60d55
to
8066113
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Changelog category (leave one):
Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
This pr converts partition names get from hdfs path to lower case, as spark paritiions are in lower case.
It fix #434 .