-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Pseudo-column for fileSize and fileModifiedTime #1428
Conversation
7f844d0
to
e137f19
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
% comments
I think we could also capture split size, but I am not sure how useful this could be.
@@ -45,6 +45,11 @@ | |||
public static final HiveType BUCKET_HIVE_TYPE = HIVE_INT; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
WRT to commit message:
Add Hive Connector $file_size hidden column
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
bump, for this commit and others
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Resolved it
presto-hive/src/test/java/io/prestosql/plugin/hive/TestHiveIntegrationSmokeTest.java
Outdated
Show resolved
Hide resolved
presto-hive/src/test/java/io/prestosql/plugin/hive/TestHiveIntegrationSmokeTest.java
Outdated
Show resolved
Hide resolved
presto-hive/src/main/java/io/prestosql/plugin/hive/HiveColumnHandle.java
Show resolved
Hide resolved
presto-hive/src/test/java/io/prestosql/plugin/hive/TestHiveIntegrationSmokeTest.java
Outdated
Show resolved
Hide resolved
presto-hive/src/test/java/io/prestosql/plugin/hive/TestHiveIntegrationSmokeTest.java
Outdated
Show resolved
Hide resolved
e137f19
to
558af9b
Compare
@kokosing Thanks for your insights. Have applied your comments. |
presto-hive/src/test/java/io/prestosql/plugin/hive/TestHiveIntegrationSmokeTest.java
Show resolved
Hide resolved
presto-hive/src/test/java/io/prestosql/plugin/hive/TestHiveIntegrationSmokeTest.java
Show resolved
Hide resolved
d585b36
to
71aaf3c
Compare
d7b6c9a
to
604c512
Compare
{ | ||
long testStartTime = Instant.now().toEpochMilli(); | ||
|
||
Thread.sleep(2_000); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
instead of sleep here you could use testStartTime - 2000
4600615
to
c40007c
Compare
c40007c
to
612c266
Compare
Merged, thanks! |
|
||
TableMetadata tableMetadata = getTableMetadata(catalog, TPCH_SCHEMA, "test_file_modified_time"); | ||
|
||
List<String> columnNames = ImmutableList.of("col0", "col1", PATH_COLUMN_NAME, FILE_SIZE_COLUMN_NAME, FILE_MODIFIED_TIME_COLUMN_NAME); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Consider changing test method name to cover more than just "FileModifiedTimeHiddenColumn"
Cherry pick of trinodb/trino#1428 Co-authored-by: Praveen2112 <[email protected]>
Cherry pick of trinodb/trino#1428 Co-authored-by: Praveen2112 <[email protected]>
Fixes #1423. Added two hidden columns for Hive and Iceberg connector.