-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Move fileformat's config setting into HiveConnectorUtils #10915
Conversation
✅ Deploy Preview for meta-velox canceled.
|
@xiaoxmeng Can you help to review this PR? Thanks. |
6121072
to
868d253
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@JkSelf looks good % minors. Thanks for the refactoring!
868d253
to
a6d2f6e
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@JkSelf Thanks for the update!
a6d2f6e
to
0c5c81d
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@JkSelf LGTM. Thanks!
@xiaoxmeng has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
namespace { | ||
|
||
#ifdef VELOX_ENABLE_PARQUET | ||
std::optional<TimestampUnit> getTimestampUnit( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
getTimestampUnit
and getTimestampTimeZone
is not parquet specific
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@Yuhta Thanks for your catch. It should be VELOX_ENABLE_ARROW
. I have updated. Can you help to review again? Thanks.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@Yuhta It seems we still need to use VELOX_ENABLE_PARQUET here. Otherwise the build will failed with following exceptions:
error: ‘getTimestampUnit’ was not declared in this scope; did you mean ‘TimestampUnit’?
a1a9d01
to
3e10282
Compare
@xiaoxmeng merged this pull request in 1900d60. |
Conbench analyzed the 1 benchmark run on commit There were no benchmark performance regressions. 🎉 The full Conbench report has more details. |
Summary: Recent refactor facebookincubator#10915 breaks the capability to write to Nimble table in Hive connector, fix it. Differential Revision: D62302602
Summary: Pull Request resolved: facebookincubator#10941 Recent refactor facebookincubator#10915 breaks the capability to write to Nimble table in Hive connector, fix it. Reviewed By: xiaoxmeng Differential Revision: D62302602
Summary: Pull Request resolved: facebookincubator#10941 Recent refactor facebookincubator#10915 breaks the capability to write to Nimble table in Hive connector, fix it. Reviewed By: xiaoxmeng Differential Revision: D62302602
Summary: Pull Request resolved: facebookincubator#10941 Recent refactor facebookincubator#10915 breaks the capability to write to Nimble table in Hive connector, fix it. Reviewed By: xiaoxmeng Differential Revision: D62302602
Summary: Pull Request resolved: facebookincubator#10941 Recent refactor facebookincubator#10915 breaks the capability to write to Nimble table in Hive connector, fix it. Reviewed By: xiaoxmeng Differential Revision: D62302602
Refactor the config setting logic from fileformat's writer to HiveConnectorUtils.