Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

[NSE-239] Adopt ARROW-7011 #240

Merged
merged 1 commit into from
Apr 12, 2021
Merged

Conversation

zhztheplayer
Copy link
Collaborator

@zhztheplayer zhztheplayer commented Apr 8, 2021

No description provided.

@github-actions
Copy link

github-actions bot commented Apr 8, 2021

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/native-sql-engine/issues

Then could you also rename commit message and pull request title in the following format?

[NSE-${ISSUES_ID}] ${detailed message}

See also:

@github-actions
Copy link

github-actions bot commented Apr 8, 2021


@github-actions
Copy link

github-actions bot commented Apr 8, 2021


@zhouyuan
Copy link
Collaborator

zhouyuan commented Apr 9, 2021

looks like the new cast is more efficient, local tests showed ~2% improvement on TPC-DS power

@@ -40,13 +40,7 @@ T round2(T val, int precision = 2) {
}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks like this round2 func can also utilize below new cast method?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is arrow::Decimal128 stored internally using some char-like stuffs? I didn't see a "Reprecision" method or something is provided so I think it might be OK for just now to use string formatters. By the way I see there is another function std::setprecision might be easier to use than snprintf.

@zhouyuan zhouyuan changed the title [DNM][NSE-239] Adopt ARROW-7011 [NSE-239] Adopt ARROW-7011 Apr 12, 2021
@github-actions
Copy link

#239

@zhouyuan zhouyuan merged commit 7b7bc88 into oap-project:master Apr 12, 2021
@zhouyuan zhouyuan mentioned this pull request Apr 13, 2021
zhouyuan pushed a commit to zhouyuan/native-sql-engine that referenced this pull request Apr 15, 2021
zhouyuan added a commit that referenced this pull request Apr 19, 2021
* [NSE-229] Fix the deprecated code warning in shuffle_split_test (#230)

* fix the deprecated code warning in shuffle_split_test

* fix the code style

* format update

* [NSE-239] Adopt ARROW-7011 (#240)

* [NSE-224] update third party code (#242)

* update third party code

Signed-off-by: Yuan Zhou <[email protected]>

* fix format

Signed-off-by: Yuan Zhou <[email protected]>

* [NSE-176]Arrow install order issue (#231)

* Add Arrow install script

* [NSE-176]Add Arrow install Script in Arrow Data Source

* remove popd parameter for ubuntu

* Change variables to BFS

* Update Arrow Header and Find Arrow function

* Fix one issue with reading wrong Arrow Path

* Update ARROW_CSV=ON

* Update build_arrow=OFF in Scala UT

* Install parent pom file in Scala UT

* [NSE-196] clean up native sql options (#215)

* clean up native sql options

Signed-off-by: Yuan Zhou <[email protected]>

* adding more options

Signed-off-by: Yuan Zhou <[email protected]>

* adding more options

Signed-off-by: Yuan Zhou <[email protected]>

* adding warning log for running on non-intel cpu

Signed-off-by: Yuan Zhou <[email protected]>

* [NSE-206]doc update on feature support status (#253)

* update operators support status

Signed-off-by: Yuan Zhou <[email protected]>

* update docs on operators supporting status

Signed-off-by: Yuan Zhou <[email protected]>

* fix

Signed-off-by: Yuan Zhou <[email protected]>

* [NSE-241] fix hashagg result length (#249)

* fix hashagg result length

Signed-off-by: Yuan Zhou <[email protected]>

* optimize on getting batch size

Signed-off-by: Yuan Zhou <[email protected]>

* using fixed sized output len for hashagg

Signed-off-by: Yuan Zhou <[email protected]>

* fix format

Signed-off-by: Yuan Zhou <[email protected]>

* [NSE-248] fix arrow dependency order (#259)

* Only read .so.300.0.0

* Fix arroow dataset dependency issue

* Add ARROW_S3=ON, Add symlink copy in CMakeList.

Co-authored-by: JiaKe <[email protected]>
Co-authored-by: Hongze Zhang <[email protected]>
Co-authored-by: Wei-Ting Chen <[email protected]>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants