Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

Naive-sql-engine not support spark-3.0.1 when running TPC-DS. #323

Open
haojinIntel opened this issue May 14, 2021 · 2 comments
Open

Naive-sql-engine not support spark-3.0.1 when running TPC-DS. #323

haojinIntel opened this issue May 14, 2021 · 2 comments
Labels
feature request Feature request

Comments

@haojinIntel
Copy link
Collaborator

When we using OAP-1.1 with spark-3.0.1 to run TPC-DS all queries, 19 queries failed. The error message is showed below:

Error: Error running query: java.lang.NoSuchMethodError: org.apache.spark.sql.execution.adaptive.ShuffleQueryStageExec.shuffle()Lorg/apache/spark/sql/execution/exchange/ShuffleExchangeLike; (state=,code=0)

@haojinIntel
Copy link
Collaborator Author

@zhixingheyi-tian @zhouyuan Please help to track the issue. Thanks!

@zhouyuan
Copy link
Collaborator

currently native sql does not have a API layer to connect with different spark version, there are two branches:

for future release we are considering to adding a compatible API layer
#273

@zhouyuan zhouyuan added the feature request Feature request label May 14, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
feature request Feature request
Projects
None yet
Development

No branches or pull requests

2 participants