Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some benchmark queries fail or produce incorrect results #330

Open
5 of 21 tasks
andygrove opened this issue Oct 8, 2022 · 2 comments
Open
5 of 21 tasks

Some benchmark queries fail or produce incorrect results #330

andygrove opened this issue Oct 8, 2022 · 2 comments
Assignees
Labels
bug Something isn't working

Comments

@andygrove
Copy link
Member

andygrove commented Oct 8, 2022

Describe the bug

The following queries produce the correct results (SF=1).

  • q4
  • q12
  • q13
  • q14

The following queries produce the correct results (SF=1) except for rounding differences due to bugs in the benchmark (not casting utf8 to decimal correctly).

  • q1
  • q5
  • q7
  • q8
  • q9
  • q18
  • q19

The following queries either fail to run or they produce the wrong results (SF=1).

  • q2 wrong row count 100 vs 460
  • q3 wrong row count 10 vs 11620
  • q6 returns the wrong value
  • q10 returns wrong number of rows 20 vs 37967
  • q11 returns wrong number of rows 1048 vs 29571
  • q15 returns wrong number of rows 1 vs 0
  • Benchmark q16 fails #373
  • q17 produces result with one row but value is null or empty
  • q20 produces results that are almost correct but has an extra whitespace
  • q21 returns the wrong number of rows 100 vs 411
@r4ntix
Copy link
Contributor

r4ntix commented Oct 13, 2022

q16 looks like it's a datafusion-proto issue: apache/datafusion#3820

@andygrove andygrove added this to the Ballista 0.10.0 milestone Oct 17, 2022
@andygrove andygrove changed the title Some benchmark queries fail Some benchmark queries fail or produce incorrect results Oct 28, 2022
@andygrove
Copy link
Member Author

@Dandandan just fyi, here is current status

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants