-
Notifications
You must be signed in to change notification settings - Fork 28.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-25486][TEST] Refactor SortBenchmark to use main method #22495
Conversation
Test build #96361 has finished for PR 22495 at commit
|
Test build #96419 has finished for PR 22495 at commit
|
Test build #96441 has finished for PR 22495 at commit
|
Test build #96444 has finished for PR 22495 at commit
|
*/ | ||
class SortBenchmark extends BenchmarkWithCodegen { | ||
object SortBenchmark extends BenchmarkBase { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@yucai . BenchmarkWithCodegen
is different from BenchmarkBase
. Can we keep BenchmarkWithCodegen
?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@dongjoon-hyun SortBenchmark
does not use any function provided in BenchmarkWithCodegen
, so I remove it.
Another option is like #22484 did, make BenchmarkWithCodegen
extend BenchmarkBase
, and then SortBenchmark
can extend BenchmarkWithCodegen
.
Do you prefer the 2nd way?
BTW, congratulations! :)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I got it. +1 for the current one. Thanks, @yucai .
Can one of the admins verify this patch? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, LGTM.
Merged to |
## What changes were proposed in this pull request? Refactor SortBenchmark to use main method. Generate benchmark result: ``` SPARK_GENERATE_BENCHMARK_FILES=1 build/sbt "sql/test:runMain org.apache.spark.sql.execution.benchmark.SortBenchmark" ``` ## How was this patch tested? manual tests Closes apache#22495 from yucai/SPARK-25486. Authored-by: yucai <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
What changes were proposed in this pull request?
Refactor SortBenchmark to use main method.
Generate benchmark result:
How was this patch tested?
manual tests