Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-12719][HOTFIX] Fix compilation against Scala 2.10 #11787

Closed
wants to merge 1 commit into from

Conversation

yy2016
Copy link

@yy2016 yy2016 commented Mar 17, 2016

What changes were proposed in this pull request?

Compilation against Scala 2.10 fails with:

[error] [warn] /home/jenkins/workspace/spark-master-compile-sbt-scala-2.10/sql/hive/src/main/scala/org/apache/spark/sql/hive/SQLBuilder.scala:483: Cannot check match for         unreachability.
[error] (The analysis required more space than allowed. Please try with scalac -Dscalac.patmat.analysisBudget=512 or -Dscalac.patmat.analysisBudget=off.)
[error] [warn]     private def addSubqueryIfNeeded(plan: LogicalPlan): LogicalPlan = plan match {

How was this patch tested?

Compilation against Scala 2.10

@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@gatorsmile
Copy link
Member

You are using a wrong JIRA number.

@JoshRosen
Copy link
Contributor

Why not just increase the pattern match analysis budget?

@yy2016
Copy link
Author

yy2016 commented Mar 17, 2016

This was the first build which failed:
https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Compile/job/SPARK-master-COMPILE-sbt-SCALA-2.10/500/

There was only one checkin:
[SPARK-12719][SQL] SQL generation support for Generate

@yy2016
Copy link
Author

yy2016 commented Mar 17, 2016

bq. Why not just increase the pattern match analysis budget

There is a chance the new budget gets exceeded in the future when more cases are added.

@yhuai
Copy link
Contributor

yhuai commented Mar 17, 2016

Thanks. I am merging this to master.

@asfgit asfgit closed this in 3ee7996 Mar 17, 2016
@yhuai
Copy link
Contributor

yhuai commented Mar 17, 2016

Just reverted it because it breaks the build.

@yy2016
Copy link
Author

yy2016 commented Mar 17, 2016

I wonder why OneRowRelation isn't covered by the following import ?

import org.apache.spark.sql.catalyst.plans.logical._

@liancheng
Copy link
Contributor

@yy2016 OneRowRelation is an object rather than a class, and should be matched using case OneRowRelation =>.

@yy2016
Copy link
Author

yy2016 commented Mar 18, 2016

@liancheng
What's your preference ?
@JoshRosen suggested defining Dscalac.patmat.analysisBudget

@liancheng
Copy link
Contributor

I agree with @JoshRosen. Was just answering your question above :)

roygao94 pushed a commit to roygao94/spark that referenced this pull request Mar 22, 2016
## What changes were proposed in this pull request?

Compilation against Scala 2.10 fails with:
```
[error] [warn] /home/jenkins/workspace/spark-master-compile-sbt-scala-2.10/sql/hive/src/main/scala/org/apache/spark/sql/hive/SQLBuilder.scala:483: Cannot check match for         unreachability.
[error] (The analysis required more space than allowed. Please try with scalac -Dscalac.patmat.analysisBudget=512 or -Dscalac.patmat.analysisBudget=off.)
[error] [warn]     private def addSubqueryIfNeeded(plan: LogicalPlan): LogicalPlan = plan match {
```

## How was this patch tested?

Compilation against Scala 2.10

Author: tedyu <[email protected]>

Closes apache#11787 from yy2016/master.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants