Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SQL] SPARK-1367 Fix NPE when joining parquet tables by serializing operator output. #292

Closed
wants to merge 1 commit into from

Conversation

marmbrus
Copy link
Contributor

@marmbrus marmbrus commented Apr 1, 2014

No description provided.

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@AmplabJenkins
Copy link

Merged build finished.

@AmplabJenkins
Copy link

Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13649/

@marmbrus
Copy link
Contributor Author

marmbrus commented Apr 1, 2014

Jenkins, test this please.

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@AmplabJenkins
Copy link

Merged build finished. All automated tests passed.

@AmplabJenkins
Copy link

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13654/

@jerryshao
Copy link
Contributor

Hey Michael, it looks cool. One simple question: why HiveTableScan equivalent parameters do not specify as transient?

@marmbrus
Copy link
Contributor Author

marmbrus commented Apr 2, 2014

@jerryshao, good question. It is likely that we could mark quite a few things as transient that are currently not. However, I'm hesitant to do so this close to the 1.0 freeze since, as this bug shows, it is not always easy to reason about what is going to be required at runtime.

At some point before 1.1 we should audit all of the stuff that is being shipped to try and minimize our closure size.

@marmbrus
Copy link
Contributor Author

marmbrus commented Apr 3, 2014

I'm going to close this. @AndreSchumacher fixed it also (and actually checks to make sure the answer is correct!) in #195 and I don't want to cause conflicts.

@marmbrus marmbrus closed this Apr 3, 2014
@marmbrus marmbrus deleted the parquetJoinNPE branch April 7, 2014 23:16
andrewor14 pushed a commit to andrewor14/spark that referenced this pull request Apr 7, 2014
standard Naive Bayes classifier

Has implemented the standard Naive Bayes classifier. This is an updated version of apache#288, which is closed because of misoperations.
gatesn pushed a commit to gatesn/spark that referenced this pull request Mar 14, 2018
bzhaoopenstack pushed a commit to bzhaoopenstack/spark that referenced this pull request Sep 11, 2019
Remove docker-machine jobs --debug option
arjunshroff pushed a commit to arjunshroff/spark that referenced this pull request Nov 24, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants