-
Notifications
You must be signed in to change notification settings - Fork 28.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove the getStageInfo() method from SparkContext. #308
Conversation
This method exposes the Stage objects, which are private to Spark and should not be exposed to the user.
Merged build triggered. |
Merged build started. |
Merged build finished. |
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13702/ |
Jenkins, retest this please |
Merged build triggered. |
Merged build started. |
Merged build finished. |
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/13708/ |
Seems good to me unless people wanted to use it directly. If that's the case, we could also mark it as a developer method instead. |
I think this is just an omission that should have been private. If needed we can make it public later on. |
Alright, going to merge this. |
This method exposes the Stage objects, which are private to Spark and should not be exposed to the user. This method was added in apache@01d77f3; ccing @squito here in case there's a good reason to keep this! Author: Kay Ousterhout <[email protected]> Closes apache#308 from kayousterhout/remove_public_method and squashes the following commits: 2e2f009 [Kay Ousterhout] Remove the getStageInfo() method from SparkContext.
Update jobs.yaml comments
This method exposes the Stage objects, which are
private to Spark and should not be exposed to the
user.
This method was added in 01d77f3; ccing @squito here in case there's a good reason to keep this!