Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-7230] [SPARKR] Make RDD private in SparkR. #5895

Closed
wants to merge 1 commit into from

Conversation

shivaram
Copy link
Contributor

@shivaram shivaram commented May 4, 2015

This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions.

This change also makes all internal uses of the SparkR API
use SparkR::: to access private functions
@shivaram shivaram changed the title [SPARKR-7230] Make RDD private in SparkR. [SPARK-7230] [SPARKR] Make RDD private in SparkR. May 4, 2015
@shivaram
Copy link
Contributor Author

shivaram commented May 4, 2015

cc @rxin @pwendell

@pwendell
Copy link
Contributor

pwendell commented May 4, 2015

Thanks Shivaram, one thing is the example still refer to the lower level API - however all of them can be pretty easily written using Dataframes I believe. Would it make sense to update those also? It might be confusing for people otherwise.

@shivaram
Copy link
Contributor Author

shivaram commented May 4, 2015

Ah yes - thats a good point. I think we can remove the RDD examples and instead add data frame examples as described in https://issues.apache.org/jira/browse/SPARK-6799 . Porting the existing examples may be tricky as they do things like KMeans or Logistic Regression and we don't have ML integration yet.

@SparkQA
Copy link

SparkQA commented May 4, 2015

Test build #31788 has finished for PR 5895 at commit bdb2f07.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@rxin
Copy link
Contributor

rxin commented May 5, 2015

Thanks. I'm merging this.

@asfgit asfgit closed this in c688e3c May 5, 2015
asfgit pushed a commit that referenced this pull request May 5, 2015
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions.

Author: Shivaram Venkataraman <[email protected]>

Closes #5895 from shivaram/rrdd-private and squashes the following commits:

bdb2f07 [Shivaram Venkataraman] Make RDD private in SparkR. This change also makes all internal uses of the SparkR API use SparkR::: to access private functions

(cherry picked from commit c688e3c)
Signed-off-by: Reynold Xin <[email protected]>
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions.

Author: Shivaram Venkataraman <[email protected]>

Closes apache#5895 from shivaram/rrdd-private and squashes the following commits:

bdb2f07 [Shivaram Venkataraman] Make RDD private in SparkR. This change also makes all internal uses of the SparkR API use SparkR::: to access private functions
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions.

Author: Shivaram Venkataraman <[email protected]>

Closes apache#5895 from shivaram/rrdd-private and squashes the following commits:

bdb2f07 [Shivaram Venkataraman] Make RDD private in SparkR. This change also makes all internal uses of the SparkR API use SparkR::: to access private functions
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions.

Author: Shivaram Venkataraman <[email protected]>

Closes apache#5895 from shivaram/rrdd-private and squashes the following commits:

bdb2f07 [Shivaram Venkataraman] Make RDD private in SparkR. This change also makes all internal uses of the SparkR API use SparkR::: to access private functions
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants