-
Notifications
You must be signed in to change notification settings - Fork 28.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-7230] [SPARKR] Make RDD private in SparkR. #5895
Conversation
This change also makes all internal uses of the SparkR API use SparkR::: to access private functions
Thanks Shivaram, one thing is the example still refer to the lower level API - however all of them can be pretty easily written using Dataframes I believe. Would it make sense to update those also? It might be confusing for people otherwise. |
Ah yes - thats a good point. I think we can remove the RDD examples and instead add data frame examples as described in https://issues.apache.org/jira/browse/SPARK-6799 . Porting the existing examples may be tricky as they do things like KMeans or Logistic Regression and we don't have ML integration yet. |
Test build #31788 has finished for PR 5895 at commit
|
Thanks. I'm merging this. |
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions. Author: Shivaram Venkataraman <[email protected]> Closes #5895 from shivaram/rrdd-private and squashes the following commits: bdb2f07 [Shivaram Venkataraman] Make RDD private in SparkR. This change also makes all internal uses of the SparkR API use SparkR::: to access private functions (cherry picked from commit c688e3c) Signed-off-by: Reynold Xin <[email protected]>
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions. Author: Shivaram Venkataraman <[email protected]> Closes apache#5895 from shivaram/rrdd-private and squashes the following commits: bdb2f07 [Shivaram Venkataraman] Make RDD private in SparkR. This change also makes all internal uses of the SparkR API use SparkR::: to access private functions
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions. Author: Shivaram Venkataraman <[email protected]> Closes apache#5895 from shivaram/rrdd-private and squashes the following commits: bdb2f07 [Shivaram Venkataraman] Make RDD private in SparkR. This change also makes all internal uses of the SparkR API use SparkR::: to access private functions
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions. Author: Shivaram Venkataraman <[email protected]> Closes apache#5895 from shivaram/rrdd-private and squashes the following commits: bdb2f07 [Shivaram Venkataraman] Make RDD private in SparkR. This change also makes all internal uses of the SparkR API use SparkR::: to access private functions
This change makes the RDD API private in SparkR and all internal uses of the SparkR API use SparkR::: to access private functions.