Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-7036][MLLIB] ALS.train should support DataFrames in PySpark #5619

Closed
wants to merge 1 commit into from

Conversation

mengxr
Copy link
Contributor

@mengxr mengxr commented Apr 21, 2015

SchemaRDD works with ALS.train in 1.2, so we should continue support DataFrames for compatibility. @coderxiang

@SparkQA
Copy link

SparkQA commented Apr 21, 2015

Test build #30691 has finished for PR 5619 at commit dfcaf5a.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.
  • This patch does not change any dependencies.

@mengxr
Copy link
Contributor Author

mengxr commented Apr 21, 2015

test this please

ratings = ratings.rdd
else:
raise TypeError("Ratings should be represented by either an RDD or a DataFrame, "
"but got %s." % type(ratings))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

a minor issue: maybe better to use "%s is provided"

@coderxiang
Copy link
Contributor

LGTM.

@SparkQA
Copy link

SparkQA commented Apr 21, 2015

Test build #30697 has finished for PR 5619 at commit dfcaf5a.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.
  • This patch does not change any dependencies.

asfgit pushed a commit that referenced this pull request Apr 21, 2015
SchemaRDD works with ALS.train in 1.2, so we should continue support DataFrames for compatibility. coderxiang

Author: Xiangrui Meng <[email protected]>

Closes #5619 from mengxr/SPARK-7036 and squashes the following commits:

dfcaf5a [Xiangrui Meng] ALS.train should support DataFrames in PySpark

(cherry picked from commit 686dd74)
Signed-off-by: Xiangrui Meng <[email protected]>
@mengxr
Copy link
Contributor Author

mengxr commented Apr 21, 2015

Merged into master and branch-1.3.

@asfgit asfgit closed this in 686dd74 Apr 21, 2015
markhamstra pushed a commit to markhamstra/spark that referenced this pull request Apr 23, 2015
SchemaRDD works with ALS.train in 1.2, so we should continue support DataFrames for compatibility. coderxiang

Author: Xiangrui Meng <[email protected]>

Closes apache#5619 from mengxr/SPARK-7036 and squashes the following commits:

dfcaf5a [Xiangrui Meng] ALS.train should support DataFrames in PySpark

(cherry picked from commit 686dd74)
Signed-off-by: Xiangrui Meng <[email protected]>
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
SchemaRDD works with ALS.train in 1.2, so we should continue support DataFrames for compatibility. coderxiang

Author: Xiangrui Meng <[email protected]>

Closes apache#5619 from mengxr/SPARK-7036 and squashes the following commits:

dfcaf5a [Xiangrui Meng] ALS.train should support DataFrames in PySpark
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants