Skip to content
This repository has been archived by the owner on Aug 13, 2024. It is now read-only.

Commit

Permalink
Upgrade to use Spark 1.6.0 (close #19)
Browse files Browse the repository at this point in the history
  • Loading branch information
alexanderdean committed Mar 28, 2016
1 parent 03f3f98 commit 9990465
Show file tree
Hide file tree
Showing 3 changed files with 7 additions and 8 deletions.
2 changes: 0 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -65,8 +65,6 @@ Once the job has completed, you should see a folder structure like this in your
+- _SUCCESS
+- part-00000
+- part-00001
+- part-00002
+- part-...

Download the files and check that one file contains:

Expand Down
9 changes: 5 additions & 4 deletions project/Dependencies.scala
Original file line number Diff line number Diff line change
Expand Up @@ -20,8 +20,8 @@ object Dependencies {
)

object V {
val spark = "1.3.0"
val specs2 = "1.13" // -> "1.13" when we bump to Scala 2.10.0
val spark = "1.6.0"
val specs2 = "1.13"
val guava = "11.0.1"
// Add versions for your additional libraries here...
}
Expand All @@ -33,7 +33,8 @@ object Dependencies {
// Add additional libraries from mvnrepository.com (SBT syntax) here...

// Scala (test only)
val specs2 = "org.specs2" % "specs2_2.10" % V.specs2 % "test"
val guava = "com.google.guava" % "guava" % V.guava % "test"
val specs2 = "org.specs2" %% "specs2" % V.specs2 % "test"
// Java (test only)
val guava = "com.google.guava" % "guava" % V.guava % "test"
}
}
4 changes: 2 additions & 2 deletions project/SparkExampleProjectBuild.scala
Original file line number Diff line number Diff line change
Expand Up @@ -31,8 +31,8 @@ object SparkExampleProjectBuild extends Build {
Libraries.sparkCore,
Libraries.sparkMllib,
Libraries.sparkSql,
Libraries.guava,
Libraries.specs2
Libraries.specs2,
Libraries.guava
// Add your additional libraries here (comma-separated)...
)
)
Expand Down

0 comments on commit 9990465

Please sign in to comment.